Google Search's Display of AI-Generated Images Instead of Real Photos Sparks Concerns


Welcome to the AIbase [AI Daily Report] section! Spend three minutes a day to learn about the latest AI events, helping you understand AI industry trends and innovative AI product applications. For more AI news, visit: https://www.aibase.com/zh1. Baidu officially releases the WENXIN Large Model 4.5 series and fully opens it to the public, featuring ten new models with various parameter configurations. These models are trained and inferred using the PaddlePaddle framework, achieving a FLOPs utilization rate of 47%, and perform well in multi-modal text tasks.
The AI image detection system developed by Tencent's Hongyuan Security Team's Zhuque Laboratory can determine if an image is AI-generated within a few seconds by uploading the image and waiting for verification. The system primarily distinguishes between real images and AI-generated images by capturing differences, such as AI-generated images sometimes defying common sense logic, showing unrealistic content like dogs flying with wings or cats smoking cigars.
With the continuous advancement of artificial intelligence technology, the difficulty of forging images and videos has decreased significantly, making the deepfake phenomenon increasingly severe. Identifying these false contents has become an urgent issue to address. Recently, a research team from Binghamton University conducted an in-depth discussion on this topic, using frequency domain analysis techniques to reveal the characteristics of AI-generated images, thus helping people identify false information. Image source note: The image is AI-generated, with permission from image licensing provider Midjourney. This research was conducted by the Department of Electrical and Computer Engineering.
Zomato, a major food delivery platform in India, announced a ban on the use of AI-generated food images on restaurant menus to safeguard customer trust and reduce complaints, refunds, and declines in ratings. CEO Deepinder Goyal emphasized that starting this month, the platform will remove AI-generated images and encourage restaurants to use professional photography services with cost price support. Zomato plans to utilize automation technology to detect and reject the upload of AI images. At the same time, the marketing team has also prohibited the use of such images in promotional materials. Despite taking a strong stance,
Google's new AI search feature may have issues that could promote fraudulent websites and malware. Users have reported search results pointing to junk sites, posing potential malware risks. Google claims to be addressing the problem, but this incident highlights its challenges in handling junk websites. This issue has raised concerns, showing that Google still faces challenges and areas for improvement in the AI search field.