Latest news shows that Google is testing a feature called "Screen Automation," aimed at allowing its AI assistant Gemini to directly control Android phones, helping users with tasks such as placing orders and making appointments. This feature first appeared in the recent Google app 17.4 beta version, codenamed "Bonobo."
According to 9to5google, this feature enables Gemini to perform specific tasks within applications on the user's device through screen automation technology. Users can let Gemini handle operations such as online shopping and service reservations through simple commands. This functionality is built on the technical foundation of Android 16 QPR3, paving the way for future intelligent operations.
However, Google has also issued a warning: although Gemini can assist users technically, errors may occur during the process, so users need to closely monitor its execution and take responsibility for its actions. Users can interrupt Gemini's operations at any time and take over the task themselves when necessary.
Additionally, enhanced measures have been introduced to protect user privacy. When Gemini interacts with applications, users can choose to enable activity recording, but it should be noted that captured screen images will be reviewed by professional staff to improve Google's services. Google advises users to avoid entering sensitive information, such as login credentials or payment details, while using this feature to prevent personal privacy leaks.
In the beta version, Google also revealed a digital avatar feature called "Wasabi," which will provide users with a 3D virtual avatar for use in Google Meet calls, enhancing the user experience.
In summary, as Gemini's ability to control mobile phones gradually takes shape, we can expect this intelligent assistant to play an increasingly important role in daily life, helping users efficiently complete various tasks.
