Highlights:

  • Google announced its readiness to roll out its AI-powered image description tool globally.
  • The new generative AI capabilities within Lookout will empower the app to generate an audio description of whatever it’s observing, including photos online.

Google LLC recently appeared at Mobile World Congress 2024 in Barcelona, unveiling a new wave of generative artificial intelligence features to enhance Android smartphones and wearable devices.

Google’s new Android features encompass an AI enhancement for the Messages app, additional functionalities for Android Auto, the capability to retrieve tickets and boarding passes through the Wear OS smartwatch, and more.

Google announced its initiative to enable users to directly access its most advanced generative AI model, Gemini, within the Messages app on any Android smartphone.
Google’s new Android features, currently in beta testing this week, will empower users to compose messages, organize events, brainstorm ideas, and seek assistance with various tasks seamlessly within the Messages app.

Furthermore, Google announced its readiness to roll out its AI-powered image description tool globally. This advancement affects the Lookout application installed on Android smartphones, which is utilized by users with visual impairments to detect and label objects and documents.

The new generative AI capabilities within Lookout will empower the app to generate an audio description of whatever it’s observing, including photos online. The feature was initially introduced in beta in the U.S., the U.K., and Canada in September, and it is exclusively available in English. It still only supports English for now, but it’s being made available globally with the promise of adding support for more languages.

Another accessibility improvement driven by AI is on the way for Google Maps’ Lens function. To recognize eateries, ATMs, bus stops, train stations, and other items in the user’s immediate surroundings, Lens uses artificial intelligence (AI). The information Maps offers about a specific company, including its opening times, reviews, and driving directions, may now be read aloud by Google’s TalkBack screen reader.

Another AI update for Docs is on the way, enabling users to annotate any document with handwritten notes from a tablet or smartphone. Those who would rather edit documents the old-fashioned way can scribble directly onto the document with their finger or a stylus to make edits or highlight specific information.

Fitbit health data is now accessible to the Android Health Connect app. This update slightly improves the utility of Health Connect, which already gathers health data from various third-party apps and devices, including AllTrails, Oura Ring, and MyFitnessPal.

Additionally, as part of Google’s new Android features, Google’s Android Auto vehicle operating system is receiving an infusion of generative artificial intelligence. This advancement enables the system to automatically summarize lengthy texts and group chats, ensuring drivers can stay focused on the road. Users can now listen to what’s being said while keeping their hands on the wheel. The new feature can also suggest quick replies, which can be sent with a quick tap, share an estimated arrival time or initiate a call.

Finally, Google’s Wear OS is gaining the ability to access Google Wallet, allowing it to retrieve useful documents like tickets, boarding passes, and gym memberships and display them on any compatible smartwatch. Moreover, Wear OS can now seamlessly offer directions and public transit information with its added support for Google Maps.