Google is making Gemini Live, its real-time AI assistant, a lot more powerful. Starting next week, the AI will get new tools to help users interact more naturally, including visual guidance, deeper app integrations, and an upgraded audio model.
These updates will first arrive on the Pixel 10 series, launching on August 28th, before expanding to other Android devices and later iOS.
Visual Guidance With Your Camera
One of the most exciting updates is visual guidance. With this feature, you can share your camera feed with Gemini Live, and the AI will highlight items directly on your screen.
For example, if you’re looking for the right tool in a messy toolbox, you can point your camera at the tools, and Gemini will highlight the correct one.
This makes Gemini more practical for real-world problem-solving, bridging the gap between AI and everyday tasks.
Smarter App Integrations
Google is also bringing Gemini deeper into your everyday apps. Soon, Gemini Live will be able to interact with Messages, Phone, and Clock.
Imagine asking Gemini for directions, then quickly saying: “This route looks good. Now send Alex a message that I’ll be 10 minutes late.” Gemini will draft and send the text for you.
This multitasking ability could make the AI a true personal assistant for daily life.
More Natural Voice Interactions
Gemini Live is also getting an updated audio model designed to make conversations feel more human. Google says the chatbot will now capture elements like intonation, rhythm, and pitch more accurately.
This means Gemini can adjust its tone depending on the situation—for example, speaking more calmly when discussing stressful topics.
You’ll also be able to control how fast or slow Gemini talks, and even request dramatic retellings in different accents for a richer experience.
When Will These Features Roll Out?
- Pixel 10 launch (Aug 28): Visual guidance first available
- Other Android devices: Rollout starts same time
- iOS: Coming in the following weeks
With these updates, Google is pushing Gemini Live closer to being a true AI companion that can see, speak, and act more naturally in your daily life.