Gemini Live: A more helpful, natural and visual assistant
Our vision is for Gemini to be a universal AI assistant you turn to every day — one that understands the world around you, assists you in completing any task, and is available to explore any idea. At last year’s Made by Google, we launched Gemini Live 1 with the Pixel 9 so you can have natural, free-flowing conversations with Gemini. Since then, we've been rapidly improving it by expanding to new languages and countries, bringing the power of your favorite apps into the conversation, and adding the ability to show Gemini what you see by sharing your camera or screen.
Today, we're advancing our work to make Gemini an even more helpful assistant with upgrades to Gemini Live — it’s more visually aware, more expressive, and deeply integrated with more of your Google apps.
Get visual help with new on-screen guidance
Now, when you share your camera, Gemini not only sees what you see, but it also provides visual guidance by highlighting things directly on your screen. These real-time visual cues create a powerful new way to learn and solve problems together.
Can’t decide between two pairs of sneakers? Gemini can see them both and highlight the one that best matches the outfit you're envisioning. Or maybe you’re trying to figure out the correct tool to use. Point your camera at your tool box, and Gemini can point out the right one.
Visual guidance in Gemini Live will be available on the Pixel 10 series as soon as devices hit shelves on August 28, and will start rolling out to other Android devices that week. We’ll expand to iOS devices in the coming weeks.
Connect to even more Google apps in Gemini Live
A true AI assistant does more than just answer questions — it helps you manage your schedule and connects you with the people in your life, all in one seamless flow. Gemini can do this for you by connecting to the apps you already rely on, and now we’re bringing more of those apps into the conversational experience of Gemini Live.
Juggling your schedule for the week? Talk through your appointments on your Google Calendar, and ask Gemini to set a reminder in Google Tasks for you to pick up your prescription before the pharmacy closes. Or, if you're brainstorming a new recipe for dinner, you can ask Gemini to add all the ingredients to a new shopping list in Google Keep.
These capabilities are powered by integrations with Google Calendar, Keep and Tasks, available today. And soon, we’re adding the Messages, Phone, and Clock apps and bringing additional capabilities into our Google Maps integration, so Gemini Live will be able to help you in even more ways.
For instance, if you’re brainstorming birthday gift ideas for your mom with Gemini Live, when you land on the perfect one, without missing a beat, you can say, “...that’s it! Call Dad so I can ask him to pick it up.”
The same goes for when you're on the move. Imagine you're talking with Gemini to find the fastest subway route. If you realize you’re running behind, you can simply interrupt and say, “This route looks good. Now, send a message to Alex that I'm running about 10 minutes late.” Gemini can draft the text, and you can get back to your navigation.
Hear the difference with more expressive and natural speech
A great conversation is more than just an exchange of words — it’s a natural give and take. We want your chats with Gemini to feel that way, too. We're launching new model updates soon that will dramatically improve how Gemini Live uses the key elements of human speech, like intonation, rhythm and pitch, allowing for a more responsive and expressive conversation. In the coming weeks, you’ll be able to:
- Experience more natural and intuitive interactions. Gemini will respond more appropriately to what you say. If you’re talking about a stressful topic, it might respond with a calmer, more measured voice.
- Control how Gemini speaks. You’ll be able to ask Gemini to speak more slowly if you're taking notes, faster if you're in a hurry or even in a fun accent to liven things up.
- Enjoy dramatic storytelling. Ask Gemini to tell you about the Roman empire from the perspective of Julius Caesar himself, and get a rich, engaging narrative complete with character accents.
Today's updates are all part of our work to make your Gemini a more natural and helpful assistant. We’re excited to build it with you.
