Galaxy XR voice assistant with Gemini Live

Conversation AI - Intuitive Control, Effortless Experience:

Use natural language to ask anything—Gemini Live understands conversations and contexts for quicker, smoother responses. Whether handling complex tasks or finding quick answers, Gemini Live delivers a seamless experience.

Multimodal Interaction - Effortless AI Engagement:

Control your device and navigate content effortlessly using your hands and voice. Gemini Live understands your surroundings, communicates naturally, and offers helpful insights.

Example: 

You: "This room looks amazing. Can you suggest similar interior designs?"

Gemini Live: "Certainly! Here are some design ideas with a similar aesthetic."

Sports/Media guide: Enhance your sports and media experience with AI that answers questions and delivers relevant information based on what's displayed on your screen.

Note: Functionality is limited for DRM-protected content, as Gemini's 'Share view' feature is unavailable for such material.

Example: "Can you tell me more about the team?"

Travel Planner: Simplify complex travel planning and exploration with conversational AI, enhanced by immersive Maps for a seamless experience.

Example: "What to eat around here?"

System Control: Designed for seamless device management, enabling smooth control of apps and system functions through deep integration and intuitive actions.

Example: First, open YouTube, Maps, or Chrome, then ask your question.

• "Can you show me videos of Taylor Swift?"
• "Show me Italian restaurants in San Francisco." 
• "Show me the latest standings of Barcelona FC." 

Gemini can be activated through multiple methods, including physical buttons, gestures, the app, and voice commands:

• Top Button: Press and hold the Top button to launch Gemini Live.
  Note: Ensure Google is set as the default assistant app.
• Hand gesture: Turn your palm upward to bring up the menu icon, then pinch to open the menu. From the Launcher, select the Gemini Live icon in the Quick panel.
• Voice activation: Say "Hey Google."
  Note: Voice activation is only available when the Google Assistant features in Gemini is turned on.
• Gemini app: Turn your palm upward to bring up the menu icon, then pinch to open the menu. From the Launcher, swipe through the Apps tray, and then select the Gemini app. Then select the Live icon on the input field.

Once you've launched Gemini Live, you can then utilize the following features from the menu:

• Share View: Engage with Gemini Live while sharing your screen. Select the Screen share button so Gemini can view your screen.
  Note: Without this, Gemini Live only listens to your voice and cannot see your screen, limiting functionality for on-screen content. DRM-protected content is not supported.
• Captions: Display Gemini Live responses to track the conversation status.
• Pause: Halt the conversation by selecting the Pause button on the card or saying "Stop." The indicator reflects the paused state.
• End: Terminate the conversation by selecting the End button on the card. The indicator vanishes once it ends.

Minimize the card by clicking outside it, and press and hold the Top button to reopen it.

1. Press the Top button to open the Launcher. Or, use the hand gesture; Hold your palm in front of you until the menu icon appears. Then, pinch your thumb and index fingers together.
2. Select Settings, then select Advanced features, and then select Top button.
3. Select Long press, and then select Digital assistant. Then, make sure Google is selected as the default assistant.

1. Press the Top button to open the Launcher. Or, use the hand gesture; Hold your palm in front of you until the menu icon appears. Then, pinch your thumb and index fingers together when the menu appears.
2. Select Settings, then select Google, and then select Search, Assistant & Voice.
3. Next, select Google Assistant, Gemini, or Voice from the menu on the left to manage and adjust your desired settings.