Published on: March 9, 2025 / Updated on: March 9, 2025 – Author: Konrad Wolfenstein
Google's smart glasses strategy with Project Astra and Gemini Live: The new era of visual AI assistance from Google – Image: Xpert.Digital
Smart glasses with a twist: Google's vision for a new era of technology
Paradigm shift in sight: Google's path to smart AI in everyday life
Google is on the cusp of a significant technological evolution in wearable technology. Recent developments with Gemini Live, combined with concrete plans for new smart glasses, point to an impending paradigm shift that could fundamentally change how we interact with artificial intelligence. The integration of visual recognition capabilities into Gemini Live on smartphones provides the technological foundation for future smart glasses solutions and marks a strategic turning point in Google's vision for ubiquitous AI assistance in everyday life.
Suitable for:
The second attempt: Google's return to the smart glasses market
Google's first foray into smart glasses dates back over a decade. Google Glass, unveiled in 2012 and discontinued for consumers in 2015, was ahead of its time in many respects. Weighing just 42 grams, the glasses were relatively lightweight, but suffered from practical limitations such as a short battery life of only two to three hours – clearly insufficient for a productive workday. Furthermore, they lacked the crucial element that could make today's smart glasses revolutionary: advanced generative AI.
Following the commercial failure of Google Glass, the company focused on enterprise applications and largely withdrew from the consumer market. Meanwhile, the technology itself continued to evolve. Google's acquisition of North, a manufacturer of Focal smart glasses, a few years ago already indicated a sustained interest in this product category. The new smart glasses Google is now developing are intended to be significantly slimmer and more comfortable than the Focals, thus incorporating lessons learned from previous generations.
Recent reports indicate that Google is in negotiations with established eyewear manufacturers such as EssilorLuxottica, which also owns Ray-Ban. This strategic move could help Google circumvent one of the main problems with Google Glass: its lack of fashion acceptance. Ray-Ban already has experience with smart sunglasses through its collaboration with Meta. These partnerships could be crucial in positioning the new smart glasses as a fashion accessory rather than a flashy technology demonstration.
Suitable for:
Project Astra: The foundation for Google's visual AI assistance
At the heart of Google's smart glasses strategy is "Project Astra"—an ambitious research project to develop a universal visual AI assistant. Google first demonstrated Project Astra at its I/O developer conference in May 2024, showcasing an impressive technical demonstration that highlighted the potential of visual AI assistance.
In a significant organizational restructuring, Google recently integrated the Project Astra team into the Gemini team. This merger underscores Gemini's central role in Google's vision for smart glasses and demonstrates that both technologies are viewed as part of a unified strategy. Within Gemini, the Astra team will focus specifically on live functionalities, further developing Gemini's visual component.
Project Astra's technological foundation is remarkably advanced. Unlike Google Glass, which a decade ago was more of a futuristic vision than a mature product, Project Astra is based on realistic technologies that are already available today. The demonstration at Google I/O showed how a user can view their surroundings through smart glasses and simultaneously talk to an AI assistant about them. What was considered wishful thinking eleven years ago is now technically feasible.
Gemini Live: The bridge between smartphone and smart glasses
The latest developments at Gemini Live form a crucial bridge between current smartphone applications and upcoming smart glasses. In March 2025, Google announced significant enhancements for Gemini Live, primarily improving the visual capabilities of the AI assistant.
The new features include live video input and screen sharing, allowing users to talk to Gemini about what they see in real time. These features are powered by Gemini 2.0 Flash, a version of the multimodal model specifically optimized for fast, mobile applications. Starting in late March 2025, these features will be available to Gemini Advanced subscribers on Android devices as part of the Google One AI Premium plan.
The way these new features work is remarkably intuitive: users can point their smartphone camera at an interesting object and ask Gemini questions directly about it. The AI assistant analyzes the video image in real time and provides contextual information. Users can also share their screen with Gemini and discuss what they see while interacting with the AI bot on their smartphone.
These functions should not be viewed merely as isolated smartphone features, but rather as a direct precursor to the planned smart glasses functionality. Google itself makes this connection clear: “Gemini Live, with its visual component, is essentially the interface that Google intends to use for smart glasses in the near future.” The crucial difference between the smartphone application and smart glasses ultimately lies only in whether the smartphone's display or the camera image of smart glasses is shared – the underlying technology is identical.
Google's upcoming smart glasses
Google's new smart glasses are expected to represent a significant advancement over previous attempts. Gemini will serve as the central element, constantly available to users via both audio and visual feedback. The user's field of vision will be permanently cleared for Gemini, allowing the AI bot to interact with the user virtually in the real world.
The “Gemini Sight” project, submitted to the Gemini API Developer Competition, presented concepts for AI-powered smart glasses that could be particularly helpful for blind and visually impaired people. These revolutionary AI-powered smart glasses are designed to seamlessly integrate with Google services and automate a variety of tasks through simple voice commands – from calendar management and sending emails to making restaurant reservations.
A select group of people has already had the opportunity to gain hands-on experience with the Gemini AI glasses. Reports suggest that the glasses actually deliver the Google Glass experience that Google couldn't achieve over a decade ago. Technological advances, particularly in the field of generative AI, are now making possible what was once just a pipe dream.
Integration with Google services and multimodal skills
A key aspect of the upcoming smart glasses is their comprehensive integration with existing Google services. Gemini can already be linked to numerous Google apps and services, including Gmail, Google Drive, Google Docs, Google Maps, YouTube, Google Flights, and Google Hotels. These connections allow the Assistant to find relevant information more quickly and automate complex tasks.
Gemini Live's multimodal capabilities are continuously expanding. Originally available only in English, Gemini Live now supports over 45 languages, including German. This linguistic versatility is a key step towards the global launch of the smart glasses. Particularly noteworthy is the ability to conduct conversations in up to two languages on the same device and even switch languages mid-sentence.
Gemini Live's visual capabilities go far beyond simple image analysis. Users can upload photos or watch YouTube videos and simultaneously discuss them with Gemini. With videos, Gemini can summarize the content and answer related questions, such as those about a product review on YouTube. With PDFs, the AI can not only summarize and answer questions but also create quizzes to test users' knowledge.
Suitable for:
Market potential and societal impact
The market potential for AI-powered smart glasses is enormous. While Google Glass failed primarily due to privacy concerns and practical usability, the integration of Gemini could partially overcome these challenges. Practical applications are diverse, ranging from everyday aids and specialized professional applications to assistive systems for people with disabilities.
Nevertheless, important questions remain, particularly regarding data privacy. The constant sharing of one's field of vision with an AI raises new ethical and legal questions that Google must address to achieve broader acceptance than with Google Glass. Collaboration with established eyewear manufacturers could help make the technology more subtle and socially acceptable.
Google is in intense competition with other technology companies in the field of augmented reality. While Apple is pursuing a more comprehensive XR solution with its Vision Pro, Google is focusing on a lighter, more everyday form of augmented reality with its smart glasses. Google has also announced the development of Android XR, a platform intended to support both smart glasses and more comprehensive VR headsets.
Gemini Live as a harbinger of a new era of human-AI interaction
The integration of visual capabilities into Gemini Live marks a crucial step in Google's long-term vision for ubiquitous AI assistance. What begins on smartphones is expected to culminate in upcoming smart glasses. The technological foundations are already in place, and Google is leveraging the widespread use of smartphones as a testing ground for features that will later be implemented in smart glasses.
The development of Gemini Live illustrates Google's strategic approach: New AI features are first introduced, tested, and optimized on smartphones before being integrated into specialized hardware such as smart glasses. This phased approach could help Google avoid past mistakes and develop a product that is both technologically mature and socially acceptable.
The coming months will show how quickly Google transitions from the enhanced Gemini Live features on smartphones to a fully-fledged smart glasses solution. The organizational restructuring with the integration of the Project Astra team into the Gemini team suggests an acceleration of this development. With the launch of Gemini Live's visual capabilities at the end of March 2025, crucial foundations will be laid, paving the way for Google's next major step in the development of wearable AI technologies.
Suitable for:
Your global marketing and business development partner
☑️ Our business language is English or German
☑️ NEW: Correspondence in your national language!
Konrad Wolfenstein
I would be happy to serve you and my team as a personal advisor.
You can contact me by filling out the contact form or simply call me on +49 7348 4088 965 (Munich) . My email address is: wolfenstein ∂ xpert.digital
I'm looking forward to our joint project.
