“Hey Copilot Vision & Actions” – Windows 11 is now getting really smart: These new AI features are changing everything

Your PC can now see and act: What the new Copilot Vision & Actions can really do

What new features has Microsoft announced for Windows 11? On October 16, 2025, Microsoft unveiled a comprehensive series of artificial intelligence upgrades for Windows 11 that are designed to fundamentally change the operating system. At the heart of these innovations is the AI ​​assistant Copilot, which is significantly more powerful and user-friendly thanks to new features. The most important improvements concern voice control, visual screen analysis, and the automation of everyday tasks.

The announcement comes at a strategically important time for Microsoft. Just two days earlier, on October 14, 2025, official support for Windows 10 ended, leaving hundreds of millions of users with the choice of either migrating to Windows 11 or continuing to use their devices without security updates. With the new AI features, Microsoft is trying to make the transition to Windows 11 more attractive while also competing with other technology giants like Google and Meta, which are integrating their own AI assistants into devices and applications.

What does the “Hey Copilot” voice activation mean for use?

How does the new voice control work in Windows 11? Microsoft has introduced a wake word called "Hey Copilot," which allows users to launch the AI ​​assistant with a voice command, without having to use a mouse or keyboard. This feature is available on all Windows 11 PCs and is designed as an optional feature that users must manually enable in the Copilot app settings.

The technical implementation is carried out via a so-called wake word spotter, which continuously listens for the wake word. This system uses a local audio buffer of ten seconds, which is stored in RAM and is never recorded or permanently stored. Wake word recognition occurs entirely on the device, so voice control also works offline. However, after activation, Copilot requires an internet connection to process the actual requests, as response generation is cloud-based.

Once activated, a microphone icon appears on the screen, accompanied by a beep indicating that Copilot is listening. Users can then express their questions or commands without any further action. There are three ways to end a conversation: Say "Goodbye," click an X icon, or simply wait a few seconds until Copilot automatically ends the conversation. Another beep then confirms the end of the interaction.

What advantages does voice control offer in everyday work? Microsoft particularly emphasizes its benefits in situations where multitasking is required or where the hands are otherwise occupied. Hands-free operation allows users to quickly access information while working on a document or performing another activity without interrupting their workflow. For people with physical limitations, voice activation represents a significant advance in accessibility.

Microsoft cites internal research showing that people who use Copilot via voice command interact with the assistant twice as often as with text-based input. This higher frequency of use suggests that voice command actually lowers the barrier to using the AI ​​assistant and leads to more intensive use. The company sees this as an important step toward more natural and intuitive human-computer interaction.

However, there are limitations. The feature is currently only available in English, so users must set their Windows display language to English to use "Hey Copilot." Expansion to other languages ​​is planned, but no specific date has been set yet. Furthermore, activation only works when the PC is turned on and unlocked. For security reasons, access to the locked screen or when the computer is turned off is not possible.

How does Copilot Vision expand the capabilities of screen analysis?

What can Copilot Vision do, and how does it differ from previous features? Copilot Vision is a new feature that enables the AI ​​assistant to analyze on-screen content and provide context-based assistance. Microsoft is now extending this functionality, previously available only in the Edge browser, to the entire Windows 11 system and making it available in all markets where Copilot is offered.

It works based on screen sharing, where users can grant Copilot access to specific windows or applications. By clicking on a glasses icon in the Copilot app, users can select which program window they want to share with the AI. Copilot can then analyze the visible content, extract text, interpret images, and offer support based on this. Sharing only occurs upon explicit request and can be canceled at any time, similar to screen sharing in video conferencing tools.

What practical applications does Copilot Vision offer? The possible applications are diverse and range from troubleshooting to guidance and data analysis. For example, Copilot Vision can help troubleshoot Windows settings by analyzing the current screen view and providing step-by-step instructions for resolving the problem. In Office applications such as Word, Excel, or PowerPoint, the function can analyze entire documents, even if their contents are not fully visible on the screen, and provide comprehensive support for document editing.

A particularly useful feature is the Highlights function, which shows users directly within applications where to click to perform certain tasks. For example, if a user asks how to improve the lighting of a photo in an image editing program, Copilot Vision can visually highlight the relevant menu items and buttons and provide interactive instructions. This visual guidance makes it easier, especially for beginners, to learn new software and use complex functions.

Microsoft also plans to expand interaction with Copilot Vision. While the feature is currently primarily controlled via voice commands, text-based communication will soon be available to Windows Insiders. This offers additional flexibility, especially in environments where voice interaction isn't practical, such as open-plan offices or public spaces.

What role do Copilot Actions play in task automation?

What are Copilot Actions and how do they work? Copilot Actions are an experimental feature that enables the AI ​​assistant to perform specific actions on behalf of the user. This feature expands Copilot from a pure information and analysis tool to an active agent capable of performing practical tasks. Examples of such actions include making restaurant reservations, ordering food, sorting photos, or extracting data from PDF documents.

The functionality was first announced for web browsers in May 2025 and is now being extended to Windows 11, where it can interact with local files and applications. Microsoft plans to make this experimental feature available to Windows Insiders in the coming weeks through Copilot Labs, a testing ground for new AI features.

How does Microsoft ensure security for automated actions? Because Copilot Actions grants the AI ​​assistant extended permissions, Microsoft has implemented comprehensive security measures. The feature is disabled by default and requires explicit user consent. Once enabled, the agents operate under dedicated user accounts separate from the actual user account to ensure a clear separation of permissions.

Agents start with minimal privileges and are only granted access to resources explicitly authorized by the user. Access to sensitive folders is strictly restricted unless permission is explicitly granted. All actions are performed in isolated workspaces that limit access and visibility. This sandbox environment ensures that agents cannot gain uncontrolled access to the entire system.

Microsoft emphasizes that users retain full control at all times. They can track every step a Copilot Action performs in the Copilot app and intervene or cancel the action if necessary. AI agent permissions can be managed in the Windows 11 user settings, where users can specify which areas of the system Copilot can access.

What practical use cases are there for Copilot Actions? One concrete example is the new AI agent called Manus, which can work directly from File Explorer. Manus can create websites by right-clicking on local documents or be used as a native app to generate websites from local images or files via chat. This feature leverages Windows' Agentic platform to retrieve content and operate securely in the background.

Further integration is provided by third-party tools. A new integration with Filmora enables direct video editing from File Explorer. For Copilot+ PC users, a Zoom integration with the Click to Do feature offers the ability to instantly schedule meetings by simply hovering over an email address. These examples demonstrate how Copilot Actions can simplify and accelerate everyday workflows.

How does Taskbar integration change access to Copilot?

What does the new Ask Copilot taskbar feature mean? Microsoft is integrating a new Ask Copilot search function directly into the Windows 11 taskbar, designed to provide quick access to speech and vision assistance with just one click. This feature transforms the taskbar into a dynamic hub for tackling tasks and reduces the number of steps users need to take to access AI assistance.

Integration into the taskbar allows users to search for apps, files, and settings directly from there, while Copilot simultaneously provides AI-powered suggestions and assistance. The search function becomes faster and more intuitive as it processes the user's input in real time and presents relevant results. Microsoft emphasizes that this feature uses existing Windows APIs and that Copilot does not have access to personal content to ensure privacy.

How does Copilot help navigate Windows settings? A particularly useful new feature is Copilot's integration with Windows Settings. Users can now ask for settings in natural language, such as "Help me focus" or "Make my screen easier to read," and receive direct links to the relevant settings pages.

This feature solves a long-standing problem with Windows: The multitude of settings options and their often convoluted organization make it difficult, even for experienced users, to quickly find specific options. With Copilot integration, navigation is significantly simplified, as the assistant understands the user's intent and leads directly to the right place, rather than presenting a long list of suggestions.

Windows Insiders who can already test this feature have seen a significant time saving. Instead of navigating through multiple menu levels or searching in the Settings app, a simple question to Copilot takes you directly to the answer. The assistant automatically detects the device in use and provides device-specific solutions, which is especially helpful for problems with display brightness, power management, or network configuration.

What are Copilot Connectors and which services can be connected?

How is Microsoft expanding Copilot's connectivity? With Copilot Connectors, Microsoft is introducing a way to connect various cloud services and applications directly to the Copilot app. These connectors allow users to directly connect to services like OneDrive, Outlook, Gmail, Google Drive, and Google Calendar, allowing Copilot to access and search the information stored there.

Implementation is an opt-in feature that must be configured in the Copilot Windows app's settings. Once connected, users can use natural language commands to request specific information, such as "Where is my resume?" or "Show me last week's email about the project," and Copilot will search the connected services to find the desired information.

A particularly useful feature is the ability to export Copilot responses directly to Word, Excel, or PowerPoint. For example, if Copilot has created a summary of information from various sources, it can be transferred to a Word document with one click, where it can be further edited and formatted. This seamless integration between search, analysis, and document creation saves considerable time and simplifies complex workflows.

What data protection considerations apply when connecting external services? Connecting external services with Copilot naturally raises data protection issues. Microsoft emphasizes that all connections must be explicitly authorized by the user and can be terminated at any time. Data processing is carried out in accordance with the existing Microsoft 365 privacy policies, including compliance with the General Data Protection Regulation (GDPR).

However, there are also concerns. As with all AI systems, there is the so-called black box effect, which makes it difficult to understand exactly how the AI ​​makes decisions and which data it processes and how. When connecting to services like Gmail or Google Drive, which are outside the Microsoft ecosystem, the complexity of data protection considerations increases even further.

Companies planning to use Copilot with connectors are advised to conduct a careful data protection risk assessment. It should be clarified which data will be made accessible via the connectors, how this data will be processed, and whether potentially sensitive or personal data is involved. A data processing agreement with Microsoft and clear internal guidelines for the use of Copilot are recommended from a data protection perspective.

What hardware requirements are there for the new AI functions?

What distinguishes regular Windows 11 PCs from Copilot+ PCs? With Copilot+ PCs, Microsoft has introduced a new category of devices specifically optimized for AI tasks. The key difference lies in the Neural Processing Unit (NPU), a specialized chip designed for processing AI models that operates significantly more efficiently than conventional CPUs or GPUs.

A Copilot+ PC must contain an NPU capable of processing at least 40 TOPS (trillion operations per second). This processing power is necessary to smoothly execute advanced AI functions such as real-time translation, image generation, or on-device AI models. Additionally, at least 16 GB of DDR5 or LPDDR5 memory and an SSD with at least 256 GB capacity are required.

Which processors meet these requirements? There are currently three processor families that meet the requirements for Copilot+ PCs. The AMD Ryzen AI 300 series offers NPUs with 50 TOPS and is available in various laptop models. The Intel Core Ultra 200V series also has powerful NPUs that exceed the 40 TOPS threshold. The Qualcomm Snapdragon X-series, both Elite and Plus, was the first processor family with equivalent NPU performance and launched in mid-2025.

Importantly, many of the Copilot features announced in October 2025 don't require a Copilot+ PC. The "Hey Copilot" voice activation, Copilot Vision, and basic Copilot Actions work on any Windows 11 PC. However, there are some advanced features that benefit from or even require the additional processing power of the NPU, such as local processing of AI models without cloud connectivity or certain real-time image processing functions.

Is it worth investing in a Copilot+ PC? The decision depends on your individual usage profile. For users who work intensively with AI tools, frequently create multimedia content, or value maximum data protection through local AI processing, a Copilot+ PC offers significant advantages. The NPU not only enables faster processing but also lower power consumption for AI tasks, resulting in longer battery life for laptops.

For users who primarily use basic productivity applications and occasionally access AI features, a standard Windows 11 PC with current hardware is usually sufficient. Microsoft has deliberately designed many of the new Copilot features to work across the entire Windows 11 install base, rather than being limited exclusively to Copilot+ PCs. This ensures broad accessibility of AI features and avoids excessive fragmentation of the user base.

Managed AI Platform - Image: Xpert.Digital

Here you will learn how your company can implement customized AI solutions quickly, securely, and without high entry barriers.

A Managed AI Platform is your all-round, worry-free package for artificial intelligence. Instead of dealing with complex technology, expensive infrastructure, and lengthy development processes, you receive a turnkey solution tailored to your needs from a specialized partner – often within a few days.

The key benefits at a glance:

⚡ Fast implementation: From idea to operational application in days, not months. We deliver practical solutions that create immediate value.

🔒 Maximum data security: Your sensitive data remains with you. We guarantee secure and compliant processing without sharing data with third parties.

💸 No financial risk: You only pay for results. High upfront investments in hardware, software, or personnel are completely eliminated.

🎯 Focus on your core business: Concentrate on what you do best. We handle the entire technical implementation, operation, and maintenance of your AI solution.

📈 Future-proof & Scalable: Your AI grows with you. We ensure ongoing optimization and scalability, and flexibly adapt the models to new requirements.

More about it here:

• Managed AI Platform

How does Microsoft position itself in competition with other AI assistants?

Who are Microsoft's competitors in the AI ​​assistant space? The AI ​​assistant market is highly competitive, and Microsoft is in direct competition with several established providers. Amazon's Alexa is particularly strong in the smart home sector and boasts the largest number of compatible devices. Google Assistant excels at superior speech recognition, more natural conversations, and excellent integration with Google services. Apple's Siri, while offering less flexibility, scores points with its strong focus on privacy and seamless integration into the Apple ecosystem.

What sets Microsoft's approach apart from the competition? The key difference lies in Copilot's deep integration with the operating system and productivity applications. While Alexa, Google Assistant, and Siri are primarily designed for voice commands, smart home control, and simple information queries, Microsoft aims to make Copilot an integral part of everyday work life.

Using OpenAI's GPT-4 and, in newer versions, GPT-5 as a foundation gives Microsoft a technological edge in natural language processing and text generation. Integration with Microsoft 365 enables Copilot to access corporate data and provide contextual support that goes far beyond simple question-and-answer interactions.

Microsoft is investing heavily in AI development. By 2023, the company had invested nearly $13 billion in OpenAI and is leveraging this partnership to continuously develop new features. These investments are paying off: As early as the second quarter of 2025, Microsoft reported robust advertising revenue and profit growth, partly due to the successful integration of AI features.

How are other tech giants reacting to Microsoft's AI strategy? Google and Meta are also intensifying their AI investments. Google is increasingly integrating its Gemini AI technology into the Assistant to enable more natural conversations and more complex context recognition. Meta announced in October 2025 that it would invest $66 billion to $72 billion in AI development and is working on a personal superintelligence for everyone.

The competition is leading to a race for innovation, with each company attempting to leverage its specific strengths. Microsoft is focusing on integration into work environments and productivity tools, Google on search expertise and natural language processing, and Meta on social networks and personalized content. For users, this competition means rapid technological advancements and a growing selection of powerful AI assistants.

What data protection and security aspects need to be considered?

How does Microsoft address data privacy concerns? The use of AI assistants like Copilot raises fundamental questions about data privacy, especially when the assistant has access to corporate data, personal documents, and emails. Microsoft emphasizes that Copilot complies with existing data protection, security, and compliance obligations, including the General Data Protection Regulation (GDPR).

A key promise is that prompts, responses, and data accessed through Microsoft Graph will not be used to train language models. Enterprise-related data within the Microsoft 365 tenant is isolated and protected, allowing companies to retain full control over their own data. Microsoft also promises compliance with the Microsoft AI Principles and the Microsoft Responsible AI Standards.

What risks exist despite these assurances? A fundamental problem is the so-called black box effect, which describes the fact that even developers don't fully understand how the AI ​​models reach their decisions. This lack of transparency makes it difficult to fully control and track data processing. Since Copilot can access corporate data such as chats in Teams, emails, and documents, there is a risk that this data will be processed without sufficient consent or in an impermissible manner.

Another risk lies in data transparency. Since Copilot can access all data for which a user has authorization, this can quickly lead to excessive access. On average, 10 percent of a company's Microsoft 365 data is accessible to all employees, which poses a significant risk of inadvertent data exposure when using Copilot.

The connection of Copilot to Bing is particularly problematic from a data protection perspective. Here, Microsoft no longer acts as a data processor but rather as the controller itself, which triggers various additional data protection obligations. However, due to the black box effect, ensuring transparent data processing is only possible to a limited extent.

What measures should companies take? Companies planning to use Copilot need to take several steps to mitigate risk. First, careful data classification should be carried out, identifying sensitive information and protecting it accordingly. Microsoft offers the Purview tool for this purpose, which can be used to categorize data and tag it with tags such as personal data, sensitive content, or public post.

A strict authorization concept is essential. Since Copilot only displays data to which the respective users have at least viewing permissions, the authorization concept must strictly adhere to the need-to-know principle. Access rights should be regularly reviewed and adjusted to prevent employees from accessing data they do not need for their work.

From a data protection perspective, concluding a data processing agreement with Microsoft is mandatory, as Microsoft processes the data on behalf of the company. The company remains responsible for data protection and must ensure that Microsoft has implemented sufficient technical and organizational measures.

In addition, clear internal guidelines for the use of Copilot should be established. These should specify which types of data may be processed via Copilot, which prompts are permitted, and how sensitive information should be handled. Regular employee training is important to raise awareness of data protection risks and promote responsible use of AI tools.

What do these innovations mean for the future of working with AI?

How will the use of AI assistants evolve? Industry analysts at Gartner predict that 2025 will be the year of AI assistants, with so-called agentic AI, or assistance-based intelligence, becoming the most important technological trend. By 2028, at least 15 percent of everyday work decisions are expected to be made by AI machines. This development points to a fundamental shift in the world of work, in which AI assistants are increasingly transforming from passive information providers to active agents.

Microsoft's vision, as described by CEO Satya Nadella, goes beyond Copilot's current functionality. Nadella distinguishes between copilot software, which performs a task in interaction with the user, and autopilot systems, which would perform a task without user interaction. The name Copilot is deliberately chosen, signaling that humans should always retain control, while AI provides support.

What impact do AI assistants have on traditional apps? The increasing prevalence of personal AI assistants could fundamentally change the way we use software. If users no longer open a specific app but instead ask their AI assistant to perform a task, apps will become increasingly invisible. Instead of using an Uber app, you could simply ask your AI assistant to book a ride. Instead of opening Spotify, you could ask your assistant to play your favorite music.

This development has far-reaching consequences for software developers. Apps will no longer primarily need to appeal to human users, but will need to provide relevant and analyzable information for AI assistants via interfaces. User interfaces are becoming less important, while APIs and data formats are becoming more important. Developers must ensure that their services can be discovered and used effectively by AI assistants to avoid being pushed out of the market.

However, apps won't become irrelevant. Many services have years of accumulated data and market positions that represent an unassailable advantage. Spotify's detailed understanding of music tastes or Booking.com's near-complete hotel availability are examples of such advantages. AI assistants will continue to rely on these specialized services, even if user interaction changes.

How are companies preparing for the AI ​​revolution? Integrating Microsoft 365 Copilot is increasingly becoming a strategic imperative for companies. A Forrester study quoted a senior vice president of technology services as saying, "Running a company without Copilot in five years would be like running a company today with typewriters instead of computers." This assessment underscores the transformative impact AI assistants will have on the business world.

Nearly 70 percent of Fortune 500 companies already use Microsoft 365 Copilot. This rapid adoption demonstrates that companies recognize the productivity gains enabled by AI assistants as a decisive competitive advantage. At the same time, the introduction of Copilot requires careful preparation, including employee training, adapting business processes, and implementing appropriate data protection and security measures.

What additional AI features will be introduced in Windows 11?

What is Gaming Copilot and how does it support gamers? Alongside the productivity features, Microsoft also introduced Gaming Copilot in October 2025, a personal gaming companion for gamers on Windows PCs and soon on mobile devices. This beta feature is integrated into the Xbox Game Bar on Windows PCs and provides gamers with real-time support, tips, and recommendations while playing.

The Gaming Copilot is designed for situations where players are stuck on certain challenges, such as difficult boss battles or complex puzzles. Instead of pausing the game and searching forums for solutions, players can activate the Copilot via push-to-talk and ask for help directly. The AI ​​analyzes the current game state and provides context-appropriate advice.

The feature was initially tested by Xbox Insiders and has been improved based on their feedback. This includes more comprehensive game support for more titles, the ability to easily access Copilot Voice via push-to-talk, and smarter on-screen recognition. It's also being integrated into ROG Xbox Ally handhelds, where Gaming Copilot can be activated via a dedicated button.

What other AI features are in development? Microsoft is continuously working on expanding the AI ​​capabilities in Windows 11. Announced features include improved AI actions in File Explorer, allowing you to automatically sort photos, extract data from PDFs, or send emails. The Relight feature in the Photos app uses AI to relight images directly on the device, which is especially interesting for design, marketing, or PR teams.

The Snipping Tool is getting intelligent screenshot recognition, which identifies text and objects directly in the screenshot, ideal for content creation, quick translations, or editorial processes. A revised Blue Screen of Death recovery process will be complemented by troubleshooting features, including AI-supported root cause analysis and recovery steps.

Microsoft also plans to deepen Copilot's integration into other areas of Windows. Recommended settings in the Settings app will now display AI agent actions for recently changed settings. Support for external fingerprint sensors through Windows Hello Enhanced Sign-in Security expands biometric sign-in options and increases security.

How do free and paid versions of Copilot differ?

What does the free version of Copilot offer? A basic version of Microsoft Copilot is available free of charge and already offers a significant feature set. The free version allows you to use the chatbot in your browser or directly in Windows 11, access GPT-4 and GPT-4 Turbo during off-peak hours, use text, speech, and images in input, and generate images with Microsoft Designer with 15 boosts per day.

Users can use plug-ins and GPTs to expand functionality and receive support for grammar, spelling, and writing style. The free version is sufficient for many everyday tasks such as answering emails, writing texts, or creating simple PowerPoint presentations.

What additional features does Copilot Pro offer? The paid version of Copilot Pro costs €20 per month for private users and offers significantly expanded features. The most important benefit is priority access to world-class AI models such as GPT-4 and GPT-4 Turbo, even during peak demand, which guarantees faster responses and higher availability.

Copilot Pro provides access to AI capabilities in Microsoft 365 apps such as Word, Excel, PowerPoint, and Outlook, but use in desktop apps also requires a Microsoft 365 Personal or Family subscription. Since an expansion in March 2024, Pro subscribers can also use Copilot in the free Microsoft 365 web apps without a separate Office subscription.

Image generation with Microsoft Designer is expanded to 100 boosts per day in Copilot Pro, which is approximately six times more than in the free version. Additionally, users can resize and format AI-generated images between square and landscape without leaving the Designer tool. Access to the Microsoft Copilot GPT Builder allows Pro subscribers to create personalized Copilot GPTs tailored to specific tasks.

Is the Copilot Pro subscription worth it? The decision depends on your individual usage profile. For power users, creative professionals, and those who work intensively with Microsoft 365 applications, Copilot Pro offers clear added value through its advanced analysis capabilities in Excel, the creation of comprehensive project plans, and integration into specific business processes.

For businesses, there's a separate solution called Microsoft 365 Copilot, which costs €30 per month per user and offers additional enterprise features such as advanced data protection controls, usage analytics for administrators, and the ability to create agents. This enterprise version is increasingly being adopted by Fortune 500 companies and is considered a strategic productivity tool.

Microsoft offers a one-month free trial for Copilot Pro, which can be activated via the Copilot mobile app on iOS or Android. This trial allows interested parties to try out the advanced features and decide whether the investment is worthwhile for their specific use cases. For many users who primarily need basic features, the free version is sufficient for gaining initial experience with AI assistants and exploring their potential.

☑️ Our business language is English or German

☑️ NEW: Correspondence in your national language!

Konrad Wolfenstein

I would be happy to serve you and my team as a personal advisor.

You can contact me by filling out the contact form or simply call me on +49 89 89 674 804 (Munich) . My email address is: wolfenstein ∂ xpert.digital

I'm looking forward to our joint project.

☑️ SME support in strategy, consulting, planning and implementation

☑️ Creation or realignment of the digital strategy and digitalization

☑️ Expansion and optimization of international sales processes

☑️ Global & Digital B2B trading platforms

☑️ Pioneer Business Development / Marketing / PR / Trade Fairs

Benefit from Xpert.Digital's extensive, fivefold expertise in a comprehensive service package | R&D, XR, PR & Digital Visibility Optimization - Image: Xpert.Digital

Xpert.Digital has in-depth knowledge of various industries. This allows us to develop tailor-made strategies that are tailored precisely to the requirements and challenges of your specific market segment. By continually analyzing market trends and following industry developments, we can act with foresight and offer innovative solutions. Through the combination of experience and knowledge, we generate added value and give our customers a decisive competitive advantage.

More about it here:

• Use the 5x expertise of Xpert.Digital in one package - starting at just €500/month