“Hey Copilot Vision & Actions” – Windows 11 is getting really smart now: These new AI features change everything

Your PC can now see and act: What the new Copilot Vision & Actions are really capable of

What new features has Microsoft announced for Windows 11? On October 16, 2025, Microsoft unveiled a comprehensive series of artificial intelligence upgrades for Windows 11, designed to fundamentally transform the operating system. At the heart of these innovations is the AI ​​assistant Copilot, which will become significantly more powerful and user-friendly thanks to new features. The most important improvements include voice control, visual screen analysis, and the automation of everyday tasks.

The announcement comes at a strategically important time for Microsoft. Just two days earlier, on October 14, 2025, official support for Windows 10 ended, leaving hundreds of millions of users to decide whether to upgrade to Windows 11 or continue using their devices without security updates. With the new AI features, Microsoft is trying to make the switch to Windows 11 more attractive while simultaneously remaining competitive in the face of intense competition from other technology companies like Google and Meta, which are integrating their own AI assistants into devices and applications.

What does the voice activation “Hey Copilot” mean for usage?

How does the new voice control in Windows 11 work? Microsoft has introduced "Hey Copilot," an activation word that allows users to launch the AI ​​assistant via voice command, without needing a mouse or keyboard. This feature is available on all Windows 11 PCs and is designed as an optional feature that users must manually activate in the Copilot app settings.

The technical implementation uses a so-called Wake Word Spotter, which continuously listens for the activation word. This system uses a local ten-second audio buffer, which is held in RAM and is never recorded or permanently stored. The activation word recognition is performed entirely on the device, so voice control also works offline. However, Copilot requires an internet connection after activation to process the actual requests, as response generation is cloud-based.

After activation, a microphone icon appears on the screen, accompanied by an audible signal indicating that Copilot is listening. Users can then ask questions or give commands without having to take any further action. To end a conversation, there are three options: saying "Goodbye," clicking an X icon, or simply waiting a few seconds until Copilot automatically ends the conversation. Another audible signal then confirms the end of the interaction.

What advantages does voice control offer in everyday work? Microsoft particularly emphasizes its benefits in situations requiring multitasking or when hands are otherwise occupied. Hands-free operation allows users to quickly retrieve information while working on a document or performing other tasks without interrupting their workflow. For people with physical disabilities, voice activation represents a significant advancement in accessibility.

Microsoft cites internal research showing that people using Copilot via voice control interact with the assistant twice as often as when using text-based input. This higher usage frequency suggests that voice control actually lowers the barrier to using the AI ​​assistant and leads to more intensive use. The company sees this as an important step towards more natural and intuitive human-computer interaction.

However, there are also limitations. The feature is currently only available in English, so users must set their Windows display language to English to use "Hey Copilot." An expansion to other languages ​​is planned, but no specific date has been set. Furthermore, activation only works if the PC is switched on and unlocked. Access from a locked screen or when the computer is switched off is not possible for security reasons.

How does Copilot Vision expand the possibilities of screen analysis?

What can Copilot Vision do and how does it differ from previous features? Copilot Vision is a new feature that allows the AI ​​assistant to analyze on-screen content and provide context-sensitive assistance. Microsoft is now extending this functionality, previously only available in the Edge browser, to the entire Windows 11 system and making it available in all markets where Copilot is offered.

The system works by sharing your screen, allowing users to grant Copilot access to specific windows or applications. By clicking a glasses icon in the Copilot app, users can select which program window they want to share with the AI. Copilot can then analyze the visible content, extract text, interpret images, and offer support based on this information. Sharing is only ever granted upon explicit request and can be revoked at any time, similar to screen sharing in video conferencing tools.

What practical applications does Copilot Vision offer? Its uses are diverse, ranging from troubleshooting and guidance to data analysis. For example, Copilot Vision can assist with troubleshooting Windows settings by analyzing the current screen view and providing step-by-step instructions for resolving the issue. In Office applications like Word, Excel, or PowerPoint, the feature can analyze entire documents, even if their content is not fully visible on the screen, and offer comprehensive support for document editing.

One particularly useful feature is the Highlights function, which shows users directly within applications where they need to click to perform specific tasks. For example, if a user asks how to improve the lighting of a photo in an image editing program, Copilot Vision can visually highlight the relevant menu items and buttons and provide an interactive guide. This visual guidance makes it especially easy for beginners to learn new software and use complex functions.

Microsoft also plans to expand interaction with Copilot Vision. While the feature is currently controlled primarily via voice commands, text-based communication will soon be available for Windows Insiders. This offers additional flexibility, especially in environments where voice interaction is impractical, such as open-plan offices or public spaces.

What role do Copilot Actions play in task automation?

What are Copilot Actions and how do they work? Copilot Actions are an experimental feature that allows the AI ​​assistant to perform specific actions on behalf of the user. This feature expands Copilot from a purely informational and analytical tool into an active agent capable of handling practical tasks. Examples of such actions include making restaurant reservations, ordering groceries, sorting photos, or extracting data from PDF documents.

The functionality was initially announced for web browsers in May 2025 and is now being extended to Windows 11, where it can interact with local files and applications. Microsoft plans to make this experimental feature available to Windows Insiders in the coming weeks via Copilot Labs, a testing ground for new AI features.

How does Microsoft ensure security for automated actions? Because Copilot Actions grants the AI ​​assistant extended permissions, Microsoft has implemented comprehensive security measures. The feature is disabled by default and requires explicit user consent. Once activated, the agents operate under dedicated user accounts, separate from the actual user account, to ensure a clear separation of permissions.

Agents start with minimal privileges and only gain access to resources explicitly granted by the user. Access to sensitive folders is strictly restricted unless explicit permission is granted. All actions are performed in isolated environments that limit access and visibility. This sandbox environment ensures that agents cannot access the entire system without oversight.

Microsoft emphasizes that users retain full control at all times. They can track every step a Copilot Action takes in the Copilot app and intervene or cancel the action if necessary. The AI ​​agents' permissions can be managed in the Windows 11 user settings, where users can specify which areas of the system Copilot is allowed to access.

What are some practical use cases for Copilot Actions? One concrete example is the new AI agent called Manus, which can work directly from File Explorer. Manus can create websites with a right-click on local documents or be used as a native app to generate websites from local images or files via chat. This feature uses Windows' Agentic platform to retrieve content and operate securely in the background.

Further integration is achieved through third-party tools. For example, a new integration with Filmora enables direct video editing from within the file explorer. For users of Copilot+ PCs, a Zoom integration with the Click to Do function allows for instant meeting scheduling simply by hovering over an email address. These examples demonstrate how Copilot Actions can simplify and accelerate everyday workflows.

How does the taskbar integration change access to Copilot?

What does the new Ask Copilot feature in the taskbar mean? Microsoft is integrating a new Ask Copilot search function directly into the Windows 11 taskbar, designed to provide quick, one-click access to speech and vision assistance. This feature transforms the taskbar into a dynamic hub for managing tasks and reduces the steps users need to take to access AI support.

Integration into the taskbar allows users to search for apps, files, and settings directly from there, while Copilot simultaneously provides AI-powered suggestions and assistance. The search function becomes faster and more intuitive, as it processes user input in real time and presents relevant results. Microsoft emphasizes that this feature uses existing Windows APIs and that Copilot does not have access to personal content, ensuring privacy.

How does Copilot help with navigating Windows settings? One particularly useful new feature is the integration of Copilot with Windows settings. Users can now ask about settings in natural language, such as "Help me concentrate" or "Make my screen easier to read," and receive direct links to the relevant settings pages.

This feature solves a long-standing problem with Windows: the sheer number of settings and their often nested organization make it difficult, even for experienced users, to quickly find specific options. With Copilot integration, navigation is significantly simplified, as the assistant understands the user's intent and guides them directly to the right place, instead of presenting a long list of suggestions.

For Windows Insiders who can already test this feature, a significant time saving is evident. Instead of navigating through multiple menu levels or searching in the Settings app, a simple question to Copilot leads directly to the desired result. The assistant automatically detects the device being used and provides device-specific solutions, which is particularly helpful for problems with display brightness, power management, or network configuration.

What are Copilot Connectors and which services can be connected?

How does Microsoft extend Copilot's connectivity? With Copilot Connectors, Microsoft introduces a way to connect various cloud services and applications directly to the Copilot app. These connectors allow users to directly connect services like OneDrive, Outlook, Gmail, Google Drive, and Google Calendar, enabling Copilot to access and search the information stored there.

Implementation is done as an opt-in feature that must be configured in the settings of the Copilot Windows app. Once connected, users can ask for specific information using natural language commands, such as "Where is my resume?" or "Show me last week's email about the project," and Copilot will search the connected services to find the requested information.

One particularly useful feature is the ability to export Copilot's answers directly to Word, Excel, or PowerPoint. For example, if Copilot has compiled a summary of information from various sources, it can be transferred to a Word document with a single click, where it can be further edited and formatted. This seamless integration between search, analysis, and document creation saves considerable time and simplifies complex workflows.

What data protection considerations apply when connecting external services? Connecting external services to Copilot naturally raises data protection questions. Microsoft emphasizes that all connections must be explicitly authorized by the user and can be disconnected at any time. Data processing is carried out in accordance with the existing Microsoft 365 data protection guidelines, including compliance with the General Data Protection Regulation (GDPR).

However, there are also concerns. As with all AI systems, there is the so-called black box effect, which makes it difficult to understand exactly how the AI ​​makes decisions and what data it processes and how. The integration of services like Gmail or Google Drive, which are outside the Microsoft ecosystem, further increases the complexity of data privacy considerations.

For companies wishing to use Copilot with connectors, a careful assessment of data protection risks is recommended. It should be clarified which data is made accessible via the connectors, how this data is processed, and whether potentially sensitive or personal data is affected. A data processing agreement with Microsoft and clear internal guidelines for the use of Copilot are advisable from a data protection perspective.

What hardware requirements are there for the new AI features?

What distinguishes regular Windows 11 PCs from Copilot+ PCs? Microsoft has introduced a new device category with Copilot+ PCs, specifically optimized for AI tasks. The key difference lies in the Neural Processing Unit (NPU), a specialized chip designed for processing AI models and significantly more efficient than conventional CPUs or GPUs.

A Copilot+ PC must include an NPU capable of processing at least 40 TOPS (trillion operations per second). This computing power is necessary to smoothly execute advanced AI functions such as real-time translations, image generation, and on-device AI models. Additionally, at least 16 GB of DDR5 or LPDDR5 RAM and an SSD with a minimum capacity of 256 GB are required.

Which processors meet these requirements? Currently, there are three processor families that meet the requirements for Copilot+ PCs. The AMD Ryzen AI 300 series offers NPUs with 50 TOPS and is available in various laptop models. The Intel Core Ultra 200V series also features powerful NPUs that exceed the 40 TOPS threshold. The Qualcomm Snapdragon X series, both Elite and Plus, was the first processor family with comparable NPU performance and was launched in mid-2025.

It's important to note that many of the Copilot features announced in October 2025 don't necessarily require a Copilot+ PC. Voice activation (Hey Copilot), Copilot Vision, and basic Copilot Actions work on any Windows 11 PC. However, some advanced features benefit from, or even require, the additional processing power of the NPU, such as local processing of AI models without a cloud connection or certain real-time image processing functions.

Is investing in a Copilot+ PC worthwhile? The decision depends on your individual usage profile. For users who work intensively with AI tools, frequently create multimedia content, or value maximum data protection through local AI processing, a Copilot+ PC offers significant advantages. The NPU not only enables faster processing but also lower energy consumption during AI tasks, resulting in longer battery life for laptops.

For users who primarily use basic productivity applications and occasionally access AI features, a standard Windows 11 PC with current hardware is usually sufficient. Microsoft deliberately designed many of the new Copilot features to work across the entire Windows 11 installation base and not be limited exclusively to Copilot+ PCs. This ensures broad accessibility of the AI ​​features and avoids excessive fragmentation of the user base.

Here you will learn how your company can implement customized AI solutions quickly, securely and without high entry barriers.

A managed AI platform is your all-inclusive, worry-free solution for artificial intelligence. Instead of dealing with complex technology, expensive infrastructure, and lengthy development processes, you receive a ready-made solution tailored to your needs from a specialized partner – often within just a few days.

The key advantages at a glance:

⚡ Rapid implementation: From idea to ready-to-use application in days, not months. We deliver practical solutions that create immediate added value.

🔒 Maximum data security: Your sensitive data stays with you. We guarantee secure and compliant processing without sharing data with third parties.

💸 No financial risk: You only pay for results. High upfront investments in hardware, software, or personnel are completely eliminated.

🎯 Focus on your core business: Concentrate on what you do best. We take care of the entire technical implementation, operation, and maintenance of your AI solution.

📈 Future-proof & scalable: Your AI grows with you. We ensure continuous optimization and scalability, and flexibly adapt the models to new requirements.

More information here:

• Managed AI Platform

How does Microsoft position itself in competition with other AI assistants?

Who are Microsoft's competitors in the field of AI assistants? The market for AI assistants is highly competitive, and Microsoft faces direct competition from several established providers. Amazon's Alexa is particularly strong in the smart home sector and boasts the largest number of compatible devices. Google Assistant is characterized by superior speech recognition, more natural conversations, and excellent integration with Google services. While Apple Siri offers less flexibility, it scores points with its strong focus on data privacy and seamless integration into the Apple ecosystem.

What distinguishes Microsoft's approach from the competition? The crucial difference lies in the deep integration of Copilot into the operating system and productivity applications. While Alexa, Google Assistant, and Siri are primarily designed for voice commands, smart home control, and simple information queries, Microsoft aims to make Copilot an integral part of everyday work.

The use of OpenAI's GPT-4 and, in newer versions, GPT-5 as a foundation gives Microsoft a technological edge in natural language processing and text generation. Integration with Microsoft 365 allows Copilot to access enterprise data and provide context-aware support that goes far beyond simple question-and-answer interactions.

Microsoft is investing heavily in AI development. By 2023, the company had invested nearly $13 billion in OpenAI and is using this partnership to continuously develop new features. These investments are paying off: As early as the second quarter of 2025, Microsoft reported robust advertising revenues and profit growth, partly attributable to the successful integration of AI features.

How are other tech giants reacting to Microsoft's AI strategy? Google and Meta are also intensifying their AI investments. Google is increasingly integrating its Gemini AI technology into the Assistant to enable more natural conversations and more complex contextual understanding. Meta announced in October 2025 that it would invest $66 to $72 billion in AI development and is working on a personal superintelligence for everyone.

Competition is driving an innovation race, with each company trying to leverage its specific strengths. Microsoft focuses on integration into work environments and productivity tools, Google on search capabilities and natural language processing, and Meta on social networks and personalized content. For users, this competition means rapid technological advancements and a growing selection of powerful AI assistants.

What data protection and security aspects need to be considered?

How does Microsoft address data privacy concerns? The use of AI assistants like Copilot raises fundamental questions about data protection, especially when the assistant has access to company data, personal documents, and emails. Microsoft emphasizes that Copilot complies with existing data protection, security, and compliance obligations, including the General Data Protection Regulation (GDPR).

A key promise is that prompts, responses, and data accessed through Microsoft Graph will not be used to train language models. Enterprise data within the Microsoft 365 tenant will be isolated and protected, ensuring that companies retain full control over their own data. Microsoft also promises adherence to the Microsoft AI Principles and the Microsoft Responsible AI Standards.

Despite these assurances, what risks remain? A fundamental problem is the so-called black box effect, which describes the fact that even the developers do not fully understand how the AI ​​models arrive at their decisions. This lack of transparency makes it difficult to fully control and understand data processing. Since Copilot can access company data such as Teams chats, emails, and documents, there is a risk that this data will be processed without sufficient consent or in an unlawful manner.

Another risk lies in data transparency. Because Copilot can access all data for which a user has permission, this can quickly lead to overly broad access. On average, ten percent of a company's Microsoft 365 data is accessible to all employees, which poses a significant risk of unintentional data disclosure when using Copilot.

The integration of Copilot with Bing is particularly problematic from a data protection perspective. Here, Microsoft no longer acts as a data processor, but as the data controller itself, which triggers various additional data protection obligations. However, ensuring transparent data processing is only possible to a limited extent due to the black box effect.

What measures should companies take? For companies that want to use Copilot, several steps are necessary to minimize risk. First, careful data classification should be carried out to identify sensitive information and protect it accordingly. Microsoft offers the Purview tool for this purpose, which allows data to be categorized and tagged with terms such as personal data, sensitive content, or public post.

A strict authorization concept is essential. Since Copilot only displays data to which the respective users have at least viewing permissions, the authorization concept must strictly adhere to the need-to-know principle. Access rights should be regularly reviewed and adjusted to prevent employees from accessing data they do not need for their work.

From a data protection perspective, concluding a data processing agreement with Microsoft is mandatory, as Microsoft processes the data on behalf of the company. The company remains responsible for data protection and must ensure that Microsoft has implemented sufficient technical and organizational measures.

In addition, clear internal guidelines for using Copilot should be established. These should define which types of data may be processed via Copilot, which prompts are permitted, and how sensitive information should be handled. Regular employee training is essential to raise awareness of data privacy risks and promote the responsible use of AI tools.

What do these innovations mean for the future of working with AI?

How will the use of AI assistants evolve? Industry analysts at Gartner predict that 2025 will be the year of AI assistants, with so-called agentic AI, or assistance-based intelligence, becoming the most important technological trend. By 2028, at least 15 percent of everyday workplace decisions are expected to be made by AI systems. This development points to a fundamental shift in the world of work, in which AI assistants will increasingly transform from passive information providers into active agents.

Microsoft's vision, as described by CEO Satya Nadella, extends beyond the current functionality of Copilot. Nadella distinguishes between Copilot software, which performs a task in interaction with the user, and autopilot systems, which would execute a task without user interaction. The name Copilot is deliberately chosen to signal that humans should always retain control, while AI provides support.

What impact will AI assistants have on traditional apps? The increasing prevalence of personal AI assistants could fundamentally change the way we use software. If, in the future, users no longer open a specific app but instead ask their AI assistant to perform a task, apps will become increasingly invisible. Instead of using an Uber app, you would simply ask the AI ​​assistant to book a ride. Instead of opening Spotify, you would ask the assistant to play your favorite music.

This development has far-reaching consequences for software developers. In the future, apps will no longer primarily need to appeal to human users, but will instead need to provide relevant and analyzable information for AI assistants via interfaces. User interfaces will become less important, while APIs and data formats will gain in significance. Developers must ensure that their services can be discovered and effectively used by AI assistants to avoid being driven out of the market.

However, apps will not become irrelevant. Many services possess data sets and market positions built up over years, representing an insurmountable advantage. Spotify's detailed understanding of music tastes or Booking.com's near-complete hotel availability are examples of such advantages. AI assistants will continue to rely on these specialized services, even as user interaction evolves.

How are companies preparing for the AI ​​revolution? Integrating Microsoft 365 Copilot is increasingly becoming a strategic imperative for businesses. A Forrester study quotes a Head Vice President of Technology Services as saying that running a company without Copilot in five years would be like running a company with typewriters instead of computers today. This assessment underscores the transformative impact that AI assistants will have on the business world.

Nearly 70 percent of Fortune 500 companies already use Microsoft 365 Copilot. This rapid adoption demonstrates that businesses recognize the productivity gains made possible by AI assistants as a crucial competitive advantage. At the same time, implementing Copilot requires careful preparation, including employee training, business process adjustments, and the implementation of appropriate data privacy and security measures.

What additional AI features will be introduced in Windows 11?

What is Gaming Copilot and how does it support gamers? Alongside its productivity features, Microsoft also introduced Gaming Copilot in October 2025, a personal gaming companion for players on Windows PCs and soon on mobile devices. This beta feature is integrated into the Xbox Game Bar on Windows PCs and offers players real-time support, tips, and recommendations while they play.

The Gaming Copilot is designed for situations where players get stuck on certain challenges, such as difficult boss fights or complex puzzles. Instead of interrupting the game and searching for solutions in forums, players can activate the Copilot via push-to-talk and ask for help directly. The AI ​​analyzes the current game state and provides context-sensitive advice.

The feature was initially tested by Xbox Insiders and improved based on their feedback. This includes broader game support for more titles, the ability to easily access Copilot Voice via push-to-talk, and more intelligent on-screen recognition. It's also integrated into the ROG Xbox Ally handhelds, where Gaming Copilot can be activated via a dedicated button.

What other AI features are in development? Microsoft is continuously working on expanding the AI ​​capabilities in Windows 11. Announced features include improved AI actions in File Explorer, which allow users to automatically sort photos, extract data from PDFs, or send emails. The Relight feature in the Photos app uses AI to add backlighting to images directly on the device, which is particularly interesting for design, marketing, or PR teams.

The Snipping Tool receives intelligent screenshot recognition that directly recognizes text and objects within the screenshot, ideal for content creation, quick translations, or editorial processes. A revamped Blue Screen of Death recovery process will now be complemented by direct troubleshooting functions, including AI-powered root cause analysis and recovery steps.

Microsoft also plans to deepen the integration of Copilot into other areas of Windows. Recommended settings in the Settings app will soon display actions taken by the AI ​​agent for recently changed settings. Support for external fingerprint sensors through Windows Hello Enhanced Sign-in Security expands biometric login options and increases security.

How do free and paid versions of Copilot differ?

What does the free Copilot version offer? Microsoft Copilot is available in a free basic version and already offers a significant range of functions. The free version allows you to use the chatbot in the browser or directly in Windows 11, access GPT-4 and GPT-4 Turbo outside of peak load times, use text, speech, and images for input, and generate images with Microsoft Designer with 15 boosts per day.

Users can use plug-ins and GPTs to extend functionality and receive support with grammar, spelling, and writing style. The free version is sufficient for many everyday tasks such as answering emails, writing texts, or creating simple PowerPoint presentations.

What additional features does Copilot Pro offer? The paid version of Copilot Pro costs €20 per month for private individuals and offers significantly expanded functionality. The most important advantage is priority access to top-tier AI models such as GPT-4 and GPT-4 Turbo, even during peak load times, guaranteeing faster responses and higher availability.

Copilot Pro offers access to AI features in Microsoft 365 apps like Word, Excel, PowerPoint, and Outlook; however, using it in desktop apps requires an additional Microsoft 365 Personal or Family subscription. Since an expansion in March 2024, Pro subscribers can also use Copilot in the free Microsoft 365 web apps without a separate Office subscription.

Image generation with Microsoft's Designer is expanded to 100 boosts per day in Copilot Pro, which is about six times more than in the free version. Additionally, users can change the size and format of AI-generated images between square and landscape without leaving the Designer tool. Access to the Microsoft Copilot GPT Builder allows Pro subscribers to create personalized Copilot GPTs tailored to specific tasks.

Is a Copilot Pro subscription worth it? The decision depends on your individual usage profile. For power users, creative professionals, and those who work extensively with Microsoft 365 applications, Copilot Pro offers clear added value through enhanced analysis capabilities in Excel, the creation of comprehensive project plans, and integration into specific business processes.

For businesses, there is a separate solution called Microsoft 365 Copilot, which costs €30 per user per month and offers additional enterprise features such as advanced data protection controls, usage analytics for administrators, and the ability to create agents. This enterprise version is increasingly used by Fortune 500 companies and is considered a strategic productivity tool.

Microsoft offers a one-month free trial of Copilot Pro, which can be activated via the Copilot mobile app on iOS or Android. This trial allows interested users to try out the advanced features and decide whether the investment is worthwhile for their specific use cases. For many users who primarily need basic functions, the free version is sufficient to gain initial experience with AI assistants and explore their potential.

☑️ Our business language is English or German

☑️ NEW: Correspondence in your native language!

 

I and my team are happy to be available to you as your personal advisor.

You can contact me by filling out the contact form here wolfenstein@xpert.digital:or simply call me at +49 7348 4088 965. My email address is

I'm looking forward to our joint project.

 

 

☑️ SME support in strategy, consulting, planning and implementation

☑️ Creation or realignment of the digital strategy and digitization

☑️ Expansion and optimization of international sales processes

☑️ Global & Digital B2B trading platforms

☑️ Pioneer Business Development / Marketing / PR / Trade Fairs

Xpert.Digital possesses in-depth knowledge across various industries. This allows us to develop tailored strategies precisely aligned with the requirements and challenges of your specific market segment. By continuously analyzing market trends and monitoring industry developments, we can act proactively and offer innovative solutions. The combination of experience and expertise generates added value and provides our clients with a decisive competitive advantage.

More information here:

• Benefit from Xpert.Digital's 5 areas of expertise in one package – starting from just €500/month