- Integration of semantic search into the Photos app to locate images using everyday phrases.
- Copilot Vision's capabilities to analyze screen content and the physical environment through the camera.
- New AI-assisted editing tools like Relight to optimize the lighting of captures.
If you're one of those people with thousands of images stored on your computer and you're going crazy trying to find that specific photo from three years ago, I have good news. Microsoft has decided to completely overhaul image file management, integrating generative artificial intelligence into the core of Windows 11 so you no longer have to rely on cryptic file names or endless folders.
The real gem is the ability to interact with our operating system as if we were chatting with a friend. Thanks to Copilot, we can now search for photos using natural language , meaning the machine understands the context and meaning of our requests, not just exact keywords. It's a significant leap forward, transforming the Photos app into a smarter and much more intuitive tool.
The semantic search revolution in the Photos app
You no longer need to remember if you named the image "IMG_2023_vacations.jpg". Now, the Windows 11 Photos app includes a smart search that lets you type simple, everyday phrases. For example, you can ask it to search for "photos of dogs playing on the beach," and the AI will analyze the visual content in your local library to show you the exact results.
This semantic search system is capable of interpreting complex concepts, greatly simplifying the organization of local files . Although for now this feature focuses on images stored on the hard drive, it already paves the way for digital asset management where the user doesn't have to do the tedious work of manual tagging.
Advanced Edition: The Arrival of Relight
But it's not all about searching; it's also about improving what we have. For those seeking a professional finish without being Photoshop experts, Relight has arrived . This tool allows you to manipulate the lighting of a photograph by adding up to three different light sources, adjusting the intensity, color, and focus point.
The best part is that it includes automatic adjustments that correct poorly lit photos with a single click. It's worth noting that, initially, this feature requires the power of Snapdragon processors in Copilot+ devices, although the plan is to bring it to AMD and Intel users very soon so that no one misses out.
Copilot Vision: The assistant that sees what you see
If we want to take it a step further, we need to talk about Copilot Vision . This feature allows AI to analyze your screen content in real time. Simply tap the glasses icon and grant it permission to view a specific application or window. It's ideal when you're lost in a complex program, as Copilot can highlight specific buttons and forms to show you where to click.
This capability isn't limited to PCs. If you use the app on your mobile device, Copilot can use the camera to recognize real-world objects . From identifying an unfamiliar plant to translating a restaurant menu in a foreign language in real time, the AI acts as digital eyes that make our lives easier.
Automation and total control with Copilot Actions
For those seeking maximum productivity, there are Copilot Actions. It's not just a chat that answers questions, but an active agent capable of performing tasks . Imagine being able to ask it to organize your photos, extract data from a PDF, or even make a restaurant reservation without leaving the assistant's interface.
To avoid any surprises, Microsoft has implemented a strict permissions system . These actions are disabled by default and operate in isolated environments to protect user privacy, ensuring that AI only accesses what we have explicitly authorized.
Edge and taskbar integration
The experience is further enhanced by its integration with the Edge browser. Here, Copilot can summarize lengthy articles , translate technical texts into simpler language, or help you find deals by comparing products across multiple tabs. In addition, the "Ask Copilot" feature in the taskbar provides one-click access to this entire ecosystem, eliminating the hassle of opening multiple applications.
For those with hardware concerns, it's important to know that features like the "Hey Copilot" voice command or Copilot Vision work on most Windows 11 PCs. However, Copilot+ devices with an NPU (Neural Processing Unit) offer superior energy efficiency and allow many of these AI models to be processed locally, without always relying on the cloud.
The Microsoft ecosystem has evolved to make interacting with our files and the digital environment seamless and natural. From finding an old photo with a simple caption to letting AI visually guide us through complex software or recognize objects with our mobile phone's camera, Windows 11 has transformed into an environment where AI isn't an add-on, but the engine that simplifies our daily routine.
