technology•Wed, August 5, 2026•4 min read

Why Collov Labs’ NewEyes AI Is a Fundamental Shift for Computer Vision

Collov Labs has launched NewEyes AI, an app that transforms your camera into an autonomous visual agent capable of performing complex tasks. Unlike traditional recognition tools, it bypasses manual steps to execute actions directly from visual input.

From Recognition to Execution

For years, visual AI has been trapped in a 'recognition loop.' Tools like Google Lens excel at identifying objects, but they typically stop there—providing information that requires a human user to then take the next step. Collov Labs, a team founded by researchers from Stanford, Berkeley, and Yale, is looking to break that cycle with the launch of NewEyes AI.

Announced in early August 2026, NewEyes AI isn't just another image classifier. It is designed to bridge the gap between perception and action, turning a smartphone camera into a multi-modal agent that can plan, execute, and iterate on tasks based on what it sees in the real world.

NewEyes AI aims to redefine how users interact with visual data.

How NewEyes AI Works

The core differentiator for NewEyes AI is how it handles the 'reasoning pass.' Traditional visual AI systems often rely on a hand-off between a vision processing step and an agentic execution step. Collov Labs has streamlined this into a single, cohesive process.

Autonomous Triggering: Recognition serves as the direct trigger for an action, eliminating the need for user hand-offs.
Multi-Step Planning: The agent is capable of breaking down complex requests into actionable, sequential steps.
Iterative Intelligence: The system tracks state changes across actions, observing and correcting itself to complete tasks effectively.
Context Awareness: Beyond identifying items, the app understands the scene and context to offer more relevant responses.

NewEyes doesn't just recognize what you see — it understands context, creates new visuals, compares prices, and takes action. All from a single tap.
— Collov Labs

The Evolution of the Collov Ecosystem

NewEyes AI is the latest addition to a growing suite of tools from Collov Labs. The company has already gained traction in the real estate sector with Collov AI, an agent that automates virtual staging and image enhancement, and CozyAI for prosumer-level visual design. By applying the same underlying visual agent technology to different domains, Collov is attempting to create a standardized way for users to interact with the world through AI.

As these agents continue to evolve, the distinction between 'viewing' something through a screen and 'interacting' with it is likely to blur further. Whether it's retail, interior design, or utility, the shift toward autonomous, vision-based agents represents a significant leap forward in how we leverage mobile hardware.

Key Takeaways

NewEyes AI allows your smartphone camera to perform autonomous actions rather than just identifying objects.
The technology features a single-pass reasoning engine that removes the lag between visual recognition and task execution.
Developed by researchers from Stanford, Berkeley, and Yale, the system is designed to handle complex, multi-step requests.
Collov Labs is expanding its 'Visual Agent' platform across multiple sectors, including real estate and design.
The system tracks states across actions, allowing the AI to observe and correct itself in real-time.

FAQ

What is NewEyes AI?

NewEyes AI is a visual agent app that uses your smartphone camera to recognize scenes and autonomously execute tasks based on user intent.

How is it different from Google Lens?

While Google Lens is primarily a recognition tool that returns matches, NewEyes AI integrates recognition and execution into a single reasoning process, allowing it to perform actions automatically.

Who created NewEyes AI?

It was created by Collov Labs, a company founded by researchers from Stanford, Berkeley, and Yale.

Can it perform multiple steps?

Yes, the system is designed to handle multi-step requests and can iterate based on its observations of the environment.