Adobe's AI-Powered Camera App Gets a Major Upgrade

Adobe is adding new AI-powered features to its experimental iOS camera app, Project Indigo, launched last year. The app previously offered pro controls, multi-frame super-resolution, and different capture modes, and is now adding features that will use LLMs (large language models) to critique photos and provide editing suggestions.

AI-Powered Photo Critique and Editing Features

With the new update, Project Indigo will use AI to critique your photos, providing a "professional" opinion about framing, lighting, colors, and emotional impact. The app will also offer capture and edit suggestions, giving you tips about reshooting the photo or making changes using Adobe Lightroom controls.

The AI features are buttons that can generate more deterministic outputs, unlike most generative AI tools that provide prompt-based editing. This makes it easier to find the perfect result without having to tweak the prompt.

• The app will also offer advanced object removal, depth of field generation, and the ability to add different styles to photos.
• The object removal feature is particularly impressive, allowing you to remove people, objects, and clutter from the background without creating any strange artifacts.
• The app also allows you to use AI to create depth of field for a photo to simulate a blurred background.
• Style transfer is also available, letting you turn your picture into tones like watercolor, pen and ink, ink line with color wash, monochromatic, and backlit subject.

Marc Levoy's Vision for Project Indigo

Marc Levoy, the person heading Adobe's project, had previously developed Pixel's camera chops. He said that most generative AI tools provide prompt-based editing, which can be a tricky endeavour. That's why most of the new experimental AI features are buttons that can generate more deterministic outputs.

Experimental Features and Potential Roadblocks

The company is using Google's Gemini-based Nano Banana for these features, but it's open to swapping in other models, including its own Adobe Firefly model. These features, bundled under the AI playground tab, are still in a testing phase, and only select users will get access to them. These features might not ever make it to a wider audience, but it is good to see some features that can make people aware of nuances in photography, rather than just creating more slop.