"Project Frame Forward is one of the more visually impressive sneaks, allowing video editors to add or remove anything from footage without using masks - a time-consuming process for selecting objects or people. Instead, Adobe's demonstration shows Frame Forward identifying, selecting, and removing a woman in the first frame of a video, and then replacing her with a natural-looking background-similar to Photoshop tools like Context-aware Fill or Remove Background. This removal is automatically applied across the entire video in a few clicks."
"Users can also insert objects into the video frame by drawing where they want to place it and describing what to add with AI prompts. These changes will similarly be applied across the whole video. The demonstration shows that these inserted objects can also be contextually aware, showing a generated puddle that reflects the movement of a cat"
"Adobe demonstrated some of the experimental AI tools it's working on at its Max conference that provide new ways to intuitively edit photos, videos, and audio. These experiments, called "sneaks," include tools that instantly apply any changes you make to one frame across an entire video, easily manipulate light in images, and correct mispronunciations in audio recordings."
Adobe showcased experimental AI tools that allow intuitive editing of photos, videos, and audio. Project Frame Forward can identify, select, remove, or replace people or objects in a single frame and propagate those edits automatically across an entire video. Users can insert AI-generated objects by drawing placement and describing content, with contextual behaviors like reflections matching scene motion. Additional experiments target easy manipulation of lighting in images and automated correction of mispronunciations in audio recordings. The tools emphasize speed and context awareness to reduce manual masking, keyframing, and detailed frame-by-frame adjustments.
Read at The Verge
Unable to calculate read time
Collection
[
|
...
]