We use Stable Diffusion as our pre-trained text-to-image model; we use the StableDiffusion-v-2-1 checkpoint provided via official HuggingFace webpage.

We presented a new framework for text-driven video editing using an image diffusion model.

In this experiment, we replace TokenFlow with extended attention and compute it between each frames of the edited video and the keyframes (w joint attention).

Our method outputs videos that better adhere to the edit prompt while maintaining temporal consistency of the resulting edited video

Here's how to edit propagation via our framework, TokenFlow.