Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
XiangpengYangย 
posted an update Dec 13, 2025
Post
3087
๐Ÿš€ Introducing VideoCoF: Unified Video Editing with a Temporal Reasoner (Chain-of-Frames)!

Weโ€™re excited to introduce VideoCoF, a unified framework for instruction-based video editing that enables temporal reasoning and ~4ร— video length extrapolation, trained with only 50k video pairs. ๐Ÿ”ฅ

๐Ÿ” What makes VideoCoF different?
๐Ÿง  Chain-of-Frames reasoning , mimic human thinking process like Seeing โ†’ Reasoning โ†’ Editing to apply edits accurately over time without external masks, ensuring physically plausible results.
๐Ÿ“ˆ Strong length generalization โ€” trained on 33-frame clips, yet supports multi-shot editing and long-video extrapolation (~4ร—).
๐ŸŽฏ Unified fine-grained editing โ€” Object Removal, Addition, Swap, and Local Style Transfer, with instance-level & part-level, spatial-aware control.

โšก Fast inference update
๐Ÿš€ H100: ~20s / video with 4-step inference, making high-quality video editing far more practical for real-world use.

๐Ÿ”— Links
๐Ÿ“„ Paper: https://arxiv.org/abs/2512.07469
๐Ÿ’ป Code: https://github.com/knightyxp/VideoCoF
๐Ÿค— Demo: XiangpengYang/VideoCoF
๐Ÿงฉ Models: XiangpengYang/VideoCoF
๐ŸŒ Project Page: https://videocof.github.io/

#VideoEditing #DiffusionModels #GenerativeAI #ComputerVision #AI

test

ยท

Really impressive work โ€” the Chain-of-Frames framing is especially clean. Treating temporal consistency as a first-class constraint instead of a post-hoc fix feels like the right abstraction.

One thing this made me think about is how much trust in systems depends on refusing to โ€œhallucinate successโ€ early โ€” whether thatโ€™s in video editing, verification, or evidence pipelines.

Iโ€™ve been working on a verification system where proof is intentionally withheld until the underlying storage is fully durable, specifically to avoid the kind of silent failure modes youโ€™re guarding against here.

Different domain, same philosophy: correctness > convenience.

Thanks for sharing this โ€” great read.

ยท

Thanks! I really love your phrasing of 'refusing to hallucinate success' โ€” that's exactly the mindset we aimed for. Glad the philosophy resonates!

Why are all the examples low-fidelity / low-frame rate?

ยท

Thanks for the feedback! I've just updated the input video, so the examples should now match the quality shown in the teaser. The current frame rate is set to 8 fps, which is standard for these demos.

Regarding the resolution (fidelity), VideoCoF actually supports arbitrary resolution and arbitrary length. You are welcome to upload your own high-resolution videos to test the performance!