BaoCut: an AI video agent where every caption, dub and cut stays editable
Most AI video tools render once and hand you a file. BaoCut makes the timeline the source of truth: transcripts, translations, subtitle layers, voice-overs and code-made motion graphics all live in one editable video that you and your agent edit through the same undo stack.
BaoCut is a desktop app (macOS 14+ on Apple Silicon, Windows x64 in CPU, CUDA and Vulkan builds) from Jim Liu, known on X as 宝玉 (@dotey). The repo started in July, but it's moving fast: three releases in four days, ending with 3.9.0 on Oct 19, which adds versioned project videos that don't depend on Git. @GitHub_Daily featured it this morning. It had 1,122 stars when we checked. Its core idea is the one we keep saying matters most for agent editing. Fix one subtitle line, swap one shot or redo one dubbed sentence, and the agent changes only that, tells you exactly what it changed, and re-renders nothing else.
What it does with footage: transcription with local models (Whisper large-v3/v3-turbo, Qwen3-ASR, MOSS with speaker labels) or online APIs, with word-level timing. Subtitles in the original language, translated, or both. Dubbing that separates the voice from the background with HTDemucs, then synthesizes each sentence with a preset or cloned voice. Talking-head cleanup that removes filler words, long pauses and retakes without touching the original file. Chapters, summaries and shorts written from the timed transcript. From a brief, it has 24 scene templates (explainers, launches, trailers, data stories, kinetic type). Motion graphics are code: the agent writes a self-contained HTML piece, BaoCut bakes the frames and drops it on the timeline. It accepts its own baocut/1 format and also hyperframes/1, so HyperFrames work carries over.
The agent side is open. The app drives Claude Code or Codex CLI (both validated end to end), and Copilot CLI, OpenCode and any Agent Client Protocol agent can plug in. If you'd rather use your own agent, baocut skill install and baocut mcp install expose the same tool catalog, and there's a JSON-emitting CLI for scripts. baocut web open gives a remote agent a one-time link to show you the editor in a browser. The README's 'bounded autonomy' rules are worth copying anywhere: the agent works within a scope and budget, asks before destructive actions, treats downloaded pages and transcripts as data rather than instructions, and reports a failed check as a failure.
Read the fine print before using it for client work. BaoCut uses its own source-available Community License, not an open-source one. You can use it for free to make and sell videos, including paid editing services, but selling, hosting or embedding BaoCut itself needs a separate licence. Some local model weights it offers (OmniVoice, Fish Audio S2 Pro, Qwen-Image) are non-commercial, and the app warns you before you pick them. FFmpeg and ffprobe aren't bundled, Windows builds are unsigned, and GPU inference on Windows hasn't been tested on real hardware yet. Only clone voices you have permission to use. Spotted, not tested. Credit Jim Liu.
Skills & repos in our directory
- BaoCut · MCP, Code-to-video engine
- claude-motion-explainer · Skill, Motion graphics
- heditor · Skill, Motion graphics
- whiteboard-teacher-video · Skill, Motion graphics
- free247editor · Skill, Code-to-video engine
- papercut-explainer · Skill, Motion graphics
More from the Lab
- huashu-motion: an open skill that writes the launch film, scores it, and lets you point at the frame to fix itSpotted, not yet tested
- Tandem: an MIT video editor with a CLI and MCP, where agent edits stay purple until you've watched themBased on the creator’s video · not yet tested by us
- VoiceStudio: local voice cloning, dubbing and an MCP server for your video agentSpotted, not yet tested
- Four editors your coding agent drives: editonny, BashCut, Yap and free247editorSpotted, not yet tested
Topics: HyperFrames · Audio, voice & music · Video MCP servers · Motion graphics skills