Open-weight video & audio models
Video and audio models you can download and run yourself instead of renting through an app: LTX, Wan, MiniMax H3, HunyuanVideo-Foley, ACE-Step and friends. Every claimed speed comes from the project's own README unless a Lab post says we tested it.
Lab posts (12)
- Spotted, not yet tested#LTX#open weights#release notes#performance#keyframesLTX-2 1.5.0: 4K renders in about half the time, plus keyframes you can pin or merely guide
Lightricks merged a batch of performance work from doubleAI's Maxwell into the open LTX-2 pipelines. On two B200s, a five-second 4K clip drops from 250 to 134 seconds. The same release lets you mark each image either to replace a frame exactly or just to guide it, and folds keyframe interpolation into the main two-stage pipeline.
- Spotted, not yet tested#MiniMax H3#open weights#ComfyUI#reference-to-video#costFastH3 Omni goes open: reference-to-video with sound on your own GPU, and the case for letting Opus cut cheap clips
Hao AI Lab open-sourced FastH3 Omni, an 8-step MiniMax H3 that takes up to 12 image, video and audio references and returns 5–15s clips with synced stereo sound. ComfyUI supported it on day one.
- Spotted, not yet tested#Unreal Engine#MCP#agents#previs#3D#cinematicEpic's Unreal Engine plugin for Claude Code is trending. The video angle is Sequencer previs
Hundreds of Unreal Editor tools in 30+ toolsets, including Sequencer, Niagara, materials and Control Rigs, exposed to Claude Code over MCP. It isn't new, but it's #1 on GitHub's Shell trending today, and it opens up agent-built previs and blockouts.
Source: Epic Games
- Spotted, not yet tested#ComfyUI#canvas#image#video#MCP#localComfyArt: a local Lovart-style infinite canvas on your ComfyUI
tldraw + React infinite canvas as a ComfyUI custom node. No account, no credits, no cloud. Optional design agent over MCP. Image plus short video via bundled MiniMax H3 workflows.
Source: @jtydhr88
- Spotted, not yet tested#ComfyUI#Blender#Seedance#camera control#workflowOfficial ComfyUI: Blender blockout to Seedance 2.5
Same idea as LTX Layout-to-Render — 3D controls the camera, AI finishes the shot — but the Seedance 2.5 path, posted by the official ComfyUI account.
Source: @ComfyUI
- Spotted, not yet tested#ComfyUI#Higgsfield#open source#challenge#VFX#MCP#OpenSourceHiggsfield: Comfy's $25K challenge and the first open rebuilds
Comfy put up $25K for open-source rebuilds of Higgsfield-style apps. Within a day: a camera-move studio, open-weights VFX presets, a script-to-Resolve film studio, and an MCP-only video editor.
Source: @ComfyUI
- Spotted, not yet tested#MiniMax H3#ComfyUI#local#speed#open weightsMiniMax H3 gets fast locally: Sol-H3 Studio, HyperFlow 8-step, Ref2VA-VSA
NVlabs' Sol-H3 claims 35.5s for a 5-second H3 clip with audio on one RTX 5090 (vs 989s stock). Ref2VA-VSA claims ~72s for reference-to-video on a 4090 in ~13.5 GB.
Source: NVlabs / @xieenze_jr
- Based on the creator’s video · not yet tested by us#audio#TTS#voice#ComfyUI#lip-sync#MiniMax H3Fish Audio Drama 3 in ComfyUI: directed multi-speaker voice, then H3 talking video
35B open-weight TTS with inline cues ([sighs], [whispers]) and up to 16 speakers, running in ComfyUI from 8 GB VRAM by keeping MoE experts in system RAM. Then hand the take to MiniMax H3 for the picture.
Source: Benji's AI Playground
- Spotted, not yet tested#LTX#ComfyUI#Blender#camera control#open weightsBlock the shot in Blender, render it in LTX: the Layout-to-Render LoRA
Give it a grey clay playblast for the camera and a single styled frame for the look. It returns a finished shot that keeps your camera path and object placement.
Source: Lightricks (LTX)
- Spotted, not yet tested#roundup#open source#rankingsThe top GitHub video repos right now, ranked by stars (Oct 2026)
Twenty repos for AI video, agent video skills and ComfyUI workflows, pulled from the GitHub search API on Oct 14 2026.
Source: Each repo's maintainers (linked)
- Spotted, not yet tested#ComfyUI#Wan#consistencyWan 3.0 in ComfyUI: reference tags for images, video and audio
Official templates for text-to-video, image-to-video and reference-to-video, with clips up to 30 seconds and synced audio.
Source: Comfy Org
- Spotted, not yet tested#music#audio sync#open sourceAn open-source audio stack for video: music, foley, lip-sync, timing
Five repos that cover most of the sound side of an AI video pipeline without a subscription.
Source: ACE Studio & StepFun
Skills, repos & workflows in the directory (21)
- FastH3 Omni ComfyUI
Open 8-step MiniMax H3 (Hao AI Lab FastVideo + Nuva Lab): prompt + up to 12 image/video/audio references → 5/10/15s clips with synced stereo audio. Native ComfyUI node; local recipes for RTX 5090/4090, PRO 6000, DGX Spark. Code Apache-2.0; weights MiniMax-H3 Community License.
- seriesmith ComfyUI
Series config + screenplay-style episode scripts in, cut episodes out: every shot compiled to its own ComfyUI job (MiniMax H3, LTX-2, Wan locally or Seedance/Kling/Veo via Comfy Router) with per-shot re-renders. #OpenSourceHiggsfield entry. MIT.
- ReAngle ComfyUI
Re-shoot a clip from a new camera angle with open weights: depth-lift the first frame, draw a camera path in 3D, then depth reprojection guides LTX-2.5 via the Layout-to-Render IC-LoRA. Demo on a 16 GB card. #OpenSourceHiggsfield. Apache-2.0.
- Comfield Repo
#OpenSourceHiggsfield entry: Higgsfield-style image + video studio on the Comfy Developer Platform. Cloud models via Comfy Router or open weights (LTX-2, MiniMax H3, FastH3) on your GPU; 27 camera-motion presets, A–D takes, live pricing. MIT.
- FXjutsu ComfyUI
Open-weights VFX presets on your footage (Vanish, Day→Night, Flood, Alpha Matte, painted-keyframe fire/smoke, restyles, composites) with LTX-2.5 + IC-LoRAs; no partner APIs. #OpenSourceHiggsfield entry.
- Sol-H3 in ComfyUI ComfyUI
NVlabs' accelerated MiniMax H3 studio over ComfyUI. README: 5s 768p clip with audio in 67.2s one-stage / 35.5s two-stage on an RTX 5090 (vs 989s stock). Needs Linux, 32 GB card, 90 GB RAM. Apache-2.0 repo.
- ComfyUI-Ref2VA-VSA ComfyUI
Sparse-attention MiniMax H3 reference-to-video node: README reports ~72s warm for a 5s 1344×768 clip on an RTX 4090, 4 steps, ~13.5 GB peak VRAM, with reference tokens kept out of pruning. Apache-2.0.
- ComfyUI-Drama3 ComfyUI
Fish Audio Drama 3 (35B TTS) natively in ComfyUI from 8 GB VRAM via experts-in-RAM: voice cloning, up to 16 speakers, inline cues, Qwen3-ASR, saved voices. Code GPL-3.0; weights under Fish Audio's licence.
- drama3-h3-talking ComfyUI
One ComfyUI workflow: text → Drama 3 voice → MiniMax H3 Ref2VA lip-synced talking video (take anchored at frame 0).
- ComfyUI Blender→Seedance 2.5 ComfyUI
Official ComfyUI workflow: Blender blockout controls the camera, Seedance 2.5 finishes the shot. Same pattern as LTX Layout-to-Render.
- ComfyUI Wan 3.0 templates ComfyUI
Official t2v / i2v / r2v graphs; @Image1/@Video1/@Audio1 reference tags (Partner Nodes, credits).
- Comfy-Org workflow_templates ComfyUI
Official template repo (Wan 3.0, vCube enhance, Meshy 3D...).
- ComfyUI-WanVideoWrapper ComfyUI
Community nodes for running Wan models locally.
- LTX-2.5 Layout-to-Render IC-LoRA ComfyUI
Clay/blocking playblast from Blender or Unreal + one styled first frame → finished shot that keeps your camera path. ComfyUI workflow included.
- LTX-Video Repo
Open video model family for self-hosting.
- Wan 3.0 (official) Repo
30 s native clips, up to 20 reference assets, instruction video editing.
- ACE-Step 1.5 Repo
Local song generation, covers, stems, LoRA from a few songs, BPM/key extraction.
- DiffRhythm Repo
Lyrics → full-length song, fast.
- MMAudio Repo
Video-to-audio synced foley (~6 GB VRAM). Check licence for commercial use.
- HunyuanVideo-Foley Repo
Foley generation from video + text.
- LatentSync Repo
Open audio-conditioned lip-sync (v1.6, 512px). Consenting subjects only.
Pipelines (2)
- ComfyUI Wan 3.0: multi-shot sequence from one reference set · Spotted, not yet tested
- Music video: own the track, cut on the beat · Spotted, not yet tested