返回目录
开源项目AI 视频生成类新手

GitHub - calesthio/OpenMontage: World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent

Monty the Clapper — the official mascot of OpenMontage OpenMontage The first open-source, agentic video production system. Paste A Video · Quick Start · Try These Prompts · Pipelines · How It Works · Sponsors · Providers · Review Guide · Agent Guide Follow

0 次阅读2026/08/10 发布
GitHub - calesthio/OpenMontage: World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent 来源图片

社区作者 · Aitroys 管理员

它解决什么问题

Monty the Clapper — the official mascot of OpenMontage

OpenMontage

The first open-source, agentic video production system.

Paste A Video · Quick Start · Try These Prompts · Pipelines · How It Works · Sponsors · Providers · Review Guide · Agent Guide

Follow The Build

Sponsors

Want to support OpenMontage? Sponsor the project .

Click to collapse

Bloome lets multiple AI agents (Claude, ChatGPT, DeepSeek, and more) collaborate in one conversation for agentic video pipelines. It has zero setup, runs in the cloud, works on web and mobile, and lets you share a configured agent with your whole team. Try Bloome .

Atlas Cloud is a full-modal AI inference platform that gives developers a single AI API for video generation, image generation, and LLM APIs.

Instead of managing multiple vendor integrations, you connect once and get unified access to 300+ curated models across all modalities. Check out Atlas Cloud's new coding plan promotion for more budget-friendly API access.

Turn your AI coding assistant into a full video production studio. Describe what you want in plain language — your agent handles research, scripting, asset generation, editing, and final composition.

Important distinction: OpenMontage can make image-based videos, but it can also make a real video video for free/open-source workflows: the agent builds a corpus from free stock footage and open archives, retrieves actual motion clips, edits them into a timeline, and renders a finished piece.

That is not the usual "animate a handful of stills and call it video" trick.

signal-from-tomorrow_final_with_music_upload_v2.mp4

"SIGNAL FROM TOMORROW" — a cinematic sci-fi trailer fully produced through OpenMontage: concept, script, scene plan, Veo-generated motion clips, soundtrack, and Remotion composition.

the_last_banana_v3_github.mp4

"THE LAST BANANA" — a 60-second Pixar-style animated short about a lonely banana who finds friendship with a kiwi. 6 Kling v3-generated motion clips (via fal.

ai), Google Chirp3-HD narration, royalty-free piano music, TikTok-style word-level captions, and Remotion composition. Total cost: $1.33 .

alexandria-fire-1080p-v2.mp4

"The Library at Alexandria" — a 70-second history elegy on what humanity lost in a single night.

Five hand-authored scenes — an illuminated manuscript page, cascading scroll-tags, a Burning Counter ticking 700,000 → 0 inside a candle's flame, a charred vellum fragment with surviving Greek, and an empty void — set to OpenAI 'ash' narration and a free Pixabay strings score.

Total cost: $0.02 . Built through OpenMontage's atelier (bespoke) composition mode — every scene crafted from scratch, no shared components.

void-linkedin.mp4

"VOID — Neural Interface" — a product ad produced with just one API key (OpenAI). 4 AI-generated images (gpt-image-1), TTS narration, auto-sourced royalty-free music, word-level subtitles via WhisperX, and Remotion data visualizations. Total cost: $0.69 . Zero manual asset work.

candyland.mp4

"Afternoon in Candyland" — a Ghibli-style anime animation. A little girl's whimsical afternoon adventure through candy gates, gumdrop rivers, and lollipop gardens.

12 FLUX-generated images with multi-image crossfade, cinematic camera motion (zoom, pan, Ken Burns), sparkle/petal/firefly particle overlays, and ambient music with auto-detected energy offset. Total cost: $0.15 . No video generation, no manual editing.

mori-no-seishin.mp4

"Mori no Seishin" — a Ghibli-style anime animation of a forest spirit's journey through ancient woods.

12 FLUX-generated images with parallax crossfade, drift and pan camera motion, firefly and petal particles, cinematic vignette lighting, and ambient forest soundtrack. Total cost: $0.15 . Still images brought to life through Remotion's animation engine.

Subscribe to @OpenMontage on YouTube to see new videos as they ship — every video includes the full prompt, pipeline, tools used, and cost so you can reproduce it yourself.

Start From A Video You Already Love

Starting from a reference video is often faster than starting from a blank prompt.

OpenMontage can start from a YouTube video, Short, Reel, TikTok, or local clip and turn it into a grounded production plan:

  • Paste a reference video
  • The agent analyzes transcript, pacing, scenes, keyframes, and style
  • You get 2-3 differentiated concepts, an honest tool path, cost estimates, and a sample before full production

"Here's a YouTube Short I love. Make me something like this, but about quantum computing."

What you get back is not "best guess prompt spaghetti." You get:

  • What it keeps from the reference: pacing, hook style, structure, tone
  • What it changes : topic, visual treatment, angle, narration approach
  • What it will cost at your target duration, before asset generation starts
  • What it will actually look like with your currently available tools

Works with Claude Code, Cursor, Copilot, Windsurf, Codex — any AI coding assistant that can read files and run code.

Watch It Happen — The Backlot Living Storyboard

Chat tells you what the agent said . Backlot shows you what the production is actually doing — a local board that fills itself in as the pipeline runs.

Stages light up, the script lands as a screenplay page, scene cards shimmer while assets generate, and every provider decision and dollar spent is on the wall.

When a production starts, the agent opens it for you automatically. No setup, no reporting — the board derives everything from the project files the pipeline already writes.

The storyboard is now a real approval gate. Asset generation pauses on a scene-by-scene contact sheet — takes, prompts, per-asset cost, quality scores — so you approve the visuals before the render, not after it's too late:

Creative gates hold until you answer. The board shows what's waiting and why; you reply in chat:

Every production on your machine, live-first, in the library:

命令
python -m backlot open # the library — every project on disk
命令
python -m backlot open < project-id > # one production's live board
命令
python scripts/backlot_simulate_run.py # no production yet? watch a simulated one live

And when a run is done, hit ▶ REPLAY RUN — the whole production replays from its timestamps, scrubbable end to end. See backlot/README.md for how it works.

Quick Start

Prerequisites

可复制命令
Python 3.10+ — python.org
  • FFmpeg — brew install ffmpeg / sudo apt install ffmpeg / ffmpeg.org
  • Node.js 18+ — nodejs.org
  • An AI coding assistant — Claude Code, Cursor, Copilot, Windsurf, or Codex

Install & Run

命令
git clone https://github.com/calesthio/OpenMontage.git
命令
cd OpenMontage
命令
make setup

Open the project in your AI coding assistant and tell it what you want:

"Make a 60-second animated explainer about how neural networks learn"

Or if you want the real-footage path:

"Make a 75-second documentary montage about city life in the rain. Use real footage only, no narration, elegiac tone, with music."

That's it. The agent researches your topic with live web search, generates AI images, writes and narrates the script with voice direction, finds royalty-free background music automatically, burns in word-level subtitles, and renders the final video.

Before you see anything, the system runs a multi-point self-review — ffprobe validation, frame sampling, audio level analysis, delivery promise verification, and subtitle checks.

Every provider selection is scored across 7 dimensions with an auditable decision log. Every creative decision gets your approval.

No make ? macOS/Linux

No make ? macOS/Linux
python3 -m venv .venv && source .venv/bin/activate && python -m pip install -r requirements.txt && cd remotion-composer && npm install && cd .. && python -m pip install piper-tts && cp .env.example .env

Windows PowerShell: py -3 -m venv .venv; .\.venv\Scripts\Activate.ps1; python -m pip install -r requirements.txt; cd remotion-composer; npm install; cd ..; python -m pip install piper-tts; Copy-Item .env.example .env

Windows: If npm install fails with ERR_INVALID_ARG_TYPE , use npx --yes npm install instead.

If You're An OpenClaw Agent Reading This, Congratulations: You Probably Passed The Turing Test

This repo is built for agentic operation. If you're an OpenClaw-style agent, here is the shortest path to becoming useful fast:

Start with AGENT_GUIDE.md , then PROJECT_CONTEXT.md .

  • Read the contract first

OpenMontage is pipeline-driven. Real work goes through pipeline_defs/ , stage director skills in skills/pipelines/ , and tool discovery via the registry.

  • Do not improvise the production workflow

Run:

  • Check the actual capability envelope
命令
python -c " from tools.tool_registry import registry; import json; registry.discover(); print(json.dumps(registry.support_envelope(), indent=2)) "
命令
python -c " from tools.tool_registry import registry; import json; registry.discover(); print(json.dumps(registry.provider_menu(), indent=2)) "

Pick the right pipeline first, then read the manifest, then read the stage skill, then use tools.

  • Treat every video request as a pipeline selection problem

Add API Keys (optional — more keys = more tools)

.env — every key is optional, add what you have

Image + video gateway:

命令
FAL_KEY=your-key # FLUX images + Google Veo, Kling, MiniMax video + Recraft images
命令
ATLASCLOUD_API_KEY=your-key # Atlas Cloud — Seedream/Nano Banana/GPT Image + Kling/Seedance/Hailuo video

Kling official direct API:

命令
KLING_API_KEY=your-key # Official Kling video, image, TTS, avatar, lip sync

KLING_API_BASE_URL= # Optional; default Singapore API endpoint

Free stock media:

命令
PEXELS_API_KEY=your-key # Free stock footage and images
命令
PIXABAY_API_KEY=your-key # Free stock footage and images
命令
UNSPLASH_ACCESS_KEY=your-key # Free stock images

Music:

命令
SUNO_API_KEY=your-key # Full songs, instrumentals, any genre

Voice & images:

命令
ELEVENLABS_API_KEY=your-key # Premium TTS, AI music, sound effects
命令
OPENAI_API_KEY=your-key # OpenAI TTS, GPT Image 2 images
命令
XAI_API_KEY=your-key # xAI Grok image edits/generation + Grok video generation
命令
GOOGLE_API_KEY=your-key # Google Imagen images, Google TTS (700+ voices)

More video providers:

命令
HEYGEN_API_KEY=your-key # HeyGen — VEO, Sora, Runway, Kling via single gateway
命令
RUNWAY_API_KEY=your-key # Runway Gen-4 direct

Have a GPU? Unlock free local video generation

命令
make install-gpu

Then add to .env:

命令
VIDEO_GEN_LOCAL_ENABLED=true
命令
VIDEO_GEN_LOCAL_MODEL=wan2.1-1.3b # or wan2.1-14b, hunyuan-1.5, ltx2-local, cogvideo-5b

What You Get With Zero API Keys

You don't need paid API keys to make real videos. Out of the box, make setup gives you:

Capability Free Tool What It Does

Narration Piper TTS Free offline text-to-speech — real human-sounding narration

Open footage Archive.org + NASA + Wikimedia Commons Free/open archival footage, educational media, and documentary texture

Extra stock Pexels + Unsplash + Pixabay Free stock footage/images (developer keys are free to get)

Composition (React) Remotion React-based rendering — spring-animated image scenes, text cards, stat cards, charts, TikTok-style word-level captions, TalkingHead

Composition (HTML/GSAP) HyperFrames HTML/CSS/GSAP rendering — kinetic typography, product promos, launch reels, registry blocks, website-to-video, rigged SVG character animation

Post-production FFmpeg Encoding, subtitle burn-in, audio mixing, color grading

Subtitles Built-in Auto-generated captions with word-level timing

OpenMontage picks between Remotion and HyperFrames at proposal time (locked as render_runtime ).

Remotion is the default for data-driven explainers and anything using the existing React scene stack; HyperFrames is the default for motion-graphics-heavy briefs that express naturally as HTML + GSAP, including the character-animation pipeline's SVG/GSAP rig output.

See skills/core/hyperframes.md for the full decision matrix.

Two free-ish paths:

  • Image-based video: Piper narrates your script, images provide the visuals, and Remotion animates them into a polished edit.
  • Local character animation: SVG rigs, pose libraries, GSAP timelines, and HyperFrames render cartoon character acting to projects/<project-name>/renders/final.mp4 .
  • Real-footage video: the documentary montage pipeline builds a CLIP-searchable corpus from Archive.org, NASA, Wikimedia Commons, and optional free-key sources like Pexels and Unsplash, then cuts together actual motion footage into a finished video.

If you want the second one, prompt for a documentary montage , tone poem , or stock-footage collage , and explicitly say use real footage only .

Try These Prompts

Copy any of these into your AI coding assistant after setup. Each one runs a full production pipeline.

Start from a reference video

"Here's a YouTube short I love. Make me something like this, but about CRISPR for high school students."

"Analyze this Reel and give me 3 original variants I could make for my own product launch."

"I like the pacing and hook in this video. Keep that energy, but turn it into a 45-second explainer about black holes."

Zero keys needed

"Make a 45-second animated explainer about why the sky is blue"

"Create a 60-second video about the history of the internet, with narration and captions"

"Make a data-driven explainer about coffee consumption around the world"

Free real-footage documentary path

"Make a 90-second documentary montage about what a city feels like at 4am. Use real footage only, no narration, elegiac tone."

"Create a 60-second Adam-Curtis-style archival collage about 1950s consumer optimism. Prefer Archive.org and Wikimedia footage."

"Cut together a dreamlike montage about coming home in the rain using real stock footage only. Music yes, narration no."

With an image/video provider configured (~$0.15–$1.50)

"Create a 30-second Ghibli-style animated video of a magical floating library in the clouds at golden hour"

"Make a 30-second anime-style animation of an underwater temple with bioluminescent coral and ancient ruins"

"Create an animated explainer about how CRISPR gene editing works, using AI-generated visuals"

"Make a product launch teaser for a fictional smart water bottle called AquaPulse"

Full setup (~$1–$3)

"Create a cinematic 30-second trailer for a sci-fi concept: humanity receives a warning from 1000 years in the future"

"Make a 90-second animated explainer about quantum computing for middle school students, with a fun narrator voice and custom soundtrack"

Want more? See the full Prompt Gallery for tested prompts with expected costs and output examples, or run make demo to render zero-key demo videos instantly.

Pipelines

Each pipeline is a complete production workflow, from idea to finished video.

Pipeline What It Produces Best For

Animated Explainer AI-generated explainer with research, narration, visuals, music Educational content, tutorials, topic breakdowns

Animation Motion graphics, kinetic typography, animated sequences Social media, product demos, abstract concepts

Avatar Spokesperson Avatar-driven presenter videos Corporate comms, training, announcements

Cinematic Trailer, teaser, and mood-driven edits Brand films, teasers, promotional content

Clip Factory Batch of ranked short-form clips from one long source Repurposing long content for social media

Documentary Montage Thematic montage cut from a CLIP-indexed corpus of free stock footage and open archives (Pexels, Archive.org, NASA, Wikimedia, Unsplash) Video essays, mood pieces, retrieval-first B-roll edits, real-footage videos without paid generation APIs

Hybrid Source footage + AI-generated support visuals Enhancing existing footage with graphics

Localization & Dub Subtitle, dub, and translate existing video Multi-language distribution

Podcast Repurpose Podcast highlights to video Podcast marketing, audiogram videos

Screen Demo Polished software screen recordings and walkthroughs Product demos, tutorials, documentation

Talking Head Footage-led speaker videos Presentations, vlogs, interviews

Every pipeline follows the same structured flow:

research -> proposal -> script -> scene_plan -> assets -> edit -> compose

Each stage has a dedicated director skill — a markdown instruction file that teaches the agent exactly how to execute that stage. The agent reads the skill, uses the tools, self-reviews, checkpoints state, and asks for human approval at creative decision points.

Web research is a first-class stage. Before writing a single word of script, the agent searches YouTube, Reddit, Hacker News, news sites, and academic sources.

It gathers data points, audience questions, trending angles, and visual references — then cites everything in a structured research brief. Your videos are grounded in real, current information, not hallucinated facts.

Why OpenMontage?

Most AI video tools give you a single clip from a prompt. OpenMontage gives you an end-to-end production pipeline — the same structured process a real production team follows, automated by your AI agent.

Most "free AI video" stacks quietly mean "animate still images." OpenMontage can do that too, but it can also build a finished video from real footage pulled from free/open sources, ranked semantically, edited intentionally, and rendered as a proper timeline.

Edit your own talking-head footage. Generate a fully animated explainer from scratch. Cut a 2-hour podcast into a dozen social clips. Translate and dub your content into 10 languages. Build a cinematic brand teaser from stock footage and AI-generated scenes.

If a production team can make it, OpenMontage can orchestrate it.

  • 12 production pipelines — explainers, talking heads, screen demos, cinematic trailers, animations, podcasts, localization, documentary montages, and more
  • 100+ production tools — spanning video generation, image creation, text-to-speech, music, audio mixing, subtitles, enhancement, and analysis
  • 700+ agent skill and production-knowledge files — pipeline directors, creative techniques, quality checklists, and deep technology knowledge packs that teach the agent how to use every tool like an expert
  • Reference-driven creation — paste a video you like and the agent turns it into a grounded, differentiated production plan instead of forcing you to invent the perfect prompt from scratch
  • Real-footage documentary creation without paid video models — build actual edited videos from free/open motion footage and archival sources, not just Ken Burns over images
  • Live web research built in — before writing a single word of script, the agent runs 15-25+ web searches across YouTube, Reddit, news sites, and academic sources to ground your video in real, current data
  • Both free/local AND cloud providers — every capability supports open-source local alternatives alongside premium APIs. Use what you have.
  • No vendor lock-in — swap providers freely. The scored selector ranks every provider across 7 dimensions (task fit, output quality, control, reliability, cost efficiency, latency, continuity) and picks the best match automatically.
  • Production-grade quality gates — delivery promise enforcement blocks slideshow-looking renders, pre-compose validation catches broken plans before wasting GPU time, and mandatory post-render self-review (ffprobe + frame extraction + audio analysis) ensures the agent never presents garbage. Every provider choice, style decision, and fallback gets logged in an auditable decision trail.
  • Budget governance built in — cost estimation before execution, spend caps, per-action approval thresholds. No surprise bills.

How It Works

OpenMontage uses an agent-first architecture . There is no code orchestrator. Your AI coding assistant IS the orchestrator.

You: "Make an explainer video about how black holes form" | v Agent reads pipeline manifest (YAML) -- stages, tools, review criteria, success gates | v Agent reads stage director skill (Markdown) -- HOW to execute each stage | v Agent calls Python tools -- scored provider selection ranks every tool across 7 dimensions | v Agent self-reviews using reviewer skill -- schema validation, playbook compliance, quality checks | v Agent checkpoints state (JSON) -- resumable, with decision log and cost snapshot | v Agent presents for your approval -- you stay in control at every creative decision | v Pre-compose validation gate -- delivery promise, slideshow risk, renderer governance | v Render (Remotion or FFmpeg) -- composition engine matched to visual grammar | v Post-render self-review -- ffprobe, frame extraction, audio analysis, promise verification | v Final video output -- only if self-review passes

命令
Python provides tools and persistence. All creative decisions, orchestration logic, review criteria, and quality standards live in readable instruction files (YAML manifests + Markdown skills) that you can inspect and customize. Every decision is logged with alternatives considered, confidence scores, and the reasoning behind each choice.

Architecture

OpenMontage/ ├── tools/ # 100+ Python tools (the agent's hands) │ ├── video/ # 13 video gen tools + compose, stitch, trim │ ├── audio/ # 4 TTS providers + Suno/ElevenLabs music, mixing, enhancement │ ├── graphics/ # 9 image/graphics generation tools + diagrams, code snippets, math │ ├── enhancement/ # Upscale, bg remove, face enhance, color grade │ ├── analysis/ # Transcription, scene detect, frame sampling │ ├── avatar/ # Talking head, lip sync │ └── subtitle/ # SRT/VTT generation │ ├── pipeline_defs/ # YAML pipeline manifests (the agent's playbook) ├── skills/ # Markdown skill files (the agent's knowledge) │ ├── pipelines/ # Per-pipeline stage director skills │ ├── creative/ # Creative technique skills │ ├── core/ # Core tool skills │ └── meta/ # Reviewer, checkpoint protocol │ ├── schemas/ # 15 JSON Schemas (contract validation) ├── styles/ # Visual style playbooks (YAML) ├── remotion-composer/ # React/Remotion video composition engine ├── lib/ # Core infrastructure (config, checkpoints, pipeline loader) └── tests/ # Contract tests, QA integration tests, eval harness

Three-Layer Knowledge Architecture

Layer 1: tools/ + pipeline_defs/ "What exists" — executable capabilities + orchestration Layer 2: skills/ "How to use it" — OpenMontage conventions and quality bars Layer 3: .agents/skills/ "How it works" — external technology knowledge packs

Each tool declares which Layer 3 skills it relies on. The agent reads Layer 1 to know what's available, Layer 2 to know how OpenMontage wants it used, and Layer 3 for deep technical knowledge when needed.

Supported Providers

Full setup guide with pricing and free tiers: docs/PROVIDERS.md

Video Generation — 15 providers

Provider Type Notes

Kling (fal.ai) Cloud API High quality, fast via fal.ai gateway

Kling Official Cloud API Official direct API with separate kling_official provider

Runway Gen-4 Cloud API Cinematic quality, Gen-3 Alpha Turbo / Gen-4 Turbo / Gen-4 Aleph

Google Veo 3 Cloud API Long-form, cinematic. Via fal.ai or HeyGen.

Grok Imagine Video Cloud API Strong reference-image video and xAI-native short-form generation

Higgsfield Cloud API Multi-model orchestrator with Soul ID for character consistency

MiniMax Cloud API Cost-effective

HeyGen Cloud API Multi-model gateway

WAN 2.1 Local GPU Free, 1.3B and 14B variants

Hunyuan Local GPU Free, high quality

CogVideo Local GPU Free, 2B and 5B variants

LTX-Video Local GPU / Modal Free locally, or self-hosted cloud

Pexels Stock Free stock footage

Pixabay Stock Free stock footage

Wikimedia Commons Stock Free/open stock footage and archival video

Image Generation — 11 tools/providers

Provider Type Notes

FLUX Cloud API State-of-the-art quality

Google Imagen Cloud API Imagen 4 — high-quality, multiple aspect ratios

Grok Imagine Image Cloud API Strong image edits, style transfer, and multi-image compositing

GPT Image 2 Cloud API OpenAI's image model

Recraft Cloud API Design-focused generation

Kling Official Cloud API Official direct API for Kling image generation and reference workflows

Local Diffusion Local GPU Stable Diffusion, free

Pexels Stock Free stock images

Pixabay Stock Free stock images

Unsplash Stock Free stock images

ManimCE Local Mathematical animations

Text-to-Speech — 5 providers

Provider Type Notes

ElevenLabs Cloud API Premium voice quality

Google TTS Cloud API 700+ voices, 50+ languages — best for localization

Kling Official TTS Cloud API Official Kling narration when a voice_id is known

OpenAI TTS Cloud API Fast, affordable

Piper Local Completely free, offline

Music, Sound & Post-Production Music & Sound:

Provider Type Notes

Suno AI Cloud API Full song generation with vocals, lyrics, any genre. Up to 8 minutes.

ElevenLabs Music Cloud API AI music generation

ElevenLabs SFX Cloud API Sound effect generation

Post-Production (always available, always free):

Tool What It Does

FFmpeg Video composition, encoding, subtitle burn-in, audio muxing

Video Stitch Multi-clip assembly, crossfades, picture-in-picture, spatial layouts

Video Trimmer Precision cutting and extraction

Audio Mixer Multi-track mixing, ducking, fades

Audio Enhance Noise reduction, normalization

Color Grade LUT-based color grading

Subtitle Gen SRT/VTT generation from timestamps

Enhancement:

Tool What It Does

Upscale Real-ESRGAN image/video upscaling

Background Remove rembg / U2Net background removal

Face Enhance Face quality enhancement

Face Restore CodeFormer / GFPGAN face restoration

Analysis:

Tool What It Does

Transcriber WhisperX speech-to-text with word-level timestamps

Scene Detect Automatic scene boundary detection

Frame Sampler Intelligent frame extraction

Video Understand CLIP/BLIP-2 vision-language analysis

Avatar & Lip Sync:

Tool What It Does

Talking Head SadTalker / MuseTalk avatar animation

Lip Sync Wav2Lip audio-driven lip synchronization

Kling Avatar Official Kling cloud avatar presenter generation

Kling Lip Sync Official Kling cloud lip-sync with explicit face selection

Composition & Rendering:

Engine Type What It Does

Remotion Local (Node.

js) React-based programmatic video — spring-animated image scenes, stat reveals, section titles, hero cards, TikTok-style word-by-word captions, scene transitions (fade/slide/wipe/flip), Google Fonts, audio with fade curves, and the TalkingHead avatar composition.

When no video generation providers are configured, the agent generates still images and Remotion turns them into fully animated video.

HyperFrames Local (Node.

js ≥ 22) HTML/CSS/GSAP programmatic video — kinetic typography, product promos, launch reels, custom motion graphics, registry blocks (data charts, grain overlays, shader transitions), website-to-video workflows, and rigged SVG character animation.

Consumed via npx hyperframes ; no monorepo checkout needed.

FFmpeg Local Core video assembly, encoding, subtitle burn, audio muxing, color grading

Runtime is chosen at proposal ( render_runtime ) and locked through edit_decisions . Silent swaps between runtimes are a governance violation — see skills/core/hyperframes.md .

Style System

Style playbooks define the visual language for your productions:

Playbook Best For

Clean Professional Corporate, educational, SaaS

Flat Motion Graphics Social media, TikTok, startups

Minimalist Diagram Technical deep-dives, architecture

Playbooks control typography, color palettes, motion styles, audio profiles, and quality rules. The agent reads the playbook and applies it consistently across all generated assets.

Platform Output Profiles

Built-in render profiles for every major platform:

Profile Resolution Aspect Ratio

YouTube Landscape 1920x1080 16:9

YouTube 4K 3840x2160 16:9

YouTube Shorts 1080x1920 9:16

Instagram Reels 1080x1920 9:16

Instagram Feed 1080x1080 1:1

TikTok 1080x1920 9:16

LinkedIn 1920x1080 16:9

Cinematic 2560x1080 21:9

Production Governance

OpenMontage treats video production like real engineering — with quality gates, audit trails, and enforcement at every stage.

Quality Gates

  • Human approval gates are enforced, not suggested — proposal, script, scene plan,

— 本文由 AI 根据公开来源辅助整理,命令、版本与许可证请在使用前到原始页面复核。

安装 / 开始使用

Quick Start · Try These Prompts · Pipelines · How It Works · Sponsors · Providers · Review Guide · Agent Guide Follow The Build Sponsors Want to support OpenMontage? Sponsor the project .

Click to collapse Bloome lets multiple AI agents (Claude, ChatGPT, DeepSeek, and more) collaborate in one conversation for agentic video pipelines.

It has zero setup, runs in the cloud, works on web and mobile, and lets you share a configured agent with your whole team. Try Bloome .

Atlas Cloud is a full-modal AI inference platform that gives developers a single AI API for video generation, image generation, and LLM APIs.

Instead of managing multiple vendor integrations, you connect once and get unified access to 300+ curated models across all modalities. Check out Atlas Cloud's new coding plan promotion for more budget-friendly API access.

Turn your AI coding assistant into a full video production studio. Describe what you want in plain language — your agent handles research, scripting, asset generation, editing, and final composition.

Important distinction: OpenMontage can make image-based videos, but it can also make a real video video for free/open-source workflows: the agent builds a corpus from free stock footage and open archives, retrieves actual motion clips, edits them into a timeline, and renders a finished piece.

That is not the usual "animate a handful of stills and call it video" trick. signal-from-tomorrow_final_with_music_upload_v2.

mp4 "SIGNAL FROM TOMORROW" — a cinematic sci-fi trailer fully produced through OpenMontage: concept, script, scene plan, Veo-generated motion clips, soundtrack, and Remotion composition. the_last_banana_v3_github.

mp4 "THE LAST BANANA" — a 60-second Pixar-style animated short about a lonely banana who finds friendship with a kiwi. 6 Kling v3-generated motion clips (via fal.

ai), Google Chirp3-HD narration, royalty-free piano music, TikTok-style word-level captions, and Remotion composition. Total cost: $1.33 . alexandria-fire-1080p-v2.

mp4 "The Library at Alexandria" — a 70-second history elegy on what humanity lost in a single night.

Five hand-authored scenes — an illuminated manuscript page, cascading scroll-tags, a Burning Counter ticking 700,000 → 0 inside a candle's flame, a charred vellum fragment with surviving Greek, and an empty void — set to OpenAI 'ash' narration and a free Pixabay strings score.

Total cost: $0.02 . Built through OpenMontage's atelier (bespoke) composition mode — every scene crafted from scratch, no shared components. void-linkedin.mp4 "VOID — Neural Interface" — a product ad produced with just one API key (OpenAI).

4 AI-generated images (gpt-image-1), TTS narration, auto-sourced royalty-free music, word-level subtitles via WhisperX, and Remotion data visualizations. Total cost: $0.69 . Zero manual asset work. candyland.

mp4 "Afternoon in Candyland" — a Ghibli-style anime animation. A little girl's whimsical afternoon adventure through candy gates, gumdrop rivers, and lollipop gardens.

12 FLUX-generated images with multi-image crossfade, cinematic camera motion (zoom, pan, Ken Burns), sparkle/petal/firefly particle overlays, and ambient music with auto-detected energy offset. Total cost: $0.15 . No video generation, no manual editing.

mori-no-seishin.mp4 "Mori no Seishin" — a Ghibli-style anime animation of a forest spirit's journey through ancient woods.

12 FLUX-generated images with parallax crossfade, drift and pan camera motion, firefly and petal particles, cinematic vignette lighting, and ambient forest soundtrack. Total cost: $0.15 . Still images brought to life through Remotion's animation engine.

Subscribe to @OpenMontage on YouTube to see new videos as they ship — every video includes the full prompt, pipeline, tools used, and cost so you can reproduce it yourself.

Start From A Video You Already Love Starting from a reference video is often faster than starting from a blank prompt. OpenMontage can start from a YouTube video, Short, Reel, TikTok, or local clip and turn it into a grounded production plan:

"Here's a YouTube Short I love. Make me something like this, but about quantum computing." What you get back is not "best guess prompt spaghetti." You get:

Works with Claude Code, Cursor, Copilot, Windsurf, Codex — any AI coding assistant that can read files and run code. Watch It Happen — The Backlot Living Storyboard Chat tells you what the agent said .

Backlot shows you what the production is actually doing — a local board that fills itself in as the pipeline runs.

Stages light up, the script lands as a screenplay page, scene cards shimmer while assets generate, and every provider decision and dollar spent is on the wall. When a production starts, the agent opens it for you automatically.

No setup, no reporting — the board derives everything from the project files the pipeline already writes. The storyboard is now a real approval gate.

Asset generation pauses on a scene-by-scene contact sheet — takes, prompts, per-asset cost, quality scores — so you approve the visuals before the render, not after it's too late: Creative gates hold until you answer.

The board shows what's waiting and why; you reply in chat: Every production on your machine, live-first, in the library:

  • Paste a reference video
  • The agent analyzes transcript, pacing, scenes, keyframes, and style
  • You get 2-3 differentiated concepts, an honest tool path, cost estimates, and a sample before full production
  • What it keeps from the reference: pacing, hook style, structure, tone
  • What it changes : topic, visual treatment, angle, narration approach
  • What it will cost at your target duration, before asset generation starts
  • What it will actually look like with your currently available tools
命令
python -m backlot open # the library — every project on disk
命令
python -m backlot open < project-id > # one production's live board
命令
python scripts/backlot_simulate_run.py # no production yet? watch a simulated one live

And when a run is done, hit ▶ REPLAY RUN — the whole production replays from its timestamps, scrubbable end to end. See backlot/README.md for how it works. Quick Start Prerequisites

可复制命令
Python 3.10+ — python.org

Install & Run

  • FFmpeg — brew install ffmpeg / sudo apt install ffmpeg / ffmpeg.org
  • Node.js 18+ — nodejs.org
  • An AI coding assistant — Claude Code, Cursor, Copilot, Windsurf, or Codex
命令
git clone https://github.com/calesthio/OpenMontage.git
命令
cd OpenMontage
命令
make setup

Open the project in your AI coding assistant and tell it what you want: "Make a 60-second animated explainer about how neural networks learn" Or if you want the real-footage path: "Make a 75-second documentary montage about city life in the rain.

Use real footage only, no narration, elegiac tone, with music." That's it.

The agent researches your topic with live web search, generates AI images, writes and narrates the script with voice direction, finds royalty-free background music automatically, burns in word-level subtitles, and renders the final video.

Before you see anything, the system runs a multi-point self-review — ffprobe validation, frame sampling, audio level analysis, delivery promise verification, and subtitle checks.

Every provider selection is scored across 7 dimensions with an auditable decision log. Every creative decision gets your approval.

No make ? macOS/Linux

No make ? macOS/Linux
python3 -m venv .venv && source .venv/bin/activate && python -m pip install -r requirements.txt && cd remotion-composer && npm install && cd .. && python -m pip install piper-tts && cp .env.example .env

Windows PowerShell: py -3 -m venv .venv; .\.venv\Scripts\Activate.ps1; python -m pip install -r requirements.txt; cd remotion-composer; npm install; cd .; python -m pip install piper-tts; Copy-Item .env.example .

env Windows: If npm install fails with ERR_INVALID_ARG_TYPE , use npx --yes npm install instead. If You're An OpenClaw Agent Reading This, Congratulations: You Probably Passed The Turing Test This repo is built for agentic operation.

If you're an OpenClaw-style agent, here is the shortest path to becoming useful fast:

Start with AGENT_GUIDE.md , then PROJECT_CONTEXT.md .

OpenMontage is pipeline-driven. Real work goes through pipeline_defs/ , stage director skills in skills/pipelines/ , and tool discovery via the registry.

Run:

  • Read the contract first
  • Do not improvise the production workflow
  • Check the actual capability envelope
命令
python -c " from tools.tool_registry import registry; import json; registry.discover(); print(json.dumps(registry.support_envelope(), indent=2)) "
命令
python -c " from tools.tool_registry import registry; import json; registry.discover(); print(json.dumps(registry.provider_menu(), indent=2)) "

Pick the right pipeline first, then read the manifest, then read the stage skill, then use tools. Add API Keys (optional — more keys = more tools)

  • Treat every video request as a pipeline selection problem

.env — every key is optional, add what you have

Image + video gateway:

命令
FAL_KEY=your-key # FLUX images + Google Veo, Kling, MiniMax video + Recraft images
命令
ATLASCLOUD_API_KEY=your-key # Atlas Cloud — Seedream/Nano Banana/GPT Image + Kling/Seedance/Hailuo video

Kling official direct API:

命令
KLING_API_KEY=your-key # Official Kling video, image, TTS, avatar, lip sync

KLING_API_BASE_URL= # Optional; default Singapore API endpoint

来源教程配图

Monty the Clapper — the official mascot of OpenMontage
配图 1 · Monty the Clapper — the official mascot of OpenMontage查看原图
🏆 #1 Repository of the Day on GitHub Trending
配图 2 · 🏆 #1 Repository of the Day on GitHub Trending查看原图
Bloome
配图 3 · Bloome查看原图
Atlas Cloud
配图 4 · Atlas Cloud查看原图
Backlot live board — assets generating
配图 5 · Backlot live board — assets generating查看原图
Backlot storyboard — filmstrip with takes and renders
配图 6 · Backlot storyboard — filmstrip with takes and renders查看原图
Backlot script gate — awaiting approval
配图 7 · Backlot script gate — awaiting approval查看原图
Backlot library
配图 8 · Backlot library查看原图

适用场景

学习研究
开源项目实践