DV4 is an agentic AI platform for creators. That means it plans the work, does the work and checks the result. You write one line, and DV4 makes a finished video, with the shots, the music and the on-screen text in place. It runs on open-source models and on our auto-tuning inference stack. It is live today at dv4.ai.
A video model makes one clip from one prompt. It does not plan a story, write music, check its own work or set type. DV4 does those jobs around the model. This note goes through those jobs in order. Our example line is: "A short ad for a matte white kettle, calm morning mood."
DV4 does each job in order. When a shot fails its checks, DV4 makes it again.
1. Safety, before DV4 makes anything
The first step is not creative. DV4 checks the request against its content rules before it spends anything. If the request breaks a rule, the job stops and DV4 makes nothing.
The safety checks run again later: on the plan, including every spoken line, and on the frames of each shot. If the safety check cannot run, the job stops and does not count against your plan. We prefer a refused job to an unchecked video.
2. A plan, written like a director's
Next, a planning model reads your line and writes a plan. The plan is not a longer prompt. It holds:
- a shot list, with framing, camera movement and length for each shot
- the spoken lines, if anyone talks
- a music brief: style, mood and tempo
- the words that go on screen, such as a title or an end card
The planner works from a reference on cinematography that our founders wrote. Then code checks the plan. Does each shot fit the length limits? Do the shots add up to the length you asked for? Does a shot ask the video model to draw text? If a check fails, the planner gets one more try with the failures listed.
You can also choose a motion graphics video instead of filmed shots. For that, a model writes the whole film as code. It renders drafts, looks at frames from them and fixes what it sees before it finishes.
3. Music comes before the pictures
DV4 makes the music beside the plan, not after the video. The track gets its beats measured. The timeline then places the cuts on those beats.
Speech works another way. When a person talks on screen, the video model makes the voice and the lip movement in the same pass as the picture. That keeps the lips in sync with the words.
4. Shots, made one by one
Now the timeline fixes each shot's exact length in frames, and the shots go to the video model. A shot that continues the one before it starts from that shot's last frame, so the action carries on across the cut.
Shot prompts never ask for readable text. Video models often misspell words, and a misspelled product name ruins an ad. The words come later, as exact type.
5. Every shot gets checked
When a shot comes back, DV4 runs these checks on it:
- The file itself. Are the size, frame rate and frame count what the timeline asked for?
- Stray text. Text recognition looks for letters the model drew by mistake.
- Speech. Speech recognition listens to the shot and compares the words with the script.
- Unexpected speech. A shot that should be silent must not mumble.
- Safety. DV4 checks sampled frames for unsafe content.
The first take has letters the model drew by mistake, so it fails. A new seed gives a new take, and the new take passes.
When a shot fails, DV4 does not ship it. It makes the shot again with a new seed, a new random start that gives a different take. If the second take also fails, DV4 picks a fallback that fits the failure:
- It keeps the better of the two takes and flags it.
- It voices the lines a different way.
An unsafe shot gets one more try with stricter safety rules. If that take also fails, DV4 stops the job, and the job does not count against your plan.
6. Words, set as type
The title, callouts and captions are not drawn by the video model. A design model writes a layout: font, size, place on screen and timing. Code then measures each block against the real frames. Does it cover a face? Is the contrast high enough to read? Then the model looks at stills of the result and fixes what reads badly.
Captions use the words from the script and the times from the speech check. So each caption appears when its words are spoken.
7. Assembly
Last, DV4 joins the shots and smooths the joins between takes that continue each other. It lays the music under the dialogue, renders the text on top and runs a final probe on the file. You get an MP4, plus a captions file when you ask for one.
What this means
You write one line. DV4 does the planning, the checks and the retakes. You do not need to know which model made which shot, or how to time a cut to a beat.
Many of these steps run a model, and models cost GPU time. Making that work faster and cheaper is the other half of what we do at Deep Variance. We build the auto-tuning inference stack for open-source diffusion models.
DV4 is live. Start creating at dv4.ai.
Originally published on the Deep Variance blog.
