- Home
- YouTube summaries
- AI video models
- Guide 1 of 7
How to choose and use AI video modelsGuide 1 of 7
How to start making AI videos: a beginner workflow
Learn the step-by-step process of creating cinematic AI videos, from generating consistent character sheets and locations to crafting structured multi-stage prompts.
In 30 seconds
- Choose platforms that provide access to multiple image and video models rather than locking into a single tool.
- Generating assets like characters, locations, and props beforehand is essential for visual consistency across scenes.
- Image generation is cheap, so iterate heavily on references before spending expensive video credits.
- Use Large Language Models (LLMs) with structured prompt templates to break scenes into distinct stages, visual styles, and audio directions.
- Draft or low-resolution modes save considerable budget when testing scene motions before committing to full 1080p renders.
0:00Introduction to AI video
Selecting the Right AI Video Platform
1:34 to 2:41 in the video, about 1 minute
Starting out in AI video creation requires picking an environment that will not quickly become obsolete. Because AI models evolve rapidly, relying on a platform tied to only a single model can leave creators stuck behind the curve.
A flexible platform offering a variety of state-of-the-art tools—such as Seedance 2.5, Kling, MiniMax H3 Max, FLUX, and dedicated motion transfer tools—ensures you can always switch to whichever engine delivers the best results for your specific project.
- Avoid long-term subscriptions tied exclusively to a single video model.
- Look for all-in-one platforms featuring unified image and video creation tools.
The Core Production Workflow and Asset Creation
2:42 to 12:22 in the video, about 10 minutes
Creating coherent AI videos involves a structured four-stage process: ideation, asset generation, video generation, and editing. Jumping straight into generating video clips from text usually results in inconsistencies and wasted credits.
Assets serve as reference anchors for your project. By preparing detailed multi-angle character sheets, location backgrounds, and prop images in advance, you give the video model the precise visual references it needs to keep elements identical from shot to shot.
- Generate images first because they cost a fraction of video generation credits.
- Prepare character sheets showing front, profile, back, and close-up views on neutral gray backgrounds.
- Produce dedicated location and prop sheets to keep environments and key objects stable.
Creating Character and Location Sheets
Character sheets can be created either using automated AI casting tools or by utilizing custom LLM templates. A standard three-panel character layout defines the subject's face, outfit, and body shape clearly across distinct angles.
Similarly, cinematic location backgrounds should specify camera perspectives (such as a three-quarter wide-angle shot) and lighting conditions to produce grounded, consistent sets for your characters.
Mastering the Multi-Part Video Prompt Format
12:23 to 14:22 in the video, about 2 minutes
High-quality video prompts require much more detail than a single descriptive sentence. To produce predictable motion, cinematic visuals, and timed audio, prompts must be organized into clear technical blocks.
A comprehensive prompt framework should define the overarching scene goal, specific asset references (using tag assignments like image tags), background lighting, timed stage-by-stage camera motions, audio/dialogue cues, and strict consistency instructions.
- Goal: A high-level description summarizing the action and duration.
- References: Tagged links linking characters, locations, and props to the prompt.
- Stages: Chronological second-by-second breakdowns of cuts, camera movements, and subject actions.
- Style and Audio: Specific film styles, color palettes, dialogue text, and ambient sound effects.
Automating Prompts with Custom LLM Skills
14:23 to 19:33 in the video, about 5 minutes
Writing detailed multi-part prompts manually for every shot can be overwhelming. Creators can streamline the workflow by uploading pre-built prompt skill templates into conversational LLMs such as ChatGPT.
By voice-dictating a rough narrative or scene concept into the LLM, the configured skill automatically expands the raw concept into a formatted, production-ready video prompt containing all necessary shot stages and camera instructions.
- Use speech-to-text tools to quickly describe narrative ideas without manual typing.
- Iterate with the LLM through multiple revisions to adjust comedic timing, actions, or camera distances before generating the clip.
Generating Videos: Drafts, References, and Audio Matching
19:34 to 23:25 in the video, about 4 minutes
Once prompts and asset tags are assembled, videos can be generated using either text-to-video or reference-to-video workflows. Reference-to-video provides far greater creative control because every character, location, and object is mapped directly to corresponding reference files.
To manage production budgets, start by generating short clips in low-resolution draft modes. This allows you to evaluate action timing and character behavior cheaply before committing larger credit pools to 1080p upscaling.
For realistic dialogue and character voices, creators can record their own voice lines and import the resulting audio as an MP4 reference. Linking specific voice files to individual characters in the prompt produces accurately synchronized line deliveries.
- Assign reference numbers directly to characters and scenes in the prompt settings.
- Use draft modes (e.g., 480p) to test shot logic before rendering full 1080p clips.
- Provide audio as black-screen MP4 files to help video engines match speech cadence and voice timbre.
Motion Transfer and Viral Formats
23:26 to 26:41 in the video, about 3 minutes
Another powerful AI video method involves motion transfer tools. Instead of relying purely on text-based motion instructions, motion transfer extracts physical movements from a real video and applies them to custom AI characters.
While this technique is often used to recreate viral social clips, the creator recommends recording original base footage yourself rather than copying others' content. Performing the action on camera and swapping in your character asset creates original, engaging videos with natural physical motion.
- Extract motion data directly from source footage.
- Apply custom character sheets to map your character onto human movement.
- Film original performances to maintain originality and comedic authenticity.
Final Thoughts
Producing professional AI video content requires moving past single-sentence prompting. By adopting a structured workflow—building reference sheets, organizing scene prompts into timed stages, and using draft modes to test motion—creators can achieve cinematic, consistent results without burning through resources.
As video models continue to advance, mastering foundational skills like asset referencing, LLM prompt structuring, and performance-based motion transfer ensures you can adapt seamlessly to any new generative tool that arrives.
Do this yourself
Make the assets first, then animate them
The video's workflow makes character sheets, locations and objects as images first, then uses them as references for every clip, with an LLM helping to write the prompts. The same order works on Oakgen: make the reference images in the image generator, then pass them to a reference-to-video model such as Kling 4.0 Reference or Seedance 2.5 so characters and places stay the same from shot to shot.
Also on Oakgen: Image generator, Kling 4.0 Reference, Seedance 2.5.
Open the AI video generatorQuestions
Why should you generate character sheets before making videos?
Generating multi-angle character sheets provides image anchors that keep facial features, hairstyles, and outfits consistent across different video generations, preventing characters from morphing between shots.
Why use neutral gray backgrounds for reference sheets?
Pure white backgrounds can lead to overexposure issues when the video engine attempts to interpret the reference, whereas neutral gray maintains balanced lighting and contrast.
How can you save credits when generating AI videos?
Generate inexpensive still images first to perfect your references, test video scenes using low-resolution draft modes, and only upscale the finished clip to 1080p once the movement and timing look correct.
This is a summary of a public video by Dan Kieft. The method and the demo are theirs: watch the original. Oakgen wrote the summary.





