Prompt Design
Updated: 2026-05
1. About This Page
This guide covers how to write video-specific prompts for Runway. There are different techniques involved compared to prompts for image-generating AI, and vocabulary related to “motion” and “camera” is particularly key.
2. The Three Key Elements of Video Prompts
When writing prompts for Runway, keep the following three elements in mind:
- Subject — What is being filmed
- Motion — How it moves
- Camera Motion — How the camera itself moves
Example:
[Subject] A man wearing a red coat [Motion] walks slowly across a snowy field [Camera] The camera tracks alongside him from the side
In practice, combine them into 1–3 sentences:
A man wearing a red coat walks slowly across a snowy field. The camera tracks alongside him from the side.
3. Vocabulary of Movement
Verbs that express “movement” have a significant impact on accuracy.
| Verb | Nuance |
|---|---|
| walks / runs | walks / runs |
| drifts / floats | drifts / floats |
| flickers | flickers |
| sways | sways |
| dissolves | dissolves |
| rotates | rotates |
| morphs | morphs |
“Move” alone is too vague and can lead to inconsistent results. Choose a specific verb.
4. Camera Terminology (Important)
Runway understands camera terminology. This is where it stands out compared to other video AI tools.
| Term | Movement |
|---|---|
| dolly in / out | The camera physically moves forward or backward |
| zoom in / out | The lens moves closer or farther away (the camera position remains fixed) |
| pan left / right | The camera swivels left or right |
| tilt up / down | The camera tilts up or down |
| tracking shot | Moving alongside the subject |
| orbit | Circling around the subject |
| handheld | Shaky, handheld feel |
| static / locked | Completely stationary |
| crane shot | Moving up and down on a crane |
| POV | Point of view |
Example:
Static shot. A door slowly opens to reveal a dark room.
Slow dolly shot in toward a glowing object on the table.
A handheld camera follows a person running through a crowded street.
5. Time-related instructions
For clips lasting 5 to 10 seconds, describing the “beginning, middle, and end” separately improves accuracy.
At first, the room is empty. A man enters from the right. He walks to the center, then turns to face the camera.
Specifying the chronological order makes it easier for the AI to understand the overall structure of the shot.
6. Vocabulary Related to Atmosphere and Style
This is where the mood of the video is set.
- Lighting: cinematic lighting, golden hour, harsh midday sun, neon, candlelight, moonlight
- Textures: film grain, 35mm, anamorphic lens, shallow depth of field
- Color Palette: muted colors, vibrant, monochrome, sepia, cool blue tones
- Weather/Environment: foggy, snowing, rainy, dusty atmosphere
- Era: 1980s style, futuristic cyberpunk, medieval
Example:
A neon-lit alley at night, with rain falling and reflections on the wet pavement, captured through a cinematic anamorphic lens with a shallow depth of field.
7. Writing in a “negative prompt” style
Runway does not have a dedicated field for negative prompts (depending on the model). Instead, you express negation using positive instructions:
- ❌ “no people” → ✓ “deserted street, empty”
- ❌ “no blur” → ✓ “sharp focus throughout”
- ❌ “not cartoon” → ✓ “photorealistic, live action”
AI has a hard time expressing “not.” Instead, it expresses things as if they “are.”
8. The Trade-off Between Length and Accuracy
- Short prompt (1 sentence): The general direction is correct, but control over the details is limited
- Medium (2–3 sentences): Good balance. Recommended
- Too long (5 or more sentences): The AI gets confused and ignores parts of the instructions
Start by writing a short prompt, see how it performs, and then add only what’s missing. Watch out for prompt bloat syndrome.
9. Iterative Improvement of Prompts
It’s rare for a prompt to be perfected on the first try. Follow these steps:
- Generate using a simple prompt (5 seconds, Turbo)
- Review the results and identify what’s missing
- Add instructions for that part and regenerate
- Iterate 2–3 times to get the general gist
First draft: “A cat walks through a garden.” ↓ Notes: The movement is too fast Revised: “A cat walks slowly through a garden.” ↓ Notes: The garden lacks atmosphere Final: “A cat walks slowly through a sunlit garden full of flowers, bathed in the golden light of late afternoon, with a cinematic shallow depth of field.”
10. Things Video AI Struggles With
Things not covered by the prompt:
- Complex hand movements — The model breaks down when the five fingers move independently
- Text — Text on signs and in books generally becomes illegible
- Coordinated movements involving multiple people — Scenes involving physical contact, such as two people shaking hands
- Consistency over long periods — The face changes after 10 seconds or more
The practical solution is to avoid these issues through composition (by not showing your hands, not showing text, not shaking hands, or cutting the shot short).
11. Saving Prompts
I save prompts that work well in my personal notes. I tweak them a little each time I reuse them to improve them.
Having 5 to 10 go-to prompts that reflect your personal style—such as “cinematic night streets,” “children running,” or “forest at dusk”—will help you work faster.
12. What’s Next
- Camera Control — Directly control the camera in Director Mode
- References — Use image references to supplement “what words cannot express”
