How to Write Prompts for AI Video Effects

AI Editor in Effect House enables you to create dynamic video effects using the image-to-video (I2V) model. By writing clear and detailed prompts, you can add motion and actions to your images. This guide walks you through how to optimize your prompts with descriptive actions and specific keywords in order to control the output of your video.

Video Model Overview

A video model generates dynamic video effects based on your prompts, allowing you to bring motion and actions to life in your creations. In Effect House, there are currently two video base models available:

Image Alive

Brings still images to life with fluid animation and natural movements

Sway Dance

Food Lotto

3D Cartoon

Keyframe Morph

Generates a transition AI video using two images

Mermaid

Wedding

Slacking Toon

How to Write Your Video Model Prompt

To get the most out of the video model, it helps to know a few key tips and understand how they work. These suggestions will guide you toward writing stronger prompts and generating better results.

note

Before writing a prompt, keep in mind that the current model can only handle one action at a time. For example, a prompt like “The character shouts and dances at the same time” may not produce good results. Instead, split it into two separate prompts:

• “The character shouts.”
• “The character dances.”

Write Prompts That Focus on Motion

Since the video model follows prompts closely, you'll get the best results when you describe actions and movement instead of only static details. Try to frame your prompt around what's happening in the scene, not just what's visible.

Prompt without motion

"A man holding a treat."

This is the generated image:

Prompt with motion

"A woman and a man kiss each other."

This is the generated image:

Use Complete Sentences

It is recommended to write complete sentences rather than just a few words. If your prompt is fewer than seven words, the system automatically expands it with the rephraser to make it more descriptive.

Original prompt

"Stretch with open hands."

This is the generated image:

Complete sentence

"In this video, a girl with blonde hair and striking blue eyes is depicted stretching gracefully with her arms outstretched."

This is the generated image:

Try Both Original and Rephrased Results

Both the original and rephrased versions of a prompt can be useful.

Before

"An adorable animal is scratching its head and blinking its eyes."

This is the generated artwork without a rephraser:

After

"In this animated video, we see a cute and adorable tiger cub sitting on a grassy field. The cub has big, expressive eyes and is seen scratching its head and blinking its eyes playfully. The background features a sunny day with leaves falling from trees, creating a warm and inviting atmosphere. The tiger cub's fur is soft and fluffy, adding to its endearing appearance. As the video progresses, the cub continues to interact with its surroundings, showcasing its playful nature and charm"

This is the generated artwork with a rephraser:

Use Specific Words to Mimic Camera Movements

You can also guide the camera movements within the scene by using keywords like:

• Zoom In
• Zoom Out
• Camera Spin Shot

Zoom In

Zoom Out

Camera Spin Shot

Prompts

• "In the dimly lit garage, a sleek, silver classic car rests quietly, showcasing its polished curves and retro-styled headlight. Then the camera zooms in."
• "In the dimly lit garage, a sleek, silver classic car rests quietly, showcasing its polished curves and retro-styled headlight. Then the camera zooms out."
• "In the dimly lit garage, a sleek, silver classic car rests quietly, showcasing its polished curves and retro-styled headlight. Camera spin shot."

note

“Spin shot” may sometimes be confused with the subject itself spinning. To avoid ambiguity, make sure you clarify the action in your prompt.

Prompt

"Shot of a woman standing in the middle of the desert, with the lens rotating and zooming to showcase her style."

Accurate

Ambiguous

Prompt Examples

Multi-Character Interaction

Use this type of prompt when you want multiple characters to interact with each other.

Prompts

• "This girl's boyfriend walks into the frame from the side."
• "The boyfriend approaches the girl."
• "The girl and her boyfriend hug each other."
• "Their embrace is affectionate and natural."
• "The animation is smooth."

      

Human-Object Interaction

These prompts describe how a character interacts with objects.

Prompt

• "The character picks up the pizza and starts eating it like crazy, filling their entire mouth."
• "The character picks up a big koala and holds it in their arms."

      

Solo Animation

Use this when you want a single subject to move in a lively or expressive way.

Prompt

• "The subject starts a funny dance, spinning around, moving side to side, and swinging their hips. They shake their hands and toss their hair as they dance."
• "At the peak of excitement, the subject jumps up, cheering loudly in celebration."

      

Avatar Customization

These prompts let you transform a character's look or appearance.

Prompt

• "The character quickly puts on the tuxedo, takes out the violin and starts playing."
• "The character spins around, and their hair turns into a colorful clown wig. They have a big red clown nose on their white clown face with exaggerated black and red makeup. Big fireworks fill the sky."

      

---

Guidelines

When writing prompts, please make sure your content adheres to the following guidelines:

1. Avoid including religious extremism, attacks on religious beliefs, or incitement of hatred or discrimination.
2. Avoid generating violent threats, abuse, terrorism, or incitement to harm individuals or groups.
3. Avoid generating obscene or pornographic material, sexual content involving minors, sexual violence, or adult sexual services.
4. Avoid generating illegal or dangerous content such as criminal activity guides, drug production, weapon manufacturing, hacking, or fraud.
5. Avoid generating instructions for illegal activities or fraudulent methods.
6. Avoid generating content that incites subversion, spreads false political information, or endangers social stability.
7. Avoid generating false medical advice that could lead to health risks.
8. Avoid inappropriate or illegal content involving minors.

Frequently Asked Questions

I still need more guidance on writing prompts. Where can I get more tips?

Feel free to use external AI tools to expand your text into more complete prompts.

What should I do if I want to create different looks?

We recommend uploading an image for the final frame or using the Image Model within the AI Editor to generate them.

When do we expect more video models?

We'll be launching a new video model soon for everyone to use, so stay tuned!