HeyGen AI — Video, avatars and translation, sound included

Generate 5 to 15 second clips with dialogue and sound from a prompt with HeyGen Video 1.0, turn a photo and audio file into a talking avatar, or translate finished videos into new languages. No production crew, no studio, no reshoots.

HeyGen AI

What is HeyGen AI?

HeyGen AI is a video generation platform. On Artlist, three HeyGen models are available inside the AI tools: HeyGen Video 1.0 generates 5 to 15 second clips with dialogue and sound from a prompt or start frame, Avatar IV turns a photo and audio file into a talking avatar, and Video Translate localizes finished videos into new languages.

What is HeyGen AI

How HeyGen AI changes traditional video production

Every shoot costs time, money, and coordination. Creators using AI video and avatars report 80% less production time, 90% lower costs, and 10x the output. Here's how HeyGen AI makes that possible.

  • Lip sync that actually looks right

    Mouth and facial movements match the audio, whether Video 1.0 is speaking a quoted line from your brief, Avatar IV is performing your recording, or Video Translate is dubbing an existing video into a new language. The result reads as native. How close it gets depends on source quality and language pair.

  • Audio as the creative input

    For Avatar IV and Video Translate, audio is the main input: the voice drives expression, gesture, and delivery, and what goes into the recording is what comes out on screen. With Video 1.0 the brief is the input, and the dialogue, ambience and effects are generated from it.

  • The voice stays yours

    With Avatar IV and Video Translate, HeyGen AI doesn't replace your voice; it preserves it. Vocal tone matches expression on one side, and carries across every language on the other. With Video 1.0, the voice is generated from the quoted lines in your prompt, delivered with lip sync.

  • Same presence, every video

    Consistency is usually the first thing that breaks at scale. HeyGen's technology keeps the same face, delivery, and on-screen presence across every piece of content. A reusable avatar is consistent by design, and with Video 1.0 a start frame carries look, wardrobe and lighting into each new clip.

  • One asset, any language

    Multilingual output is built in from the start. This is really where you save yourself time. One strong source video can cover dozens of markets without touching the production again.

  • Full clips from a written brief

    HeyGen Video 1.0 generates a 5 to 15 second shot with dialogue, ambience and effects in one pass. Quoted lines are spoken with lip sync, so a presenter or product clip arrives ready to post, no separate voice or sound step.

What creators are actually making with HeyGen AI

From prompt-generated clips and presenter-led social content to localized campaign videos, here's where HeyGen AI's models fit into a real production workflow.

  • Presenter and product clips with sound

    With HeyGen Video 1.0, write a brief or upload a start frame and get a 5 to 15 second clip with spoken lines, ambience and effects already in it. Best for single, contained shots with a locked or slow camera: presenters, products and short social clips.

    Close-up of a man mid-sentence speaking to camera in a dim apartment at dusk
  • Personal avatars and digital clones

    Create a reusable digital version of yourself from an image and audio file. First generation takes minutes, then the same face is available for every project.

    HeyGen AI - Personal avatars and digital clones use cases
  • Marketing and social media assets

    Short-form, presenter-led content for TikTok, Instagram, and YouTube. Generate a product or presenter clip from a brief with Video 1.0, or run the same ad through Avatar IV with different CTAs. Ten variations cost the same effort as one.

    HeyGen AI - Marketing and social media assets
  • Education and training resources

    Generate avatar-led training videos and onboarding walkthroughs that stay consistent across teams. For longer content, segment your audio into focused sections.

    HeyGen AI for education and training resources
  • Localization and global scaling

    Finished videos can be translated into 76 languages (and 99 dialects) without rebuilding the production, with voice cloning to preserve the original speaker.

    HeyGen AI for localization and global scaling
  • Singing and music content

    Upload a song as your audio input, and the avatar sings it back with lip-sync precision. While one of the less obvious use cases, it’s an impressive example of what the model can actually do.

    HeyGen AI for singing and music content
Street musician singing and playing acoustic guitar on a wet cobbled harbour quay under an overcast sky

HeyGen Video 1.0: Short Clips With Dialogue Built In

HeyGen Video 1.0 is HeyGen's first general-purpose video model. Write a brief or upload a start frame and get a 5 to 15 second clip at up to 2K, with spoken lines lip-synced, ambience and effects generated in the same pass. In October 2026 it ranked first on Artificial Analysis' blind text-to-video leaderboard.

HeyGen model comparison

Feature
HeyGen Video 1.0
HeyGen Avatar IV
HeyGen Video Translate
Primary strength
Short clips with dialogue and sound from a prompt
Expressive talking avatar from an image and audio file
Localizing a finished video into new languages
Inputs
Text prompt, optional start frame (up to 16 MB)
One image + one audio file
Video file + target language
Output length
5 to 15 seconds
Up to 3 minutes
Matches the source, or dynamic
Max resolution
2K (480p, 768p, 1080p, 2K)
1080p
Matches the source video
Aspect ratios
16:9, 9:16 (start frame sets the shape)
16:9 only
Matches the source video
Audio
Generated: dialogue, ambience, effects
Driven by your audio file
Translated voice, cloned from the speaker
Lip sync
Multi-speaker
Not confirmed
Languages
Follows the prompt
Follows the audio
76 languages, 99 dialects
Best for
Presenters, products and short social clips
Presenter-led avatar videos at scale
Adapting existing videos for new markets

How to create your first HeyGen AI video on Artlist

HeyGen AI lives inside the Artlist AI tools. Here's how you get the most out of all three models.

  1. Navigate to the AI tools. Choose HeyGen Video 1.0 to generate a clip from a prompt, Avatar IV to create from a photo and audio file, or Video Translate to dub existing footage.

    How to use HeyGen AI models in Artlist - step 1
  2. For Video 1.0: a text prompt, with an optional start frame image up to 16 MB. For Avatar IV: one image (JPG, PNG, WebP, GIF, AVIF) and one audio file (MP3, WAV, M4A, OGG, AAC). For Video Translate: your video file, plus your target language.

    How to use HeyGen AI models in Artlist - step 2
  3. For Video 1.0, set duration (5 to 15 seconds), resolution from 480p to 2K, 16:9 or 9:16, and Prompt Enhancement (Off, Turbo or Quality). For Avatar IV, set output resolution up to 1080p. For Video Translate, choose lip-sync on or off and toggle dynamic duration.

    How to use HeyGen AI models in Artlist - step 3
  4. Run the generation and preview inside the AI tools before exporting. Avatar IV automatically saves generated avatars. Same face, next project, no re-upload.

    How to use HeyGen AI models in Artlist - step 4

Expert tips to get the most out of HeyGen AI

Most issues with HeyGen's models come from the same place: treating them as automatic when they're actually responsive. Here's where people usually go wrong.

  • Put the camera and sound in your Video 1.0 brief

    Name the camera, lens and support, and say when the camera stays still; "cinematic" on its own does little. Budget about 2.5 spoken words per second and quote the line. End with an "Audio:" line placing sounds close, mid and far, and write "No music" to rule it out. Turn Prompt Enhancement off once the brief is complete.

  • Treat the audio as the brief

    Avatar IV extracts expression from your recording. It doesn’t invent it. Before generating, listen back and ask whether it sounds like a performance or a first read. Vary pace, use natural pauses, let inflection carry the emotion. You can rerun with better audio, but you can’t fix a flat avatar in post.

  • Segment long audio, don’t run it as one block

    For anything over 30 seconds, break the audio into logical sections before generating. Avatar IV maintains expression alignment better across shorter segments than across a continuous input.

  • Plan your framing before you upload

    Avatar IV outputs in 16:9 horizontal only. If your source image is portrait or square, white bars get added, and that's not fixable after generation. Crop or reframe to 16:9 before uploading. 

  • Lock duration for ads, go dynamic for the rest

    Dynamic duration is the better default. It produces more natural pacing. Lock to original length only when timing is non-negotiable, like ads or synced presentations.

  • Portraits, half-bodies, and full-bodies all work

    Unlike most avatar tools, Avatar IV handles portrait, half-body, and full-body image formats, and works from angled or profile shots, not just front-facing headshots. Sharper, better-lit images still produce more detailed outputs.

Is HeyGen AI right for your workflow?

HeyGen AI is built for anyone producing video at scale without a camera, a crew, or a full production budget. 

  • HeyGen AI for marketing and performance teams

    Marketing and performance teams

    Produce UGC-style ads, product promos, and multiple campaign variations without reshooting. Change the hook, swap the CTA, test across channels, all from the same source assets.

  • HeyGen AI for education and L&D teams

    Education and L&D teams

    With HeyGen AI, you can create training modules and internal explainers that stay consistent across teams and locations. When content needs updating, regenerate the relevant segment.

  • HeyGen AI for sales and outreach teams

    Sales and outreach teams

    Use avatar-led video for client updates, product walkthroughs, or outreach campaigns. It keeps a human presenter format without requiring a shoot every time the message changes.

  • HeyGen AI for content creators

    Content creators

    Stay off camera without losing your on-screen presence. Build a reusable digital presenter with Avatar IV, generate short clips with dialogue from a brief with Video 1.0, and keep a consistent face across every video.

Frequently asked questions

HeyGen AI is strongest at three things: generating short clips with dialogue and sound from a prompt or start frame with HeyGen Video 1.0, creating expressive talking-avatar videos from a single image and audio file with Avatar IV, and translating existing videos into 76 languages without losing the original speaker's voice with Video Translate. All three are built for human video at scale: one generates a shot from a brief, one performs your audio, and one adapts what already exists.

HeyGen Video 1.0 takes a start frame as its only image input, with no end frame, reference images or video. Text to Video offers 16:9 and 9:16 only; other shapes need a start frame in that shape. Hands operating objects, loose hair and fabric are the least reliable parts of a shot, faces can drift toward retouched skin, and plain surfaces can pick up invented logos unless the prompt rules them out. Unspecified sound is the model's choice and may add music.

Avatar IV has a few hard constraints worth knowing before you start:

Output is 16:9 horizontal only: portrait or square images will have white bars added, and that's not adjustable after generation. It's single-speaker only, so multi-character scenes aren’t possible in one generation.Maximum duration is three minutes per run, and resolution caps at 1080p. On the behavioral side: flat, monotone recordings produce flat avatars. The model reads what’s in the audio, but doesn't compensate for a low-energy performance.

For HeyGen Translate, the main limitation is cost. It’s the more expensive of the three models. Output resolution and ratio match the input video, so quality is only as good as your source file.

HeyGen Video 1.0 is HeyGen's first general-purpose video model, built on MiniMax H3 and post-trained by HeyGen. It generates 5 to 15 second clips from a text prompt or a start frame, in 16:9 or 9:16 at 480p, 768p, 1080p or 2K, with audio always on: quoted lines are spoken with lip sync, plus ambience, effects and optional music. In October 2026 it ranked first on Artificial Analysis' blind text-to-video leaderboard, just ahead of Wan 3.0 and MiniMax H3. It is at its best on single, contained shots with a locked or slow camera, such as presenters, products and short social clips.

Avatar IV requires an image and an audio file. The image becomes the visual base of the avatar. The audio drives speech, expression, and delivery. It’s the only creative lever you have over how the avatar performs. Supported image formats are JPG, PNG, WebP, GIF, and AVIF. Supported audio formats are MP3, WAV, M4A, OGG, and AAC.

Yes. Only use images you have the rights to. Using someone’s likeness without consent can violate privacy and intellectual property laws, and goes against Artlist’s Terms of Use. When in doubt, use your own image or a purpose-built character. If you’re using a real person’s photo, make sure you have explicit permission before generating.

Realism comes mostly from the inputs, not the settings. To create your AI Avatar, start with a clear, well-lit photo where the face isn’t heavily obscured or angled. For audio, keep pacing natural and expressive — tone directly shapes facial movement.

Record in short, natural segments rather than one long continuous take. Matching gesture intensity to the content also helps avoid a staged look.

Generate your clip inside the Artlist AI tools: write a brief for HeyGen Video 1.0, or upload your image and audio file to Avatar IV, configure your settings, and export once you're happy with the output.

From there, bring it into your wider Artlist project and build around it with AI music, stock footage, and motion elements.

Edit everything into a finished piece, such as an ad, explainer, or social video, with the generated clip or avatar as the presenter.

HeyGen Translate supports 76 languages in total: 

  • 38 European, including French, German, Italian, Spanish, and Portuguese
  • 30 Asian, spanning Hindi, Japanese, Korean, Chinese/Mandarin, and Indonesian
  • 5 African (Afrikaans, Amharic, Somali, Swahili, and Zulu)
  • 3 Middle Eastern (Arabic, Hebrew, and Persian)

Yes. HeyGen Translate also supports 99 regional dialects, so accent coverage goes well beyond basic translation. English alone has 16 accents, Spanish covers 22 regional variants across Latin America and Spain, Arabic has 16 dialects, and Chinese/Mandarin offers 9. French, German, Dutch, Portuguese, Tamil, Urdu, and Swahili also include multiple regional options.

Yes. HeyGen Video Translate includes automatic lip syncing. The model updates the speaker’s lip and facial movements to match the translated audio, so the output looks and sounds like it was recorded in the target language.

Still have questions? We're here to help.