bytedance avatar

Video Generation

Turns text prompts into video clips using a structured JSON workflow that lets you specify everything from camera angles and character dialogue to audio cues and era-specific settings. You can optionally feed it a reference image to guide the visual style or anchor the first frame. The workflow is pretty hands-on: you write a detailed JSON prompt, optionally generate a reference image using the image-generation skill, then call a Python script with your parameters. Best suited for narrative scenes where you want tight control over composition and storytelling elements rather than quick throwaway clips. The JSON structure feels verbose but pays off when you need reproducible results or want to iterate on specific aspects like camera movement or audio layering.

skills.sh installs
3K
GitHub stars
85.2K
last updated
Aug 21, 2026

Install

$ npx -y skills add bytedance/deer-flow --skill video-generation --agent claude-code

Installs into .claude/skills of the current project.

Files

Video Generation Skill

Overview

This skill generates high-quality videos using structured prompts and a Python script. The workflow includes creating JSON-formatted prompts and executing video generation with optional reference image.

Core Capabilities

  • Create structured JSON prompts for AIGC video generation
  • Support reference image as guidance or the first/last frame of the video
  • Generate videos through automated Python script execution

Workflow

Step 1: Understand Requirements

When a user requests video generation, identify:

  • Subject/content: What should be in the image
  • Style preferences: Art style, mood, color palette
  • Technical specs: Aspect ratio, composition, lighting
  • Reference image: Any image to guide generation
  • You don't need to check the folder under /mnt/user-data

Step 2: Create Structured Prompt

Generate a structured JSON file in /mnt/user-data/workspace/ with naming pattern: {descriptive-name}.json

Step 3: Create Reference Image (Optional when image-generation skill is available)

Generate reference image for the video generation.

  • If only 1 image is provided, use it as the guided frame of the video

Sponsors

Details

Repository
github.com/bytedance/deer-flow
Category
Generative Media
First seen
Apr 16, 2026

More from bytedance/deer-flow

All 21
1nexu-io avatarfal-upscalenexu-io/open-designUpscale and enhance image and video resolution using AI super-resolution models hosted on fal.ai.2.9Kskills.sh installs
2inferen-sh avatarelevenlabs-dubbinginferen-sh/skills2.7Kskills.sh installs
3inferen-sh avatarelevenlabs-voice-isolatorinferen-sh/skills2.7Kskills.sh installs
4steipete avatarsherpa-onnx-ttssteipete/clawdissherpa onnx tts2.7Kskills.sh installs
5theplasmak avatarfaster-whispertheplasmak/faster-whisperfaster whisper1.9Kskills.sh installs
6digitalsamba avatarelevenlabsdigitalsamba/claude-code-video-toolkitGenerate AI voiceovers, sound effects, and music using ElevenLabs APIs. Use when creating audio content for videos, podcasts, or games. Triggers include generat1.4Kskills.sh installs