A comprehensive reference for vision, audio, and video generation across multiple providers. Covers image analysis with Claude Opus 4-8 and GPT-5.5, document processing with Gemini 3.1, speech-to-text with 9.5 hour audio support, and AI video generation with Kling v3, Sora 2, Veo 3.1, and Runway Gen-4.5. The multi-shot video patterns are especially useful if you need character consistency across scenes. Includes canonical model IDs, provider comparisons, and async polling patterns. The common mistakes section will save you from the usual traps like forgetting max_tokens on vision requests or trying to use video APIs synchronously. Nine rules total, but the quick reference table makes navigation straightforward.

skills.sh installs
242
GitHub stars
301
last updated
Aug 21, 2026

Install

$ npx -y skills add yonatangross/orchestkit --skill multimodal-llm --agent claude-code

Installs into .claude/skills of the current project.

Files

Multimodal LLM Patterns

Integrate vision, audio, and video generation capabilities from leading multimodal models. Covers image analysis, document understanding, real-time voice agents, speech-to-text, text-to-speech, and AI video generation (Kling v3, Sora 2, Veo 3.1 std/lite/fast tiers, Runway Gen-4.5 via gen4_turbo).

Sponsors

Details

Repository
github.com/yonatangross/orchestkit
Category
AI & Agent Building
First seen
Jun 3, 2026

More from yonatangross/orchestkit

All 61
1borghei avatarself-improving-agentborghei/claude-skillsPatterns for AI agents that learn from their own execution, detect failure modes, and improve autonomously. Use when building agents that get better over time, 241skills.sh installs
2guia-matthieu avatarai-video-conceptguia-matthieu/clawfu-skillsDéveloppez une idée créative et structurez un script vidéo optimisé pour la génération IA, en suivant la méthode des scènes de 8 secondes de PJ Ace. Use when: *241skills.sh installs
3nansen-ai avatarnansen-agent-guidenansen-ai/nansen-cliRouting guide -- when to use `nansen agent` (AI research) vs direct CLI data commands. Use when deciding how to answer a user's research question with Nansen to240skills.sh installs
4zinohome avatarui-prompt-generatorzinohome/cozyengineui prompt generator238skills.sh installs
5veithly avatarproactive-agentveithly/proactive-agentSelf-improving agent that can upgrade skills, learn new capabilities, and adapt to new tasks. Use when you need to evolve capabilities or handle unknown tasks.235skills.sh installs
6cdeistopened avataranti-ai-writingcdeistopened/skill-stackTransform AI-assisted drafts into authentic, human-sounding content. This skill provides patterns to detect and eliminate AI tells, frameworks for natural writi225skills.sh installs