
Multimodal Llm
A comprehensive reference for vision, audio, and video generation across multiple providers. Covers image analysis with Claude Opus 4-8 and GPT-5.5, document processing with Gemini 3.1, speech-to-text with 9.5 hour audio support, and AI video generation with Kling v3, Sora 2, Veo 3.1, and Runway Gen-4.5. The multi-shot video patterns are especially useful if you need character consistency across scenes. Includes canonical model IDs, provider comparisons, and async polling patterns. The common mistakes section will save you from the usual traps like forgetting max_tokens on vision requests or trying to use video APIs synchronously. Nine rules total, but the quick reference table makes navigation straightforward.
- skills.sh installs
- 242
- GitHub stars
- 301
- last updated
- Aug 21, 2026
Install
$ npx -y skills add yonatangross/orchestkit --skill multimodal-llm --agent claude-codeInstalls into .claude/skills of the current project.
Files
Multimodal LLM Patterns
Integrate vision, audio, and video generation capabilities from leading multimodal models. Covers image analysis, document understanding, real-time voice agents, speech-to-text, text-to-speech, and AI video generation (Kling v3, Sora 2, Veo 3.1 std/lite/fast tiers, Runway Gen-4.5 via gen4_turbo).
Sponsors
Details
- Repository
- github.com/yonatangross/orchestkit
- Category
- AI & Agent Building
- First seen
- Jun 3, 2026
More from yonatangross/orchestkit
All 61- Database Patterns238
- Architecture Patterns236
- Performance232
- Github Operations228
- Remember228
- Doctor227
- React Server Components Framework227
- Web Research Workflow227
- Explore224
- Errors223
- Issue Progress Tracking221
- Release Management220
- Fix Issue217
- Review Pr217
- Llm Integration216
- I18n Date Patterns215
- Task Dependency Patterns214
- Api Design211
- Assess211
- Analytics210
- Commit210
- Skill Evolution210
- Verify210
- Create Pr209