Ai Multimodal
This is a unified interface for Google Gemini's multimodal capabilities: transcribe audio up to 9.5 hours, analyze images with object detection and segmentation, process videos including YouTube URLs, extract tables and charts from PDFs, and generate images from text. Supports both Google AI Studio and Vertex AI with context windows up to 2M tokens. The real value is having one consistent API for everything instead of juggling separate services. Pick gemini-2.5-flash for most work, though you'll need specific models for segmentation or image generation. Includes utilities for optimizing large files before upload and converting documents to markdown. Built for developers who need multimodal AI without managing a dozen different integrations.
- skills.sh installs
- 539
- GitHub stars
- 2.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add mrgoonie/claudekit-skills --skill ai-multimodal --agent claude-codeInstalls into .claude/skills of the current project.
Files
AI Multimodal Processing Skill
Process audio, images, videos, documents, and generate images using Google Gemini's multimodal API. Unified interface for all multimedia content understanding and generation.
Core Capabilities
Audio Processing
- Transcription with timestamps (up to 9.5 hours)
- Audio summarization and analysis
- Speech understanding and speaker identification
- Music and environmental sound analysis
- Text-to-speech generation with controllable voice
Image Understanding
- Image captioning and description
- Object detection with bounding boxes (2.0+)
- Pixel-level segmentation (2.5+)
- Visual question answering
- Multi-image comparison (up to 3,600 images)
- OCR and text extraction
Video Analysis
- Scene detection and summarization
- Video Q&A with temporal understanding
- Transcription with visual descriptions
- YouTube URL support
- Long video processing (up to 6 hours)
- Frame-level analysis
Document Extraction
- Native PDF vision processing (up to 1,000 pages)
- Table and form extraction
- Chart and diagram analysis
- Multi-page document understanding
- Structured data output (JSON schema)
- Format conversion (PDF to HTML/JSON)
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/mrgoonie/claudekit-skills
- Categories
- Backend & APIs, AI & Agent Building, Design & UI/UX, Office & Documents, Generative Media
- First seen
- Jun 3, 2026
More from mrgoonie/claudekit-skills
All 28- Code Review520
- Context Engineering502
- Shopify454
- Web Testing448
- Databases441
- Frontend Design424
- Docs Seeker408
- Repomix406
- Better Auth396
- Frontend Dev Guidelines377
- Web Frameworks377
- Mcp Management373
- Mermaidjs V11370
- Skill Creator360
- Payment Integration356
- Mcp Builder315
- Template Skill294
- Backend Development2.3K
- Sequential Thinking1.8K
- Threejs1.3K
- Devops995
- Chrome Devtools745
- Aesthetic722
- Ui Styling645
Recommended
More Backend & APIs
longbridge-depthlongbridge/skillsOrderbook depth (5/10-level bid/ask), broker queue (HK only), and tick-by-tick trades for stocks via Longbridge Securities. Use for orderbook microstructure que537skills.sh installs
setup-timescaledb-hypertablestimescale/pg-aiguideUse this skill when creating database schemas or tables for Timescale, TimescaleDB, TigerData, or Tiger Cloud, especially for time-series, IoT, metrics, events,537skills.sh installs
groove-work-execandreadellacorte/grooveExecute the implementation plan, track progress in the task backend. Use after planning.536skills.sh installs
spring-boot-developmentmanutej/luxor-claude-marketplaceComprehensive Spring Boot development skill covering auto-configuration, dependency injection, REST APIs, Spring Data, security, and enterprise Java application536skills.sh installsgroove-utilities-task-configandreadellacorte/grooveConfigure task backend settings interactively.533skills.sh installsgroove-utilities-task-archiveandreadellacorte/grooveArchive a completed task in the configured backend.532skills.sh installs