rsmdt avatar

Multimodal

rsmdt/multimodal-mcp

Connects Claude to OpenAI, xAI, Gemini, ElevenLabs, and BFL APIs for generating and editing images, videos, audio, and transcriptions through a single interface. Exposes tools like generate_image, generate_video, generate_audio, and transcribe_audio with automatic provider selection based on which API keys you've configured. You can explicitly choose a provider per request or let it auto-select from what's available. All generated media saves to disk with descriptive filenames. Reach for this when you want Claude to generate visual or audio content without writing provider-specific code for each API, or when you're working across multiple media generation services and want consistent tool parameters.

GitHub stars
1
tools
5
auth
Secret needed
transport
STDIO
env vars
6
last updated
Mar 3, 2026

Tools

5 tools

Public tool metadata for what this MCP can expose to an agent.

generate_imageGenerate an image from a text prompt.

Generate an image from a text prompt.

No parameter schema in public metadata yet.

generate_videoGenerate a video from a text prompt. Video generation is asynchronous and may take several minutes.

Generate a video from a text prompt. Video generation is asynchronous and may take several minutes.

No parameter schema in public metadata yet.

generate_audioGenerate audio from text. Supports text-to-speech and sound effects. Audio generation is synchronous.

Generate audio from text. Supports text-to-speech and sound effects. Audio generation is synchronous.

No parameter schema in public metadata yet.

transcribe_audioTranscribe audio to text (speech-to-text).

Transcribe audio to text (speech-to-text).

No parameter schema in public metadata yet.

list_providersList all configured media generation providers and their capabilities. Takes no parameters.

List all configured media generation providers and their capabilities. Takes no parameters.

No parameter schema in public metadata yet.

Sponsors

Configuration

OPENAI_API_KEYsecret

OpenAI API key for image, video, audio generation and transcription

XAI_API_KEYsecret

xAI API key for image and video generation

GEMINI_API_KEYsecret

Google Gemini API key for image, video, and audio generation

ELEVENLABS_API_KEYsecret

ElevenLabs API key for audio generation and transcription

BFL_API_KEYsecret

BFL API key for FLUX image generation and editing

MEDIA_OUTPUT_DIR

Directory for saved media files (defaults to cwd)

Readme

multimodal-mcp

Multi-provider media generation MCP server. Generate images, videos, audio, and transcriptions from text prompts using OpenAI, xAI, Gemini, ElevenLabs, and BFL (FLUX) through a single unified interface.

Features

  • 🎨 Image Generation β€” Generate images via OpenAI (gpt-image-1), xAI (grok-imagine-image), Gemini (imagen-4), or BFL (FLUX Pro 1.1)
  • ✏️ Image Editing β€” Edit images via OpenAI, xAI, Gemini, or BFL (FLUX Kontext)
  • 🎬 Video Generation β€” Generate videos via OpenAI (sora-2), xAI (grok-imagine-video), or Gemini (veo-3.1)
  • πŸ”Š Audio Generation β€” Text-to-speech via OpenAI (tts-1), Gemini, or ElevenLabs (Flash v2.5). Sound effects via ElevenLabs
  • πŸŽ™οΈ Audio Transcription β€” Speech-to-text via OpenAI (Whisper) or ElevenLabs (Scribe)
  • πŸ”„ Auto-Discovery β€” Automatically detects configured providers from environment variables
  • 🎯 Provider Selection β€” Auto-selects or explicitly choose a provider per request
  • πŸ“ File Output β€” Saves all generated media to disk with descriptive filenames

Quick Start

Set the API key for at least one provider. Most users only need one β€” add more to access additional providers.


View the full README on GitHub

Details

Repository
github.com/rsmdt/multimodal-mcp
Category
Media & Entertainment
Package
@r16t/multimodal-mcp
Transport
STDIO
Auth
Required
Registry
MCP registry, active

Related Media & Entertainment MCP servers

View all
1joaoestella avatarmediasensejoaoestella/mediasenseLet Claude listen to audio and watch video: transcribe, summarize and edit recordings and links.1stars
2malkreide avatarSrgssr Mcpmalkreide/srgssr-mcpSRG SSR weather, video, audio, EPG, Polis1stars
3rendobar avatarRendobarrendobar/mcpTransform video, audio and images, and generate media from prompts. FFmpeg, captions, models.0stars
4socialneuron avatarMcp Serversocialneuron/mcp-server52 MCP tools for AI social media: create, distribute, analyze, and optimize content.0stars
50xkaroshi avatarContendeo0xkaroshi/contendeo-mcpMultimodal video analysis MCP β€” transcription, vision, and OCR for any video URL.0stars
6avotsai avataravotsavotsai/avots-mcpImage, video, audio, face-swap, talking avatars and chat across 300+ AI models, one balance.0stars