
Codabench Mcp
Wraps the Codabench REST API so Claude can participate in ML competitions end to end. You get tools to search competitions, read rules and task specs, download datasets with streaming and SHA-256 verification, submit solutions through Codabench's three-step upload flow, poll submission status with backoff, and check leaderboards. Authentication uses a Codabench API token you grab from their Swagger UI or via curl. The generic codabench_request tool is locked to GET by default but you can flip CODABENCH_ALLOW_WRITE_RAW if you need it. Useful when you want Claude to explore benchmarks, prototype submissions, or iterate on a competition without leaving the chat.
- tools
- 16
- auth
- Secret needed
- transport
- STDIO
- env var
- 1
- last updated
- Apr 23, 2026
Tools
16 toolsPublic tool metadata for what this MCP can expose to an agent.
search_competitions
No parameter schema in public metadata yet.
get_competition
No parameter schema in public metadata yet.
list_competition_phases
No parameter schema in public metadata yet.
get_phase
No parameter schema in public metadata yet.
get_competition_rules
No parameter schema in public metadata yet.
list_competition_tasks
No parameter schema in public metadata yet.
get_task
No parameter schema in public metadata yet.
download_datasetDownloads a dataset with streaming and SHA-256 verification.
Downloads a dataset with streaming and SHA-256 verification.
No parameter schema in public metadata yet.
list_my_submissions
No parameter schema in public metadata yet.
get_submission
No parameter schema in public metadata yet.
get_submission_logs
No parameter schema in public metadata yet.
submit_to_phaseSubmits to a phase, handling Codabench's 3-step upload flow.
Submits to a phase, handling Codabench's 3-step upload flow.
No parameter schema in public metadata yet.
poll_submissionPolls a submission with backoff and timeout, returning a non-error still_running status.
Polls a submission with backoff and timeout, returning a non-error still_running status.
No parameter schema in public metadata yet.
get_leaderboard
No parameter schema in public metadata yet.
get_my_profile
No parameter schema in public metadata yet.
codabench_requestGeneric REST escape hatch, GET-only by default.
Generic REST escape hatch, GET-only by default.
No parameter schema in public metadata yet.
Sponsors
Configuration
CODABENCH_API_TOKEN*secretDRF token for Codabench. Obtain via https://www.codabench.org/api/docs/ > api-token-auth > Try it out.
Readme
codabench-mcp
MCP server for the Codabench REST API. Lets an AI agent drive a full participant ML-benchmark workflow: discover competitions, read rules, download data, submit, poll, read leaderboards.
Features
Curated tools for the participant path:
search_competitions,get_competition,list_competition_phases,get_phase,get_competition_rules,list_competition_tasks,get_taskdownload_dataset(streaming + SHA-256)list_my_submissions,get_submission,get_submission_logssubmit_to_phase(handles Codabench's 3-step upload flow)poll_submission(backoff + timeout + non-error "still_running")get_leaderboard,get_my_profilecodabench_request— generic REST escape hatch (GET-only by default)
Authentication
You need a Codabench API token. Two ways to get one:
1. Swagger UI (recommended)
- Visit https://www.codabench.org/api/docs/
- Find the
api-token-authendpoint → Try it out - POST your username/password
- Copy the
tokenvalue from the response
2. curl
Details
- Repository
- github.com/harshitagr/codabench-mcp
- Category
- Automation & Workflows
- Package
codabench-mcp- Transport
- STDIO
- Auth
- Required
- Registry
- MCP registry, active