
Ai Eval
A lightweight evaluation server running on Cloudflare Workers that exposes MCP over both REST and JSON-RPC 2.0. The implementation uses streamable HTTP transport, making it accessible from any MCP client that supports remote connections. You'd reach for this when you need to integrate AI evaluation capabilities into your workflow without managing infrastructure, since it's already deployed and accessible at api.lazy-mac.com/ai-eval. The dual protocol support means you can call it from traditional HTTP clients or connect it directly through MCP. Documentation is minimal, so expect to explore the available tools and prompts through your MCP client's discovery features.
- tools
- 3
- transport
- HTTP
- last updated
- May 16, 2026
Install
From registry metadata$ npx add-mcp https://api.lazy-mac.com/ai-eval/mcp --name ai-evalRun in your terminal. add-mcp asks which agents to add it to (Claude Code, Codex, Cursor and more). Add -g to install it for every project.
Review the command, arguments and environment values before installing. MCP servers run with your local permissions.
Other ways
Claude Code
$ claude mcp add --transport http ai-eval https://api.lazy-mac.com/ai-eval/mcpRun in your terminal. Add --scope user to make it available in every project.
Tools
Verified live · 3 toolsVerified live against the running server on Nov 6, 2026.
score_responseScore an AI response against a prompt using heuristic metrics (length, relevance, structure, completeness)3 params
Score an AI response against a prompt using heuristic metrics (length, relevance, structure, completeness)
criteriaarrayprompt*stringresponse*stringcompare_responsesCompare and rank multiple AI responses to the same prompt2 params
Compare and rank multiple AI responses to the same prompt
prompt*stringresponses*arraytext_metricsGet text quality metrics: word count, sentence count, estimated tokens, readability grade1 params
Get text quality metrics: word count, sentence count, estimated tokens, readability grade
text*stringSponsors
Readme
ai-eval-api
Cloudflare Workers MCP server: ai-eval. REST + MCP (JSON-RPC 2.0). Live: api.lazy-mac.com/ai-eval
Details
- Repository
- github.com/lazymac2x/ai-eval-api
- Category
- Cloud & Infrastructure
- Transport
- HTTP
- Registry
- MCP registry, active
- Tools verified
- Nov 6, 2026
More from lazymac2x
- Ai Guardrails
- Ai Model Router
- Ai Prompt Optimizer
- Ai Provider Status
- Ai Rate Limit Tracker
- Ai Token Counter
- Api Changelog Tracker
- Api Composition Gateway
- Api Contract Validator
- Api Diff Monitor
- Api Flow Analyzer
- Api Payload Auditor
- Api Perf Analyzer
- Api Request Deduplicator
- Api Response Cost Analyzer
- Api Schema Drift Detector
- Blog
- Citation Verifier
- Claude Skill Validator
- Code Explainer
- Code Pattern Risk Scanner
- Color Palette
- Cron Collision Detector
- Cron Monitor