Claude MarketplacesSubmit
daymade avatar

llm-eval-harness

daymade/claude-code-skills

Tests/benchmarks a third-party LLM endpoint (OpenAI- or Anthropic-compatible): availability, fidelity, speed, concurrency, protocol compliance, quality regression. Use before hand-rolling a curl loop, when onboarding a provider, or debugging "system prompt 不生效" / a tok/s claim — 测评/压测一个模型或渠道. Not for TTS/voice-clone supplier eval (use the audio skill).

version
1.8.0
GitHub stars
1.5K
View on GitHub

Install

/plugin install llm-eval-harness@daymade-skills

Run it inside Claude Code after adding the marketplace with /plugin marketplace add daymade/claude-code-skills.

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Details

Marketplace
daymade/claude-code-skills
Source
llm-eval-harness
Category
Developer Tools
Keywords
llm, eval, benchmark, model-comparison, speed-test, concurrency, protocol-compliance, tokens-per-second, ttft, thinking-aware, availability, fidelity, system-prompt, gateway-testing, vendor-bug-report

More from daymade/claude-code-skills

All 88