Evaluating Llms Harness
A wrapper around the lm-evaluation-harness library that lets you benchmark language models against 60+ academic tests right from your terminal. You point it at any HuggingFace model and specify which benchmarks to run (MMLU, GSM8k, HellaSwag, etc.), and it handles the standardized prompts and scoring. Useful when you're comparing models or trying to get objective numbers on how a fine-tuned model stacks up. The skill itself is a template that simplifies the CLI invocation, though the real heavy lifting happens in the underlying Eleuther AI library. If you're evaluating models regularly, this saves you from remembering all the command flags and argument patterns.
- skills.sh installs
- 418
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill evaluating-llms-harness --agent claude-codeInstalls into .claude/skills of the current project.
Files
A wrapper around the lm-evaluation-harness library that lets you benchmark language models against 60+ academic tests right from your terminal. You point it at any HuggingFace model and specify which benchmarks to run (MMLU, GSM8k, HellaSwag, etc.), and it handles the standardized prompts and scoring. Useful when you're comparing models or trying to get objective numbers on how a fine-tuned model stacks up. The skill itself is a template that simplifies the CLI invocation, though the real heavy lifting happens in the underlying Eleuther AI library. If you're evaluating models regularly, this saves you from remembering all the command flags and argument patterns.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/davila7/claude-code-templates
- Categories
- Code Review & Quality, Data Science & ML
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Ml Paper Writing416
- Openalex Database416
- Workflow Automation416
- Backend To Frontend Handoff Docs413
- Shopify Development411
- Nextjs Supabase Auth410
- Clinicaltrials Database409
- Writing Plans408
- Geopandas407
- Bash Linux405
- App Store Optimization404
- Telegram Bot Builder403
- Treatment Plans403
- Micro Saas Launcher401
- Ai Product399
- Paper 2 Web399
- Best Practices398
- Json Canvas397
- Hypothesis Generation396
- Notion Research Documentation396
- Social Content396
- Sympy396
- Mcp Builder395
- Pytorch Fsdp395
Recommended
More Code Review & Quality
obsidian-literature-workflowgalaxy-dawn/claude-scholarUse this skill for project-scoped literature review built on Sources/Papers, with synthesis landing in Knowledge, writing handoff in Writing, and the default li418skills.sh installs
hugging-face-model-trainerhuggingface/skillsThis skill should be used when users want to train or fine-tune language models using TRL (Transformer Reinforcement Learning) on Hugging Face Jobs infrastructu418skills.sh installs
react-testing-librarypproenca/dot-skillsReact Testing Library best practices for writing maintainable, user-centric tests. Use when writing, reviewing, or refactoring RTL tests. Triggers on test files418skills.sh installs
conlangjwynia/agent-skillsGenerate phonologically consistent constructed languages for fiction. Use when you need naming languages, alien speech, or fantasy tongues without deep linguist417skills.sh installsjscodeshiftpproenca/dot-skillsjscodeshift codemod development best practices from Facebook/Meta. This skill should be used when writing, reviewing, or debugging jscodeshift codemods. Trigger416skills.sh installstddpproenca/dot-skillsTest-Driven Development methodology and red-green-refactor workflow (formerly test-tdd). This skill should be used when practicing TDD, writing tests first, des415skills.sh installs