Evaluating Code Models
This taps into the BigCode Evaluation Harness to benchmark code generation models across 15+ standardized tests including HumanEval, MBPP, and MultiPL-E in 18 languages. You'd use this when you need objective metrics on how well a model generates code, whether you're comparing different models, tracking improvements over time, or validating a fine-tuned version. It's a fork from an AI research collection, so it's built for people who want real numbers rather than vibes. Fair warning that the security audits show mixed results, with a fail from Gen Agent Trust Hub, so review what you're installing before running it in production environments.
- skills.sh installs
- 350
- GitHub stars
- 33.2K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add davila7/claude-code-templates --skill evaluating-code-models --agent claude-codeInstalls into .claude/skills of the current project.
Files
This taps into the BigCode Evaluation Harness to benchmark code generation models across 15+ standardized tests including HumanEval, MBPP, and MultiPL-E in 18 languages. You'd use this when you need objective metrics on how well a model generates code, whether you're comparing different models, tracking improvements over time, or validating a fine-tuned version. It's a fork from an AI research collection, so it's built for people who want real numbers rather than vibes. Fair warning that the security audits show mixed results, with a fail from Gen Agent Trust Hub, so review what you're installing before running it in production environments.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/davila7/claude-code-templates
- Categories
- Testing & QA, Code Review & Quality, Data Science & ML
- First seen
- Jun 3, 2026
More from davila7/claude-code-templates
All 618- Geo Database350
- Notion Spec To Implementation350
- Training Llms Megatron350
- Changelog Generator349
- Performance Profiling349
- Server Management349
- Tensorrt Llm349
- Deslop348
- Algorithmic Art347
- Email Systems347
- Faiss347
- Voice Agents347
- Git Pushing346
- Brand Guidelines344
- Paid Ads344
- Guidance343
- Executing Plans342
- Launch Strategy342
- Marp Slide342
- Writing Clearly And Concisely342
- Browser Extension Builder341
- Huggingface Tokenizers340
- Llama Factory339
- Stable Baselines3338
Recommended
More Testing & QA
backend-engineersiviter-xyz/dot-agentBuild robust backend systems with modern technologies (Node.js, Python, Go, Rust), frameworks (NestJS, FastAPI, Django), databases (PostgreSQL, MongoDB, Redis),349skills.sh installs
cloudflare-turnstilejezweb/claude-skillsAdd bot protection with Turnstile (CAPTCHA alternative). Use when: protecting forms, securing login/signup, preventing spam, migrating from reCAPTCHA, integrati348skills.sh installs
flutter-duit-bduimadteacher/mad-agents-skillsIntegrate, fix, review, migrate, test, or debug Duit / flutter_duit backend-driven UI in Flutter applications. Use when a task mentions DUIT, flutter_duit, back346skills.sh installs
ecto-patternsbobmatnyc/claude-mpm-skillsEcto patterns for Phoenix/Elixir apps. Covers schemas, changesets, migrations, queries, Ecto.Multi, transactions, constraints, associations, pagination, tenant 345skills.sh installs
e-taxkazukinagata/shinkokuThis skill should be used when the user wants to file their tax return electronically via the 確定申告書等作成コーナー (NTA Tax Return Preparation Corner) using Claude in C342skills.sh installscloudflare-browser-renderingjezweb/claude-skillsAdd headless Chrome automation with Puppeteer/Playwright on Cloudflare Workers. Use when: taking screenshots, generating PDFs, web scraping, crawling sites, bro341skills.sh installs