Writing Evals
Scaffolds evaluation suites for the Axiom AI SDK by generating eval files, scorers, flag schemas, and config from natural language descriptions. It reads your AI code first, traces inputs and outputs, then creates colocated .eval.ts files with at least two scorers per capability (correctness plus quality checks). The philosophy is solid: evals are tests for AI, scorers are assertions, flags are variables. It knows the difference between reference-based and reference-free scorers and will pick the right pattern based on whether you're returning categories, free text, structured objects, or tool calls. Use this when you need to prove your AI features still work after every change.
- skills.sh installs
- 2.2K
- GitHub stars
- 17
- last updated
- Aug 21, 2026
Install
$ npx -y skills add axiomhq/skills --skill writing-evals --agent claude-codeInstalls into .claude/skills of the current project.
Files
Scaffolds evaluation suites for the Axiom AI SDK by generating eval files, scorers, flag schemas, and config from natural language descriptions. It reads your AI code first, traces inputs and outputs, then creates colocated .eval.ts files with at least two scorers per capability (correctness plus quality checks). The philosophy is solid: evals are tests for AI, scorers are assertions, flags are variables. It knows the difference between reference-based and reference-free scorers and will pick the right pattern based on whether you're returning categories, free text, structured objects, or tool calls. Use this when you need to prove your AI features still work after every change.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/axiomhq/skills
- Category
- Documentation
- First seen
- Jun 3, 2026
More from axiomhq/skills
All 6Recommended
More Documentation
wiki-switchar9av/obsidian-wikiSwitch between multiple Obsidian wiki vault profiles. Use this skill when the user says "/wiki-switch NAME", "switch to my work wiki", "switch vault", "change w2.1Kskills.sh installs
writing-great-skillsvinvcn/mattpocock-skills-zh-cn编写和编辑优秀 skills 的参考：让技能可预测的词汇和原则。2.1Kskills.sh installs
llm-wikinashsu/llm_wiki_skillQuery the user's LLM Wiki knowledge base (the LLM Wiki desktop app at 127.0.0.1:19828 — NOT Obsidian, Notion, Apple Notes, Logseq, or any other PKM tool). Trigg1.9Kskills.sh installs
paper-writing-sectionlingzhi227/agent-research-skillsWrite a specific section of an academic paper (Abstract, Introduction, Background, Related Work, Methods, Experiments, Results, Discussion/Conclusion) with sect1.8Kskills.sh installs
research-paper-writingmaster-cai/research-paper-writing-skillsImprove academic paper writing quality for ML/CV/NLP-style papers with clear section structure, paragraph flow, and reviewer-facing presentation. Use when draft1.8Kskills.sh installs