hamelsmu/evals-skills
- skills.sh installs
- 6.1K
- skills
- 7
Install
$ npx -y skills add hamelsmu/evals-skills --agent claude-codeInstalls into .claude/skills of the current project.
Skills
1
eval-audithamelsmu/evals-skillsAudit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when unsur1.5Kskills.sh installs
eval-audithamelsmu/evals-skillsAudit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when unsur1.5Kskills.sh installs2evaluate-raghamelsmu/evals-skillsGuides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, as850skills.sh installs
evaluate-raghamelsmu/evals-skillsGuides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, as850skills.sh installs3write-judge-prompthamelsmu/evals-skillsDesign LLM-as-Judge evaluators for subjective criteria that code-based checks cannot handle. Use when a failure mode requires interpretation (tone, faithfulness837skills.sh installs
write-judge-prompthamelsmu/evals-skillsDesign LLM-as-Judge evaluators for subjective criteria that code-based checks cannot handle. Use when a failure mode requires interpretation (tone, faithfulness837skills.sh installs4error-analysishamelsmu/evals-skillsHelp the user systematically identify and categorize failure modes in an LLM pipeline by reading traces. Use when starting a new eval project, after significant799skills.sh installs
error-analysishamelsmu/evals-skillsHelp the user systematically identify and categorize failure modes in an LLM pipeline by reading traces. Use when starting a new eval project, after significant799skills.sh installs5validate-evaluatorhamelsmu/evals-skillsCalibrate an LLM judge against human labels using data splits, TPR/TNR, and bias correction. Use after writing a judge prompt (write-judge-prompt) when you need739skills.sh installs
validate-evaluatorhamelsmu/evals-skillsCalibrate an LLM judge against human labels using data splits, TPR/TNR, and bias correction. Use after writing a judge prompt (write-judge-prompt) when you need739skills.sh installs6generate-synthetic-datahamelsmu/evals-skillsCreate diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation. Use when bootstrapping an eval dataset, when real user 723skills.sh installs
generate-synthetic-datahamelsmu/evals-skillsCreate diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation. Use when bootstrapping an eval dataset, when real user 723skills.sh installs7build-review-interfacehamelsmu/evals-skillsBuild a custom browser-based annotation interface tailored to your data for reviewing LLM traces and collecting structured feedback. Use when you need to build 647skills.sh installs
build-review-interfacehamelsmu/evals-skillsBuild a custom browser-based annotation interface tailored to your data for reviewing LLM traces and collecting structured feedback. Use when you need to build 647skills.sh installs