This is how you actually test whether your agent workflow works in practice. It walks you through five evaluation dimensions (task completion, output quality, error behavior, user experience, consistency) and forces you to run concrete scenarios including edge cases and adversarial inputs. You get a structured table to document what happened versus what should have happened, then a graded report with specific improvement actions. The real value is that it won't let you skip the uncomfortable tests. Most people only check the happy path, but this pushes you to test malformed input, tool failures, and tricky cases. If you're shipping an agent workflow to users, run this first and prepare to feel slightly embarrassed by what breaks.

skills.sh installs
363
GitHub stars
602
last updated
Aug 21, 2026

Install

$ npx -y skills add sharpdeveye/maestro --skill evaluate --agent claude-code

Installs into .claude/skills of the current project.

Files

MANDATORY PREPARATION

Invoke /agent-workflow — it contains workflow principles, anti-patterns, and the Context Gathering Protocol. Follow the protocol before proceeding — if no workflow context exists yet, you MUST run /teach-maestro first. Consult the feedback-loops reference in the agent-workflow skill for evaluation patterns, golden test sets, and regression detection.


Evaluate the workflow's actual interaction quality by testing it against scenarios that represent real usage.

Evaluation Dimensions

1. Task Completion

  • Does the workflow actually accomplish what it's supposed to?
  • Does it handle the complete task or only the happy path?
  • Are edge cases addressed or silently dropped?

2. Output Quality

  • Is the output accurate, complete, and well-formatted?
  • Does it match the defined output schema (if any)?
  • Would a domain expert approve the output?

3. Error Behavior

  • What happens when input is malformed?
  • What happens when a tool fails?
  • What happens when the model is uncertain?
  • Is the error message useful or generic?

4. User Experience

Sponsors

Details

Repository
github.com/sharpdeveye/maestro
Categories
Testing & QA, Git & Pull Requests, Code Review & Quality, Automation & Workflows, Design & UI/UX
First seen
Jun 3, 2026

More from sharpdeveye/maestro

All 22
1davila7 avataranalytics-trackingdavila7/claude-code-templatesWhen the user wants to set up, improve, or audit analytics tracking and measurement. Also use when the user mentions "set up tracking," "GA4," "Google Analytics361skills.sh installs
2pmprompt avatarpmf-surveypmprompt/claude-plugin-product-managementUse when asked to "PMF survey", "measure product-market fit", "40% rule", "Sean Ellis test", "Rahul Vohra method", or "how disappointed would you be". Helps qua358skills.sh installs
3pedronauck avatarhormozi-ad-factorypedronauck/skillsGenerates 150-750+ ad variations using Alex Hormozi's combinatorial Hook x Meat x CTA framework. Triggers on requests to create ads, ad copy, ad scripts, market353skills.sh installs
4davila7 avatarevaluating-code-modelsdavila7/claude-code-templatesEvaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding 350skills.sh installs
5siviter-xyz avatarbackend-engineersiviter-xyz/dot-agentBuild robust backend systems with modern technologies (Node.js, Python, Go, Rust), frameworks (NestJS, FastAPI, Django), databases (PostgreSQL, MongoDB, Redis),349skills.sh installs
6jezweb avatarcloudflare-turnstilejezweb/claude-skillsAdd bot protection with Turnstile (CAPTCHA alternative). Use when: protecting forms, securing login/signup, preventing spam, migrating from reCAPTCHA, integrati348skills.sh installs