Measure Experiment Design

This generates a complete experiment design document when you're planning an A/B test. It walks you through hypothesis formation, variant definitions, metric selection, sample size calculations, and success criteria so you don't launch underpowered tests or move goalposts after seeing results. The quality checklist enforces one primary metric and falsifiable hypotheses, which saves you from common traps like testing too many things at once or declaring victory on cherry-picked secondary metrics. Use it before launching any test where you need statistical rigor, not for quick informal experiments. It's opinionated about the structure but that's the point, it codifies good experiment hygiene so you're not reinventing the framework each time.

skills.sh installs: 801
GitHub stars: 794
last updated: Aug 21, 2026

View on GitHub

Install

$ npx -y skills add product-on-purpose/pm-skills --skill measure-experiment-design --agent claude-code

Installs into .claude/skills of the current project.

Files

Experiment Design

An experiment design document defines all parameters needed to run a rigorous A/B test or controlled experiment. It ensures the team aligns on what you're testing, how you'll measure success, and how long to run the test before drawing conclusions. Good experiment design prevents common pitfalls: underpowered tests, unclear success criteria, and decisions based on noise rather than signal.