Experiment Designer
Automates the setup of A/B tests and experimental frameworks when you need to validate product decisions with real data. It generates experiment configs, helps you define success metrics, and sets up the statistical scaffolding so you're not manually calculating sample sizes or significance thresholds. Useful when you're moving beyond gut decisions but don't want to context switch into statistics mode. The structured approach keeps you honest about what you're actually testing and when to call results, which is half the battle with experiments that drag on without clear stopping points.
- skills.sh installs
- 617
- GitHub stars
- 29.5K
- last updated
- Aug 21, 2026
Install
$ npx -y skills add alirezarezvani/claude-skills --skill experiment-designer --agent claude-codeInstalls into .claude/skills of the current project.
Files
Experiment Designer
Design, prioritize, and evaluate product experiments with clear hypotheses and defensible decisions.
When To Use
Use this skill for:
- A/B and multivariate experiment planning
- Hypothesis writing and success criteria definition
- Sample size and minimum detectable effect planning
- Experiment prioritization with ICE scoring
- Reading statistical output for product decisions
Core Workflow
- Write hypothesis in If/Then/Because format
- If we change
[intervention] - Then
[metric]will change by[expected direction/magnitude] - Because
[behavioral mechanism]
- Define metrics before running test
- Primary metric: single decision metric
- Guardrail metrics: quality/risk protection
- Secondary metrics: diagnostics only
- Estimate sample size
- Baseline conversion or baseline mean
- Minimum detectable effect (MDE)
- Significance level (alpha) and power
Use:
python3 scripts/sample_size_calculator.py --baseline-rate 0.12 --mde 0.02 --mde-type absolute
- Prioritize experiments with ICE
- Impact: potential upside
- Confidence: evidence quality
- Ease: cost/speed/complexity
ICE Score = (Impact * Confidence * Ease) / 10
Sponsors
Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthly
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any language
Agent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/alirezarezvani/claude-skills
- Categories
- Documentation, Productivity & Planning
- First seen
- Jun 3, 2026
More from alirezarezvani/claude-skills
All 267- Signup Flow Cro615
- Focused Fix614
- Runbook Generator614
- Email Template Builder613
- Chro Advisor612
- Competitor Alternatives611
- Onboarding Cro609
- Spec Driven Workflow609
- Churn Prevention604
- Context Engine604
- Roadmap Communicator604
- Board Deck Builder602
- Agenthub599
- Autoresearch Agent599
- Monorepo Navigator598
- Referral Program597
- Paywall Upgrade Cro596
- Company Os594
- Git Worktree Manager594
- Free Tool Strategy592
- Popup Cro592
- Scenario War Room590
- Helm Chart Builder585
- Cs Onboard584
Recommended
More Documentation1
rust-ffimohitmishra786/low-level-dev-skillsRust FFI skill for C interoperability. Use when calling C libraries from Rust, generating Rust bindings with bindgen, exporting Rust functions to C with cbindge613skills.sh installs
rust-ffimohitmishra786/low-level-dev-skillsRust FFI skill for C interoperability. Use when calling C libraries from Rust, generating Rust bindings with bindgen, exporting Rust functions to C with cbindge613skills.sh installs2
vercel-react-best-practiceslanggenius/difyReact and Next.js performance optimization guidelines from Vercel Engineering. This skill should be used when writing, reviewing, or refactoring React/Next.js c612skills.sh installs
vercel-react-best-practiceslanggenius/difyReact and Next.js performance optimization guidelines from Vercel Engineering. This skill should be used when writing, reviewing, or refactoring React/Next.js c612skills.sh installs3rust-unsafemohitmishra786/low-level-dev-skillsRust unsafe code skill for systems programming. Use when writing or reviewing unsafe Rust, understanding what operations require unsafe, implementing safe abstr611skills.sh installs
rust-unsafemohitmishra786/low-level-dev-skillsRust unsafe code skill for systems programming. Use when writing or reviewing unsafe Rust, understanding what operations require unsafe, implementing safe abstr611skills.sh installs4
novel-writeryangsonhung/awesome-agent-skillsUse when writing, continuing, revising, or planning novels, characters, and fictional worlds.610skills.sh installs
novel-writeryangsonhung/awesome-agent-skillsUse when writing, continuing, revising, or planning novels, characters, and fictional worlds.610skills.sh installs5
livewire-developmentspatie/freek.devDevelops reactive Livewire 4 components. Activates when creating, updating, or modifying Livewire components; working with wire:model, wire:click, wire:loading,608skills.sh installs
livewire-developmentspatie/freek.devDevelops reactive Livewire 4 components. Activates when creating, updating, or modifying Livewire components; working with wire:model, wire:click, wire:loading,608skills.sh installs