Ab Test Designer
This takes you through designing a proper A/B test with all the pieces product teams actually need: hypothesis formation, sample size calculations, variant definitions, guardrail metrics, and analysis plans. It's built around a structured framework that forces you to think through risks and decision criteria before you run anything. Use it when you're testing a feature change, optimizing conversion rates, or need data to back a product decision. The best part is it pushes you to define success upfront and calculate how long to run the test, which stops teams from either calling tests too early or letting them run forever without learning anything.
- skills.sh installs
- 394
- GitHub stars
- 58
- last updated
- Aug 21, 2026
Install
$ npx -y skills add pmprompt/claude-plugin-product-management --skill ab-test-designer --agent claude-codeInstalls into .claude/skills of the current project.
Files
Domain Context
This skill implements a proven product management framework. The approach combines best practices from industry leaders and is designed for practical application in day-to-day PM work.
Input Requirements
- Context about your product, feature, or problem
- Relevant data, research, or constraints (recommended but optional)
- Clear articulation of what you're trying to achieve
A/B Test Designer
When to Use
- Testing a new feature or design variation
- Validating a hypothesis before full rollout
- Optimizing conversion rates or key metrics
- Choosing between multiple design approaches
- Need to make a data-driven decision on a change
What This Skill Does
Helps you design rigorous A/B tests with clear hypotheses, success metrics, sample size calculations, and analysis plans.
Instructions
Help me design an A/B test for [feature/change]. Include:
-
Hypothesis
- Current situation and metrics
- Proposed change
- Expected impact and why
-
Test Design
- Primary success metric
- Secondary metrics
- Sample size needed
- Test duration
- User segments to include/exclude
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/pmprompt/claude-plugin-product-management
- Categories
- Testing & QA, Data Science & ML, Marketing & SEO, Design & UI/UX
- First seen
- Jun 3, 2026
More from pmprompt/claude-plugin-product-management
All 25- Shape Up393
- Okrs392
- Strategic Narrative385
- Opportunity Solution Trees376
- Monetizing Innovation373
- Working Backwards370
- Design Sprint361
- Stakeholder Update Generator361
- Pmf Survey358
- Seven Powers358
- Growth Loops356
- Positioning Canvas356
- Trustworthy Experiments353
- Product Led Seo350
- Hooked Model349
- Hierarchy Of Engagement344
- Radical Candor344
- Hierarchy Of Marketplaces341
- Prd Writer1.2K
- Feature Prioritization Assistant548
- User Feedback Synthesizer436
- Thinking In Bets428
- Product Led Growth402
- Jobs To Be Done399
Recommended
More Testing & QA
playwright-web-scraperdawiddutoit/custom-claudeExtract structured data from multiple web pages using Playwright with built-in ethical crawling practices including rate limiting, robots.txt compliance, and er393skills.sh installs
laravel-tddiserter/laravel-claude-agentsTest-Driven Development specifically for Laravel applications using Pest PHP. Use when implementing any Laravel feature or bugfix - write the test first, watch 380skills.sh installs
test-writerleonardomso/33-js-conceptsGenerate comprehensive Vitest tests for code examples in JavaScript concept documentation pages, following project conventions and referencing source lines356skills.sh installs
regression-testingproffesor-for-testing/agentic-qeStrategic regression testing with test selection, impact analysis, and continuous regression management. Use when verifying fixes don't break existing functiona334skills.sh installs
load-test-builderpatricio0312rev/skillsCreates load and performance tests with k6, Artillery, or autocannon to validate system behavior under stress. Use when users request "load testing", "performan328skills.sh installs
analyze-selective-testingtuist/agent-skillsAnalyzes Xcode selective testing effectiveness for a test run, showing which test targets were skipped or ran, and diagnosing regressions in test selection. Can304skills.sh installs