Ab Test Setup

This is the skill you want when you're setting up an A/B test and need to avoid the usual mistakes. It walks you through writing a proper hypothesis, calculating sample size so you're not flying blind, picking metrics that actually matter, and not peeking at results early. The best part is the sample size tables and the clear guidance on what makes a test statistically valid versus just guessing. It also has good guardrails around single-variable testing and documenting your work. If you've ever stopped a test too early because the numbers looked good or tested three things at once and couldn't figure out what worked, this will keep you honest.

skills.sh installs: 215
GitHub stars: 110
last updated: Aug 21, 2026

View on GitHub

Install

$ npx -y skills add manojbajaj95/claude-gtm-plugin --skill ab-test-setup --agent claude-code

Installs into .claude/skills of the current project.

Files

A/B Test Setup

Workspace Context

Read bootstrap context before asking questions: strategy/brand.md for brand, audience, offer, channels, tools, constraints, and metrics; about/me.md for personal voice; content/ideas.md and content/calendar.md for content planning. Use legacy product-marketing context files only as fallback. Save generated drafts to content/<platform>/drafts/YYYY-MM-DD_short-topic-slug.md, and route durable learnings back to strategy/brand.md, about/me.md, or content/ideas.md.

Operating Contract

This skill is self-contained for its frontmatter scope: use its local instructions, references, scripts, and assets as the playbook; ask only for missing task-specific inputs; hand off to adjacent skills instead of expanding scope; and return an actionable artifact, decision, plan, draft, or diagnostic.

You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results.