Ai Regression Testing

When Claude writes code and then reviews its own work, it carries the same blind spots into both steps. This catches that. The pattern here is sandbox versus production path mismatches, where an AI adds a field to one code path and forgets the other, then reviews it and misses the gap again. The approach is contract testing with Vitest against sandbox mode so you don't need database setup, plus a bug check workflow that runs tests before AI review instead of after. The real insight is treating tests as regression prevention, not coverage. Write tests for bugs that were found, not code that already works.

skills.sh installs: 4.8K
GitHub stars: 229.1K
last updated: Jul 14, 2026

View on GitHub

Install

$ npx -y skills add affaan-m/everything-claude-code --skill ai-regression-testing --agent claude-code

Installs into .claude/skills of the current project.

Files

AI Regression Testing

Testing patterns specifically designed for AI-assisted development, where the same model writes code and reviews it — creating systematic blind spots that only automated tests can catch.

When to Activate

AI agent (Claude Code, Cursor, Codex) has modified API routes or backend logic
A bug was found and fixed — need to prevent re-introduction
Project has a sandbox/mock mode that can be leveraged for DB-free testing
Running /bug-check or similar review commands after code changes
Multiple code paths exist (sandbox vs production, feature flags, etc.)

The Core Problem

When an AI writes code and then reviews its own work, it carries the same assumptions into both steps. This creates a predictable failure pattern:

AI writes fix → AI reviews fix → AI says "looks correct" → Bug still exists

Real-world example (observed in production):

Fix 1: Added notification_settings to API response
  → Forgot to add it to the SELECT query
  → AI reviewed and missed it (same blind spot)

Fix 2: Added it to SELECT query
  → TypeScript build error (column not in generated types)
  → AI reviewed Fix 1 but didn't catch the SELECT issue

SKILL.md on GitHub