affaan-m avatar

Ai Regression Testing

When the same AI writes code and reviews it, you get systematic blind spots. This skill addresses that with regression testing patterns built for AI-assisted development. The core workflow is simple: run tests before AI review, catch sandbox/production path mismatches mechanically instead of relying on model judgment, and write regression tests for every bug found. The documentation walks through real patterns from production where AI missed the same bug four times in code review but a single test caught it instantly. Most valuable if you have a sandbox mode for database-free API testing and you're using Claude or similar models to modify backend routes.

skills.sh installs
5.7K
GitHub stars
300.3K
last updated
Aug 21, 2026

Install

$ npx -y skills add affaan-m/ecc --skill ai-regression-testing --agent claude-code

Installs into .claude/skills of the current project.

Files

AI Regression Testing

Testing patterns specifically designed for AI-assisted development, where the same model writes code and reviews it — creating systematic blind spots that only automated tests can catch.

When to Activate

  • AI agent (Claude Code, Cursor, Codex) has modified API routes or backend logic
  • A bug was found and fixed — need to prevent re-introduction
  • Project has a sandbox/mock mode that can be leveraged for DB-free testing
  • Running /bug-check or similar review commands after code changes
  • Multiple code paths exist (sandbox vs production, feature flags, etc.)

The Core Problem

When an AI writes code and then reviews its own work, it carries the same assumptions into both steps. This creates a predictable failure pattern:

AI writes fix → AI reviews fix → AI says "looks correct" → Bug still exists

Real-world example (observed in production):

Fix 1: Added notification_settings to API response
  → Forgot to add it to the SELECT query
  → AI reviewed and missed it (same blind spot)

Fix 2: Added it to SELECT query
  → TypeScript build error (column not in generated types)
  → AI reviewed Fix 1 but didn't catch the SELECT issue

Sponsors

Details

Repository
github.com/affaan-m/ecc
Categories
Backend & APIs, Testing & QA, DevOps & CI/CD, AI & Agent Building, Debugging, Automation & Workflows, Databases
First seen
Jul 14, 2026

More from affaan-m/ecc

All 263
1affaan-m avatardocumentation-lookupaffaan-m/eccUse up-to-date library and framework docs via Context7 MCP instead of training data. Activates for setup questions, API references, code examples, or when the u5.7Kskills.sh installs
2wondelai avatarhigh-perf-browserwondelai/skillsOptimize web performance through network protocols, resource loading, and browser rendering internals. Use when the user mentions "my site is slow", "Core Web V5.5Kskills.sh installs
3affaan-m avatarkotlin-ktor-patternsaffaan-m/eccKtor server patterns including routing DSL, plugins, authentication, Koin DI, kotlinx.serialization, WebSockets, and testApplication testing.5.5Kskills.sh installs
4jeffallan avatarkotlin-specialistjeffallan/claude-skillsProvides idiomatic Kotlin implementation patterns including coroutine concurrency, Flow stream handling, multiplatform architecture, Compose UI construction, Kt5.4Kskills.sh installs
5affaan-m avatarquarkus-patternsaffaan-m/eccQuarkus 3.x LTS architecture patterns with Camel for messaging, RESTful API design, CDI services, data access with Panache, and async processing. Use for Java Q5.4Kskills.sh installs
6affaan-m avatarflox-environmentsaffaan-m/eccCreate reproducible, cross-platform (macOS/Linux) development environments with Flox, a declarative Nix-based environment manager. Use when setting up project t5.4Kskills.sh installs