
Triage
When your Shiplight YAML tests start breaking after a deployment or UI change, this skill systematically reproduces failures, inspects the evidence, and applies minimal fixes without silently rewriting test intent to mask real bugs. It follows a strict precedence order: user instruction beats spec, spec beats current behavior, which means if your app contradicts the test goal or feature spec, you get a mismatch report instead of a cover-up. The workflow is reproduce, understand the failure and relevant files, inspect live browser state only when logs aren't enough, fix the smallest surface (locator, template, auth, or spec), validate and rerun, then update project memory. Best for CI repair passes or when several tests share a root cause, not for creating new tests from scratch.
- skills.sh installs
- 584
- GitHub stars
- 2
- last updated
- Jun 3, 2026
Install
$ npx -y skills add shiplightai/agent-skills --skill triage --agent claude-codeInstalls into .claude/skills of the current project.
Files
Triage Failing Tests
Use this skill to reproduce, diagnose, and repair failing Shiplight YAML tests. If the application is broken or current behavior conflicts with the spec, report the mismatch instead of rewriting the test around it.
When To Use
Use /triage when:
- A Shiplight test run is failing
- A deployment or UI change broke existing tests
- Several tests may share the same failure source
- CI needs a best-effort repair/report pass
Skip /triage when:
- Creating new tests from scratch; use
/create-yaml-tests - Verifying UI code changes without failing tests; use
/verify - Tests pass and the task is only quality improvement
- The product is being intentionally redesigned and tests need planned rewriting
Required Context
Before editing YAML:
- Read the
create-yaml-testsreference guidesproject-layout.md,updating-tests.md,test-implementation-guide.md, andknowledge.md. - Read relevant
knowledge/notes for the failing area, environment, auth, data, and tooling. - Read the matching spec under
specs/tests/, if one exists. - Read
shiplight://yaml-test-specandshiplight://schemas/action-entity.
Ground Truth
Sponsors
Details
- Repository
- github.com/shiplightai/agent-skills
- Category
- AI & Agent Building
- First seen
- Jun 3, 2026