When your Shiplight YAML tests start breaking after a deployment or UI change, this skill systematically reproduces failures, inspects the evidence, and applies minimal fixes without silently rewriting test intent to mask real bugs. It follows a strict precedence order: user instruction beats spec, spec beats current behavior, which means if your app contradicts the test goal or feature spec, you get a mismatch report instead of a cover-up. The workflow is reproduce, understand the failure and relevant files, inspect live browser state only when logs aren't enough, fix the smallest surface (locator, template, auth, or spec), validate and rerun, then update project memory. Best for CI repair passes or when several tests share a root cause, not for creating new tests from scratch.

skills.sh installs
584
GitHub stars
2
last updated
Jun 3, 2026

Install

$ npx -y skills add shiplightai/agent-skills --skill triage --agent claude-code

Installs into .claude/skills of the current project.

Files

Triage Failing Tests

Use this skill to reproduce, diagnose, and repair failing Shiplight YAML tests. If the application is broken or current behavior conflicts with the spec, report the mismatch instead of rewriting the test around it.

When To Use

Use /triage when:

  • A Shiplight test run is failing
  • A deployment or UI change broke existing tests
  • Several tests may share the same failure source
  • CI needs a best-effort repair/report pass

Skip /triage when:

  • Creating new tests from scratch; use /create-yaml-tests
  • Verifying UI code changes without failing tests; use /verify
  • Tests pass and the task is only quality improvement
  • The product is being intentionally redesigned and tests need planned rewriting

Required Context

Before editing YAML:

  1. Read the create-yaml-tests reference guides project-layout.md, updating-tests.md, test-implementation-guide.md, and knowledge.md.
  2. Read relevant knowledge/ notes for the failing area, environment, auth, data, and tooling.
  3. Read the matching spec under specs/tests/, if one exists.
  4. Read shiplight://yaml-test-spec and shiplight://schemas/action-entity.

Ground Truth

Sponsors

Details

Repository
github.com/shiplightai/agent-skills
Category
AI & Agent Building
First seen
Jun 3, 2026

More from shiplightai/agent-skills

All 12
1aj-geddes avatartechnical-roadmap-planningaj-geddes/useful-ai-promptsCreate comprehensive technical roadmaps aligned with business goals. Plan technology investments, architecture evolution, and infrastructure improvements over q582skills.sh installs
2aj-geddes avataraccessibility-testingaj-geddes/useful-ai-promptsTest web applications for WCAG compliance and ensure usability for users with disabilities. Use for accessibility test, a11y, axe, ARIA, keyboard navigation, sc580skills.sh installs
3aj-geddes avatarpush-notification-setupaj-geddes/useful-ai-promptsImplement push notifications for iOS and Android. Covers Firebase Cloud Messaging, Apple Push Notification service, handling notifications, and backend integrat580skills.sh installs
4plugin87 avatarredesignplugin87/ux-ui-agent-skillsUpgrade an existing website or app to premium quality without breaking functionality — audit the current design, identify generic/AI tells, then apply taste and580skills.sh installs
5fvadicamo avatargithub-pr-reviewfvadicamo/dev-agent-skillsHandles PR review comments and feedback resolution. Use when user wants to resolve PR comments, handle review feedback, fix review comments, address PR review, 579skills.sh installs
6get-convex avatarconvex-helpers-guideget-convex/agent-skillsDiscover and use convex-helpers utilities for relationships, filtering, sessions, custom functions, and more. Use when you need pre-built Convex patterns.578skills.sh installs