steipete avatar

Openclaw Qa Testing

This skill helps you run, debug, and extend the OpenClaw project's QA automation for channels like Telegram, WhatsApp, and Matrix. It reads scenario packs from the qa-lab extension, decides which lane to use (mock or live frontier), and runs full test suites with configurable model policies defaulting to gpt-5.4. You get structured JSON summaries and markdown reports in .artifacts, plus utilities for OTEL smoke tests, character evals across multiple LLMs, and credential management through 1Password and Convex. The workflow is opinionated: it won't use gpt-5.4-pro or mini unless you ask, and it expects you to rerun the full lane if anything fails. Useful when you're shipping transport features or validating end-to-end channel contracts before release.

skills.sh installs
126
GitHub stars
376.2K
last updated
Jun 3, 2026

Install

$ npx -y skills add steipete/clawdis --skill openclaw-qa-testing --agent claude-code

Installs into .claude/skills of the current project.

Files

OpenClaw QA Testing

Use this skill for qa-lab / qa-channel work. Repo-local QA only.

Read first

  • docs/concepts/qa-e2e-automation.md
  • docs/help/testing.md
  • docs/channels/qa-channel.md
  • qa/README.md
  • qa/scenarios/index.yaml
  • extensions/qa-lab/src/suite.ts
  • extensions/qa-lab/src/character-eval.ts

Model policy

  • Normal live suite runs rely on QA Lab source- and auth-aware defaults.
  • Do not pass --model, --alt-model, or --fast by default. Omitted --fast does not mean fast is disabled; fast behavior is source-owned.
  • For scenario-specific runs, the complete execution.summary is authoritative and overrides generic default guidance, including when it requires other flags. Add explicit provider/model pins only when execution.config.requiredProvider or requiredModel requires them.

Default workflow

  1. Read the scenario pack and current suite implementation.
  2. Decide lane:
    • mock/dev: mock-openai
    • real validation: live-frontier
  3. For a normal live suite, use:
pnpm openclaw qa suite \
  --provider-mode live-frontier \
  --output-dir .artifacts/qa-e2e/run-all-live-frontier-<tag>

Sponsors

Details

Repository
github.com/steipete/clawdis
Category
Testing & QA
First seen
Jun 3, 2026

More from steipete/clawdis

All 61
1shipshitdev avatarhusky-test-coverageshipshitdev/libraryhusky test coverage116skills.sh installs
2softaworks avatarqa-test-plannersoftaworks/agent-toolkitGenerate comprehensive test plans, manual test cases, regression test suites, and bug reports for QA engineers. Includes Figma MCP integration for design valida4.4Kskills.sh installs
3manutej avatarjest-react-testingmanutej/luxor-claude-marketplaceComprehensive React component testing with Jest and React Testing Library covering configuration, mocking strategies, async testing patterns, hooks testing, and1.2Kskills.sh installs
4aaronontheweb avatarplaywright-blazor-testingaaronontheweb/dotnet-skillsWrite UI tests for Blazor applications (Server or WebAssembly) using Playwright. Covers navigation, interaction, authentication, selectors, and common Blazor-sp560skills.sh installs
5aaronontheweb avatarsnapshot-testingaaronontheweb/dotnet-skillsUse Verify for snapshot testing in .NET. Approve API surfaces, HTTP responses, rendered emails, and serialized outputs. Detect unintended changes through human-484skills.sh installs
6sickn33 avatarapi-testing-observability-api-mocksickn33/antigravity-awesome-skillsapi testing observability api mock451skills.sh installs