Scraper Builder

This is a code generator that outputs complete Playwright scraper projects using the PageObject pattern. It creates TypeScript classes for each page you want to scrape, Zod schemas for data validation, and Docker configs for deployment. The standout feature is agent-browser integration: you can have Claude navigate a site, capture accessibility snapshots, and auto-generate selectors instead of writing them manually. It's opinionated about selector resilience (data-testid over brittle CSS paths) and composition over inheritance. Use it when you need a structured, maintainable scraper for a specific site. Skip it for API scraping, mass crawling, or test automation, where other patterns fit better.

skills.sh installs: 377
GitHub stars: 182
last updated: Aug 21, 2026

View on GitHub

Install

$ npx -y skills add jwynia/agent-skills --skill scraper-builder --agent claude-code

Installs into .claude/skills of the current project.

Files

Scraper Builder

Generate complete, runnable web scraper projects using the PageObject pattern with Playwright and TypeScript. This skill produces site-specific scrapers with typed data extraction, Docker deployment, and optional agent-browser integration for automated site analysis.

When to Use This Skill

Use this skill when:

Building a site-specific web scraper for data extraction
Generating PageObject classes for a target website
Scaffolding a complete scraper project with Docker support
Using agent-browser to analyze a site and auto-generate selectors
Creating reusable scraping components (pagination, data tables)

Do NOT use this skill when:

Building API clients (use HTTP client libraries directly)
Writing QA/E2E test suites (use Playwright test runner with test-focused patterns)
Mass crawling or spidering entire domains (use Crawlee or Scrapy)
Scraping sites that require authentication bypass or CAPTCHA solving