Web Scraper

guia-matthieu/clawfu-skills

This is a straightforward BeautifulSoup wrapper that turns webpage scraping into CLI commands. You get four main operations: scrape elements by CSS selector, extract all links, pull email addresses with configurable depth, and grab structured data using predefined schemas for articles and products. The CSS selector reference table is genuinely helpful if you're rusty on that syntax. What's nice is the explicit ethical guidelines section, which actually matters since too many people slam servers without thinking about rate limits or robots.txt. The examples show real output formats, so you know what you're getting. It won't replace knowing how to write a scraper yourself, but if you need to pull competitor pricing or extract contact info from directories without writing boilerplate, it does the job.

skills.sh installs

590

GitHub stars

150

last updated

Aug 21, 2026

pip install beautifulsoup4 requests pandas click lxml

python scripts/main.py scrape https://example.com --selector "h1,h2,p"
python scripts/main.py scrape https://example.com --selector ".product-price"

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Recommended

More DevOps & CI/CD

1us-market-sentimentstar23/day1global-skillsUS stock market sentiment monitoring and position recommendation system. Evaluates market sentiment by tracking 5 core indicators (NAAIM Exposure Index, Institu590skills.sh installs

2interactive-dashboard-builderanthropics/knowledge-work-pluginsBuild self-contained interactive HTML dashboards with Chart.js, dropdown filters, and professional styling. Use when creating dashboards, building interactive r586skills.sh installs

3culture-architectalirezarezvani/claude-skillsBuild, measure, and evolve company culture as operational behavior — not wall posters. Covers mission/vision/values workshops, values-to-behaviors translation, 584skills.sh installs

4fastifybobmatnyc/claude-mpm-skillsProduction Fastify (TypeScript) patterns: schema validation, plugins, typed routes, error handling, security hardening, logging, testing with inject, and gracef582skills.sh installs

5agent-native-architectureeveryinc/compound-engineering-pluginBuild applications where agents are first-class citizens. Use this skill when designing autonomous agents, creating MCP tools, implementing self-modifying syste581skills.sh installs

6spec-to-repoalirezarezvani/claude-skillsUse when the user says 'build me an app', 'create a project from this spec', 'scaffold a new repo', 'generate a starter', 'turn this idea into code', 'bootstrap578skills.sh installs