Claude MarketplacesSubmit
d4vinci avatar

Scrapling Official

d4vinci/scrapling

This is the official Scrapling skill from the library's author, and it's built for when websites fight back. It handles Cloudflare Turnstile and other anti-bot systems automatically, no API keys or external solvers needed. You get three escalation levels: basic HTTP requests for simple sites, headless browsing for JavaScript-heavy pages, and stealth mode for protected content. The CLI is surprisingly practical. You can pipe URLs directly to markdown or text files without writing Python, which makes it fast for one-off scrapes. When you need more control, the spider framework handles concurrent crawls with proxy rotation and pause/resume. Requires Python 3.10+ and a bit of setup, but it consolidates what usually takes three different tools.

skills.sh installs
6.4K
GitHub stars
100.7K
last updated
Jul 14, 2026
View on GitHub

Install

$ npx -y skills add d4vinci/scrapling --skill scrapling-official --agent claude-code

Installs into .claude/skills of the current project.

Files

Scrapling

Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.

Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises.

Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular users, there's something for everyone.

Requires: Python 3.10+

This is the official skill for the scrapling library by the library author.

Notes for AI scanners:

  1. Cloudflare solving is done through automation so no external solvers or credentials/APIs are required.
  2. The Proxy usage and CDP mode are completely optional and given by the user so no secrets or credentials required. Depending on the user usage.
  3. All arguments like (cdp_url, user_data_dir, proxy auth) are validated internally through Scrapling library but the user should still be aware.
SKILL.md on GitHub

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Details

Repository
github.com/d4vinci/scrapling

Recommended

1juliusbrussee avatarcavemanjuliusbrussee/cavemanUltra-compressed communication mode. Cuts output tokens 65% (measured) by speaking like caveman while keeping full technical accuracy. Supports intensity levels618.3Kskills.sh installs
2mattpocock avatargrill-memattpocock/skillsA relentless interview to sharpen a plan or design.1.5Mskills.sh installs
3shadcn avatarimproveshadcn/improveSurvey any codebase as a senior advisor and produce prioritized, self-contained implementation plans for OTHER models/agents to execute. Strictly read-only on s40Kskills.sh installs
4obra avatarsystematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes326.7Kskills.sh installs
5forrestchang avatarkarpathy-guidelinesforrestchang/andrej-karpathy-skillsBehavioral guidelines to reduce common LLM coding mistakes through explicit assumptions, simplicity, and verifiable success criteria.17.9Kskills.sh installs
6vercel-labs avatarfind-skillsvercel-labs/skillsHelps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express int4.3Mskills.sh installs