Just Scrape

If you need Claude to pull data from the web without you manually copying HTML or dealing with API docs, this wraps the ScrapeGraph AI CLI into a tight workflow. It handles the usual progression: search when you don't have a URL yet, scrape when you do, extract for structured JSON with AI prompts, crawl for bulk documentation grabs, and monitor for recurring change tracking. The skill doc is thorough about avoiding redundant fetches and includes the full command reference with schema support, stealth mode, and credit management. Requires an npm install and a ScrapeGraph API key. Good for research tasks, competitor monitoring, or any time you'd rather delegate web scraping to Claude than write another Beautiful Soup script.

install copies · 90 days. Times the install command was copied on this site in the last 90 days, bots filtered.: 26
skills.sh installs: 245K
GitHub stars: 76
last updated: Aug 21, 2026

View on GitHub

Install

$ npx -y skills add scrapegraphai/just-scrape --skill just-scrape --agent claude-code

Installs into .claude/skills of the current project.

Files

just-scrape CLI

Search, scrape, crawl, extract structured JSON, and monitor page changes using the just-scrape CLI.

Run just-scrape --help or just-scrape <command> --help for full option details.

If the task is to integrate ScrapeGraph AI into application code, add SGAI_API_KEY to a project, or choose endpoint usage in product code, inspect the project first and use the ScrapeGraph AI SDK/API docs directly instead of this CLI skill.

Prerequisites

Must be installed and authenticated. Check with just-scrape validate and just-scrape credits.

command -v just-scrape >/dev/null 2>&1 || npm install -g just-scrape@latest
just-scrape validate
just-scrape credits

API key: Set SGAI_API_KEY, use a .env file, use ~/.scrapegraphai/config.json, or complete the interactive prompt.
Credits: Remaining ScrapeGraph AI credits. Each operation consumes credits.

Before doing real work, verify the setup with one small request:

mkdir -p .just-scrape
just-scrape scrape "https://example.com" --json > .just-scrape/install-check.json

just-scrape search "query" --num-results 3 --json > .just-scrape/search-check.json

Workflow

SKILL.md on GitHub

Details

Repository: github.com/scrapegraphai/just-scrape
Categories: Backend & APIs, DevOps & CI/CD, Documentation, Marketing & SEO, CLI & Terminal
First seen: May 16, 2026