Claude MarketplacesSubmit
carrasquelalex1 avatar

Webscrape Mcp

carrasquelalex1/webscrape-mcp

Connects your LLM to the web with three straightforward tools: webscrape_search queries DuckDuckGo and returns scraped results as Markdown, webscrape_fetch_url grabs a single page with optional Readability mode to strip nav and ads, and webscrape_batch_fetch handles up to five URLs in parallel. PDF detection is automatic, so URLs ending in .pdf get text extracted page by page via PyMuPDF. Built-in 200-entry cache for repeated requests. Reach for this when you need clean, LLM-ready content from arbitrary URLs without managing BeautifulSoup pipelines yourself. Hosted on Render for quick testing or run locally with the Python source.

tools
4
transport
HTTP
last updated
Jun 7, 2026
View on GitHub

Tools

4 tools

Public tool metadata for what this MCP can expose to an agent.

webscrape_fetch_urlFetch a single URL and return clean Markdown. Supports use_readability, js_render, extract_schema, and auto-detects PDFs

Fetch a single URL and return clean Markdown. Supports use_readability, js_render, extract_schema, and auto-detects PDFs

No parameter schema in public metadata yet.

webscrape_batch_fetchFetch up to 5 URLs in parallel. Supports PDF auto-detection, JS rendering, and structured data

Fetch up to 5 URLs in parallel. Supports PDF auto-detection, JS rendering, and structured data

No parameter schema in public metadata yet.

webscrape_searchSearch the web (DuckDuckGo → Google → Bing fallback) and scrape results into Markdown

Search the web (DuckDuckGo → Google → Bing fallback) and scrape results into Markdown

No parameter schema in public metadata yet.

webscrape_screenshotCapture a screenshot of any web page with headless Chromium. Supports PNG/JPEG, viewport sizing, and full-page capture

Capture a screenshot of any web page with headless Chromium. Supports PNG/JPEG, viewport sizing, and full-page capture

No parameter schema in public metadata yet.

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Readme

WebScrape MCP Server

English · Español

English

MCP server that lets AI agents search the web and extract clean Markdown content — no ads, no clutter, just the text your LLM needs.

What's New in v2.0.0

New features:

  • JS rendering — Render JavaScript-heavy sites with Playwright (Chromium headless). Auto-fallback when httpx gets 403 or empty content
  • Structured data extraction — Extract JSON-LD, Open Graph, Twitter Cards, meta tags, canonical URLs, and hreflang links with extract_schema=True
  • Screenshots — New webscrape_screenshot tool captures page screenshots with configurable viewport, full-page mode, and PNG/JPEG format
  • Multi-engine search — DuckDuckGo primary, automatic fallback to Google and Bing if DDGS is unavailable
  • Smart truncation — Content is truncated at paragraph/sentence boundaries instead of mid-word

Improvements:

  • Enhanced cache: 500 entries with 15-minute TTL (was 200, no expiry)
  • Better error handling with specific messages for 403, 404, 429, timeouts
  • Updated Dockerfile with Chromium dependencies for Playwright

Tools

View the full README on GitHub

Details

Repository
github.com/carrasquelalex1/webscrape-mcp
Categories
Documents & Knowledge, Search & Web Crawling
Transport
HTTP
Registry
MCP registry, active

Related Documents & Knowledge MCP servers

View all
1clichefactory avatarClicheFactory Document Intelligenceclichefactory/clichefactory-mcpExtract structured JSON from PDFs, images, DOCX, XLSX, CSV, EML attachments, and DSPy pipelines.0stars
2iterationlayer avatarIteration Layeriterationlayer/iterationlayerComposable APIs for document extraction, image transformation, and document & sheet generation.0stars
3quelvio avatarMcp Serverquelvio/quelvio-mcp-serverYour company's brain for AI agents. Cited, permission-aware knowledge across every system.0stars
4defibabylon avatardefi-inteldefibabylon/defi-intelOperator-grade DeFi intelligence MCP. - 10 tools vs DefiLlama's basic 4, - adds governance proposals, - RWA attestation scores, - live X/Twitter narrative. - No0stars
5kamy-development avatarKamykamy-development/kamy-pluginDocument API for AI-native software: render PDFs, e-sign, PAdES-seal, and verify.0stars
6edkarlsson avatarLocusedkarlsson/locusHierarchical markdown memory palace for AI agents — structured palace navigation via MCP tools.0stars