x-monk avatar

Webshift

x-monk/webshift

WebShift gives Claude web search that returns clean text, not raw HTML garbage. It runs as a native Rust binary and exposes three tools: webshift_query for full search pipelines (search, fetch, clean, rerank), webshift_fetch for single-page grabs, and webshift_onboarding for configuration help. The pipeline strips scripts, ads, and navigation bloat, then uses BM25 reranking to surface relevant content within strict token budgets. You can plug in SearXNG locally via Docker or use cloud backends like Brave, Tavily, Exa, or SerpAPI. If you need Claude to search the web without flooding context windows with markup noise, this is the tool. No Python runtime, no dependencies, just a single static binary.

GitHub stars
7
tools
3
last updated
Apr 1, 2026

Tools

3 tools

Public tool metadata for what this MCP can expose to an agent.

webshift_queryFull search pipeline: search + fetch + clean + rerank + (optional) summarize

Full search pipeline: search + fetch + clean + rerank + (optional) summarize

No parameter schema in public metadata yet.

webshift_fetchSingle page fetch and clean

Single page fetch and clean

No parameter schema in public metadata yet.

webshift_onboardingReturns a JSON guide for the agent (budgets, backends, tips)

Returns a JSON guide for the agent (budgets, backends, tips)

No parameter schema in public metadata yet.

Sponsors

Readme

WebShift

Crates.io docs.rs Latest Release Beta License


What is WebShift

WebShift is a Rust library and MCP server that shifts noisy web pages into clean, right-sized text for LLM consumption.

Raw HTML is mostly junk: scripts, ads, navigation menus, cookie banners, tracking pixels. Feeding it directly to an LLM floods the context window with tens of thousands of useless tokens and leaves no room for reasoning. WebShift strips all that noise, sterilizes the text, and enforces strict


View the full README on GitHub

Details

Repository
github.com/x-monk/webshift
Category
Search & Web Crawling
Registry
MCP registry, active

Related Search & Web Crawling MCP servers

View all
1ksimback avatarHermes Atlas Mcpksimback/hermes-atlas-mcpSearch and fetch 100+ Hermes Agent tools, skills, plugins, and integrations from hermesatlas.com.6stars
2skymoore avatargrokipedia-mcpskymoore/grokipedia-mcpSearch and retrieve Grokipedia articles with filters, full content, and citations. Explore related pages and extract sections to quickly gather relevant knowled6stars
3kwp-lab avatarKwp Lab Rss Reader Mcpkwp-lab/rss-reader-mcpTrack and browse RSS feeds with ease. Fetch the latest entries from any feed URL and extract full…5stars
4leandrogavidia avatarLeandrogavidia Vechain Mcp Serverleandrogavidia/vechain-mcp-serverSearch VeChain documentation, query on-chain data, and fetch fee suggestions with direct links to…5stars
5cyanheads avatarNoaa Cdo Mcp Servercyanheads/noaa-cdo-mcp-serverSearch NOAA CDO stations and datasets, fetch historical weather observations.5stars
6fato07 avatarLog Analyzer Mcpfato07/log-analyzer-mcpAI-powered log analysis - parse, search, extract errors across 9+ formats5stars