Webshift
A Rust-based MCP server that turns messy web search results into clean, token-budgeted text ready for LLM consumption. It exposes three tools: webshift_query for full search pipelines (search, fetch, clean, BM25 rerank, optional summarization), webshift_fetch for single-page cleaning, and webshift_onboarding for agent configuration guidance. Supports eight search backends including SearXNG, Brave, Tavily, and Google, with hard caps on download size, per-page character limits, and total result budgets. Strips HTML noise (scripts, ads, nav elements), sterilizes Unicode and BiDi text, and enforces strict output sizes so you don't flood context windows. Ships as a single static binary with zero runtime dependencies. Reach for this when your agent needs web search that respects token budgets and delivers clean text instead of raw HTML soup.
- GitHub stars
- 7
- tools
- 3
- last updated
- May 9, 2026
Tools
3 toolsPublic tool metadata for what this MCP can expose to an agent.
webshift_queryFull search pipeline: search + fetch + clean + rerank + (optional) summarize
Full search pipeline: search + fetch + clean + rerank + (optional) summarize
No parameter schema in public metadata yet.
webshift_fetchSingle page fetch and clean
Single page fetch and clean
No parameter schema in public metadata yet.
webshift_onboardingReturns a JSON guide for the agent (budgets, backends, tips)
Returns a JSON guide for the agent (budgets, backends, tips)
No parameter schema in public metadata yet.
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageReadme
WebShift
What is WebShift
WebShift is a Rust library and MCP server that shifts noisy web pages into clean, right-sized text for LLM consumption.
Raw HTML is mostly junk: scripts, ads, navigation menus, cookie banners, tracking pixels. Feeding it directly to an LLM floods the context window with tens of thousands of useless tokens and leaves no room for reasoning. WebShift strips all that noise, sterilizes the text, and enforces strict
Details
- Repository
- github.com/x-hannibal/webshift
- Category
- Search & Web Crawling
- Registry
- MCP registry, active
Related Search & Web Crawling MCP servers
View all
Webshiftx-monk/webshiftRust MCP server for denoised web search — fetch, clean, and rerank web content for AI agents.7stars
Hermes Atlas Mcpksimback/hermes-atlas-mcpSearch and fetch 100+ Hermes Agent tools, skills, plugins, and integrations from hermesatlas.com.6stars
grokipedia-mcpskymoore/grokipedia-mcpSearch and retrieve Grokipedia articles with filters, full content, and citations. Explore related pages and extract sections to quickly gather relevant knowled6stars
Kwp Lab Rss Reader Mcpkwp-lab/rss-reader-mcpTrack and browse RSS feeds with ease. Fetch the latest entries from any feed URL and extract full…5stars
Leandrogavidia Vechain Mcp Serverleandrogavidia/vechain-mcp-serverSearch VeChain documentation, query on-chain data, and fetch fee suggestions with direct links to…5stars
Noaa Cdo Mcp Servercyanheads/noaa-cdo-mcp-serverSearch NOAA CDO stations and datasets, fetch historical weather observations.5stars