Search & Web Crawling MCP Servers
1,212 Search & Web Crawling MCP servers for Claude Code, recommended first
Sponsors
Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthly
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any language
Agent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any languageShowing 1 to 48 of 1,212
Stars1
Brave Searchpipeworx-io/mcp-brave-searchBrave Search MCP — independent web index (no Google/Bing dependency)0stars
Brave Searchpipeworx-io/mcp-brave-searchBrave Search MCP — independent web index (no Google/Bing dependency)0stars2
HasData Google Search (SERP)hasdata/google-search-mcpGoogle SERP as JSON: organic, AI Overview, People Also Ask, AI Mode, news, shopping. No Cloud setup.14stars
HasData Google Search (SERP)hasdata/google-search-mcpGoogle SERP as JSON: organic, AI Overview, People Also Ask, AI Mode, news, shopping. No Cloud setup.14stars3
Google Search Consoleacamolese/google-search-console-mcpGoogle Search Console: SEO audits, performance queries, URL inspection, indexing checks.9stars
Google Search Consoleacamolese/google-search-console-mcpGoogle Search Console: SEO audits, performance queries, URL inspection, indexing checks.9stars4
Google Search Consolesarahpark/google-search-console-mcpGoogle Search Console MCP server — search analytics, URL inspection, and sitemaps9stars
Google Search Consolesarahpark/google-search-console-mcpGoogle Search Console MCP server — search analytics, URL inspection, and sitemaps9stars5
MCP Google Search Consolecrunchtools/mcp-google-search-consoleSecure MCP server for Google Search Console analytics, sitemaps, and URL inspection0stars
MCP Google Search Consolecrunchtools/mcp-google-search-consoleSecure MCP server for Google Search Console analytics, sitemaps, and URL inspection0stars6
Brave Search Mcp Serverbrave/brave-search-mcp-serverBrave Search MCP Server: web results, images, videos, rich results, AI summaries, and more.1.6Kstars
Brave Search Mcp Serverbrave/brave-search-mcp-serverBrave Search MCP Server: web results, images, videos, rich results, AI summaries, and more.1.6Kstars7
Google Search Console MCP Server and API by Cotletcotlet-connect/google-search-console-mcpGoogle Search Console website search performance monitoring MCP server: request indexing.0stars
Google Search Console MCP Server and API by Cotletcotlet-connect/google-search-console-mcpGoogle Search Console website search performance monitoring MCP server: request indexing.0stars8
Firecrawl MCP Serverfirecrawl/firecrawl-mcp-serverFirecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.7.8Kstars
Firecrawl MCP Serverfirecrawl/firecrawl-mcp-serverFirecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.7.8Kstars9
Exa Searchpollinations/pollinationsSearch the live web and fetch clean content from source pages.5.3Kstars
Exa Searchpollinations/pollinationsSearch the live web and fetch clean content from source pages.5.3Kstars10
ShadowCrawldevshero/shadowcrawlStealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.66stars
ShadowCrawldevshero/shadowcrawlStealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.66stars11Firecrawlpipeworx-io/mcp-firecrawlFirecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling / search…1stars
Firecrawlpipeworx-io/mcp-firecrawlFirecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling / search…1stars
13
DuckDuckGonickclyde/duckduckgo-mcp-serverProvides web search and content extraction via DuckDuckGo, with rate limiting, error handling, and LLM‑friendly output.1.1Kstars
DuckDuckGonickclyde/duckduckgo-mcp-serverProvides web search and content extraction via DuckDuckGo, with rate limiting, error handling, and LLM‑friendly output.1.1Kstars14
One Search Mcpyokingma/one-search-mcpWeb search, URL discovery, scraping & extraction with agent-browser and search providers148stars
One Search Mcpyokingma/one-search-mcpWeb search, URL discovery, scraping & extraction with agent-browser and search providers148stars15
Searxng Mcpaicrafted/searxng-mcpMCP server for SearXNG aggregator — web search across multiple engines via Model Context Protocol7stars
Searxng Mcpaicrafted/searxng-mcpMCP server for SearXNG aggregator — web search across multiple engines via Model Context Protocol7stars16
AgentScrapehshintelligence/agent-scrapePay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.1stars
AgentScrapehshintelligence/agent-scrapePay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.1stars17
Code Indexachreftlili/code-indexSQLite-backed hybrid (vector + FTS) code search index for Claude Code over MCP.0stars
Code Indexachreftlili/code-indexSQLite-backed hybrid (vector + FTS) code search index for Claude Code over MCP.0stars
19
Exaexa-labs/exa-mcp-serverConnect AI agents to Exa for web search, content fetching, and multi-step research.5.2Kstars
Exaexa-labs/exa-mcp-serverConnect AI agents to Exa for web search, content fetching, and multi-step research.5.2Kstars20
SearXNG Searchihor-sokoliuk/mcp-searxngMCP server for SearXNG — privacy-respecting web search with pagination, URL reading1.4Kstars
SearXNG Searchihor-sokoliuk/mcp-searxngMCP server for SearXNG — privacy-respecting web search with pagination, URL reading1.4Kstars21
Code Indexjohnhuang316/code-index-mcpA Model Context Protocol (MCP) server that helps large language models index, search, and analyze code repositories with minimal setup942stars
Code Indexjohnhuang316/code-index-mcpA Model Context Protocol (MCP) server that helps large language models index, search, and analyze code repositories with minimal setup942stars22
Search Console MCPsaurabhsharma2u/search-console-mcpGoogle Search Console + Bing + GA4 + AdSense — unified SEO intelligence for AI agents.320stars
Search Console MCPsaurabhsharma2u/search-console-mcpGoogle Search Console + Bing + GA4 + AdSense — unified SEO intelligence for AI agents.320stars23
iFlow Searchzhengyanglsun/iflow-search-jsMCP server for iFlow Search web search, image search, and URL fetch tools.0stars
iFlow Searchzhengyanglsun/iflow-search-jsMCP server for iFlow Search web search, image search, and URL fetch tools.0stars24HasData DuckDuckGohasdata/duckduckgo-mcpDuckDuckGo search as JSON. Ranked results, ads in their own array, 37 regions.7stars
HasData DuckDuckGohasdata/duckduckgo-mcpDuckDuckGo search as JSON. Ranked results, ads in their own array, 37 regions.7stars25HasData Web Scrapinghasdata/web-scraping-mcpFetch any public web page through managed proxies, with optional JS rendering and extraction rules.7stars
HasData Web Scrapinghasdata/web-scraping-mcpFetch any public web page through managed proxies, with optional JS rendering and extraction rules.7stars26HasData Binghasdata/bing-mcpBing search results with the ad block and Copilot answer, geo and market targeting, as JSON.5stars
HasData Binghasdata/bing-mcpBing search results with the ad block and Copilot answer, geo and market targeting, as JSON.5stars27
paper-search-mcp-openai-v2titansneaker/paper-search-mcp-openaiFind and download academic papers from leading sources like arXiv, PubMed, bioRxiv, medRxiv, Google Scholar, Semantic Scholar, CrossRef, and IACR. Get standardi4stars
paper-search-mcp-openai-v2titansneaker/paper-search-mcp-openaiFind and download academic papers from leading sources like arXiv, PubMed, bioRxiv, medRxiv, Google Scholar, Semantic Scholar, CrossRef, and IACR. Get standardi4stars
29
X402search Mcpx402-index/x402search-mcpSearch 13,000+ x402-enabled APIs from your AI agent. Powered by x402search.xyz1stars
X402search Mcpx402-index/x402search-mcpSearch 13,000+ x402-enabled APIs from your AI agent. Powered by x402search.xyz1stars31Jina Readerpipeworx-io/mcp-jina-readerJina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.0stars
Jina Readerpipeworx-io/mcp-jina-readerJina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.0stars32
Mifactory Scraping Apimifactory-bot/mifactory-scraping-apiWeb scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.0stars
Mifactory Scraping Apimifactory-bot/mifactory-scraping-apiWeb scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.0stars33
Crawl4AI RAGcoleam00/mcp-crawl4ai-ragProvides web crawling, RAG, and knowledge-graph capabilities for AI agents with a Supabase-backed vector store.2.2Kstars
Crawl4AI RAGcoleam00/mcp-crawl4ai-ragProvides web crawling, RAG, and knowledge-graph capabilities for AI agents with a Supabase-backed vector store.2.2Kstars34
Web Searchmrkrsl/web-search-mcpProvides multi-engine web search with full-page extraction for local LLM workflows and quick summaries.862stars
Web Searchmrkrsl/web-search-mcpProvides multi-engine web search with full-page extraction for local LLM workflows and quick summaries.862stars35
Defuddle Fetchdomdomegg/defuddle-fetch-mcp-serverFetch content from the web, cleaned up nicely for LLMs (using Defuddle).6stars
Defuddle Fetchdomdomegg/defuddle-fetch-mcp-serverFetch content from the web, cleaned up nicely for LLMs (using Defuddle).6stars36
SourceWeave Web Searchmrnaqa/sourceweave-web-searchFully local MCP server and CLI for web research2stars
SourceWeave Web Searchmrnaqa/sourceweave-web-searchFully local MCP server and CLI for web research2stars
40
code-indexregsorm/code-index-mcpRust code index MCP server, native 1C:Enterprise (BSL) support. 37 tools, AST for 14 languages.161stars
code-indexregsorm/code-index-mcpRust code index MCP server, native 1C:Enterprise (BSL) support. 37 tools, AST for 14 languages.161stars41
Mcp Codebase Indexmikerecognex/mcp-codebase-indexStructural codebase indexer with 17 query tools. 87% token reduction. Zero dependencies.56stars
Mcp Codebase Indexmikerecognex/mcp-codebase-indexStructural codebase indexer with 17 query tools. 87% token reduction. Zero dependencies.56stars42
Adamamer20 Paper Search Mcp Openaiadamamer20/paper-search-mcp-openaiSearch and download academic papers from arXiv, PubMed, bioRxiv, medRxiv, Google Scholar, Semantic…13stars
Adamamer20 Paper Search Mcp Openaiadamamer20/paper-search-mcp-openaiSearch and download academic papers from arXiv, PubMed, bioRxiv, medRxiv, Google Scholar, Semantic…13stars43
TranscriptAPI: YouTube Transcript and Search MCPzeropointrepo/youtube-mcpTranscriptAPI.com: hosted YouTube transcripts, search, channels and playlists for AI agents13stars
TranscriptAPI: YouTube Transcript and Search MCPzeropointrepo/youtube-mcpTranscriptAPI.com: hosted YouTube transcripts, search, channels and playlists for AI agents13stars44
Web Fetch Mcpkylinmountain/web-fetch-mcpMCP server for web content fetching, summarizing, comparing, and extracting information8stars
Web Fetch Mcpkylinmountain/web-fetch-mcpMCP server for web content fetching, summarizing, comparing, and extracting information8stars45
SearXNG HTTP MCPwhw23/searxng_http_mcpSelf-contained SearXNG metasearch MCP server. One Docker image, 200+ engines, privacy-first.8stars
SearXNG HTTP MCPwhw23/searxng_http_mcpSelf-contained SearXNG metasearch MCP server. One Docker image, 200+ engines, privacy-first.8stars46
Code Indextrondhindenes/code-index-mcpFast local source code searching using Zoekt trigram-based indexing6stars
Code Indextrondhindenes/code-index-mcpFast local source code searching using Zoekt trigram-based indexing6stars47
Bing Adsmharnett/mcp-bing-adsMCP server for Microsoft Advertising (Bing Ads) — campaigns, keywords, and reports2stars
Bing Adsmharnett/mcp-bing-adsMCP server for Microsoft Advertising (Bing Ads) — campaigns, keywords, and reports2stars48
ScrapeBadgerscrape-badger/scrapebadger-mcpTwitter/X, Google, Facebook Marketplace, Yelp, GitHub and AutoScout24 for AI agents.2stars
ScrapeBadgerscrape-badger/scrapebadger-mcpTwitter/X, Google, Facebook Marketplace, Yelp, GitHub and AutoScout24 for AI agents.2starsQuestions
How do search MCP servers differ from browser automation?
Search MCP servers provide structured search results through APIs. They're faster and more reliable for finding information. Browser automation servers control a full browser for interactive tasks. Use search servers when you need to find information; use browser servers when you need to interact with a specific website.
Which search providers are available?
You'll find servers for Exa, Tavily, DuckDuckGo, Brave Search, SearXNG, and Google Search API, among others. Crawling tools like Crawl4AI, Firecrawl, and Jina are also available for extracting content from specific URLs.
Can Claude crawl entire websites?
Yes, crawling MCP servers like Crawl4AI and Firecrawl can traverse websites, follow links, and extract structured content. They're useful for building datasets, monitoring changes, and indexing content.
All 1212 Search & Web Crawling MCP servers →