MCP Servers

Playwright MCP server

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Crawlie

Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.

Inspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives

260 MCP tools across 49 domains. AI Flywheel, quality gates, research, web scraping.

Fetch any URL and get clean Markdown. Web scraping for AI agents.

x402-gated web extraction gateway. Tools: extract, extract_batch.

Fetch, crawl, and search the web: Google, Amazon, Walmart, Booking.com, Agoda, and YouTube data.

Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.

Scrape and analyze public LinkedIn posts as structured JSON via the Apify LinkedIn Posts API.

Build, deploy, and run web scraping and automation actors in the cloud

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

Greet anyone by name with a friendly hello. Scrape webpages to extract content for quick reference…

Token-budgeted web fetch for AI agents — auto-routes Jina, FireCrawl, Trafilatura, PDF.

Deterministic web tools for AI agents: read URLs, metadata, email, scrape, RSS, DNS, SSL, HTTP.

One MCP for the Web. Easily search, crawl, navigate, and extract websites without getting blocked.…

Cloudflare Workers MCP server: ai-crawler-policy

Call 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key

Send quick greetings, scrape website content, and generate text or images on demand. Perform web s…

Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.

Twitter/X scraping API for AI agents. Get profiles, tweets, trends, and more.

Agent-native internet gateway: typed search, fetch, scrape, crawl, and extract via the Clawifi API.

Robots-aware website audits, pre-crawl quotes, and structured evidence for people and agents.

Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.