Crawlie

MCP server · by crawlie

Maps & Location Streamable HTTP v0.1.0

Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.

View source ↗ Website ↗ Generate config for multiple servers More servers

Install

Pin version unavailable — hosted endpoints aren’t versioned

Streamable HTTP
https://crawlie.app/mcp

Setup by client

Pick your client — the config below is generated for this server (hosted endpoint). Copy respects the “Pin version” switch above.

Remote (hosted) endpoint

https://crawlie.app/mcp

Claude Desktop: Settings → Connectors → Add custom connector, paste this URL.

Format verified against the official Claude Desktop docs ↗.

terminal

claude mcp add --transport http crawlie https://crawlie.app/mcp

Format verified against the official Claude Code docs ↗.

.cursor/mcp.json (hosted endpoint)

{
  "mcpServers": {
    "crawlie": {
      "url": "https://crawlie.app/mcp"
    }
  }
}

Format verified against the official Cursor docs ↗.

.vscode/mcp.json (hosted endpoint)

{
  "servers": {
    "crawlie": {
      "type": "http",
      "url": "https://crawlie.app/mcp"
    }
  }
}

Format verified against the official VS Code docs ↗.

mcp_config.json (hosted endpoint)

{
  "mcpServers": {
    "crawlie": {
      "serverUrl": "https://crawlie.app/mcp"
    }
  }
}

Format verified against the official Windsurf docs ↗.

GitHub

⭐ 114 stars · 最近更新于 103 天前

About this server

crawlie The fast, free, open source technical SEO + GEO crawler — built for humans and agents. Crawl any site for broken links, redirects, missing metadata, and 40+ SEO & Generative Engine checks — with plain English guidance on every fix. Runs locally, ships a CLI and an MCP ser…

Summary from the project README — github.com/spronta/crawlie

Distributed as Streamable HTTP, listed under Maps & Location. Review our MCP security guide before granting access to real data.

Frequently asked questions

What does the Crawlie MCP server do?

How do I install Crawlie?

Run the install command shown above, then paste the config for your client (Claude Desktop, Claude Code, Cursor, VS Code or Windsurf) into its MCP settings and restart the client.

Is Crawlie free to use?

The MCP server itself is free to install. The source is public on https://github.com/spronta/crawlie. Any third-party service it calls may require its own API key and account.

Which clients support Crawlie?

Any MCP-compatible client can use it, including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf and custom agents.

Add this badge

Publish this server? Link back with a badge on your README or site — copy either snippet.

Markdown

[![Listed on MCPNav](https://mcpnav.net/badge/crawlie.svg)](https://mcpnav.net/server/crawlie/)

HTML

<a href="https://mcpnav.net/server/crawlie/"><img src="https://mcpnav.net/badge/crawlie.svg" alt="Listed on MCPNav" height="20"></a>