RAG Documentation Scraper

Knowledge & Memory npm v1.0.0

Crawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata.

View source ↗ Generate config for multiple servers More servers

Install

Pin version registry version 1.0.0

npm
npx -y rag-docs-scraper-mcp-server

npm
npx -y rag-docs-scraper-mcp-server@1.0.0

Setup by client

Pick your client — the config below is generated for this server (local stdio). Copy respects the “Pin version” switch above.

claude_desktop_config.json

{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server@1.0.0"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

Format verified against the official Claude Desktop docs ↗.

terminal

claude mcp add --env APIFY_TOKEN=<YOUR_APIFY_TOKEN> rag-docs-scraper -- npx -y rag-docs-scraper-mcp-server

claude mcp add --env APIFY_TOKEN=<YOUR_APIFY_TOKEN> rag-docs-scraper -- npx -y rag-docs-scraper-mcp-server@1.0.0

Format verified against the official Claude Code docs ↗.

.cursor/mcp.json

{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server@1.0.0"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

Format verified against the official Cursor docs ↗.

.vscode/mcp.json

{
  "servers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

{
  "servers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server@1.0.0"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

Format verified against the official VS Code docs ↗.

mcp_config.json

{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server@1.0.0"
      ],
      "env": {
        "APIFY_TOKEN": "<YOUR_APIFY_TOKEN>"
      }
    }
  }
}

Format verified against the official Windsurf docs ↗.

Environment variables

Defined in the server's official registry manifest. Required secrets are shown as <YOUR_…> placeholders in the configs above.

APIFY_TOKEN required secret — Your Apify API token — https://console.apify.com/account/integrations

About this server

Distributed as npm, listed under Knowledge & Memory. Review our MCP security guide before granting access to real data.

Frequently asked questions

How do I install RAG Documentation Scraper?

Run the install command shown above, then paste the config for your client (Claude Desktop, Claude Code, Cursor, VS Code or Windsurf) into its MCP settings and restart the client.

Is RAG Documentation Scraper free to use?

The MCP server itself is free to install. The source is public on https://github.com/LernowaAdmin/rag-docs-scraper. Any third-party service it calls may require its own API key and account.

Which clients support RAG Documentation Scraper?

Any MCP-compatible client can use it, including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf and custom agents.

Add this badge

Publish this server? Link back with a badge on your README or site — copy either snippet.

Markdown

[![Listed on MCPNav](https://mcpnav.net/badge/rag-docs-scraper.svg)](https://mcpnav.net/server/rag-docs-scraper/)

HTML

<a href="https://mcpnav.net/server/rag-docs-scraper/"><img src="https://mcpnav.net/badge/rag-docs-scraper.svg" alt="Listed on MCPNav" height="20"></a>