A

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)

MCP server · by foomworks

Web APIs Streamable HTTP v0.2.1

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

View source ↗ Website ↗ More servers

Install

Run one of the commands below, then add the client config underneath.

Streamable HTTPhttps://agent-web.foomworks.workers.dev/mcp

Client configuration

Paste into Claude Desktop, Cursor (mcp.json), VS Code or any MCP client, then restart the client.

mcpServers{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

About this server

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) is listed in the Web APIs category of the MCPNav directory. It is distributed as Streamable HTTP and can be loaded by any client that speaks the Model Context Protocol.

Typical uses include giving your assistant scoped access to the corresponding service so it can answer questions and take actions with real data instead of guessing. Always review what a server can access before you enable it — see our MCP security guide.

Frequently asked questions

What is the agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) MCP server?

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) is an MCP server by foomworks. URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

How do I install agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

Install it with: https://agent-web.foomworks.workers.dev/mcp. Then add the JSON config to your client's MCP settings and restart the client.

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) free to use?

The MCP server itself is free to install. The source is public on https://github.com/foomworks/agent-web. Any third-party API it calls (such as a search or maps API) may require its own key and billing.

Which clients support agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

Any MCP-compatible client can use it, including Claude Desktop, Cursor, VS Code, Windsurf and custom agents.