Skip to content

crawlforge-mcp-server

CrawlForge MCP Server - Professional Model Context Protocol server with 26 web scraping, crawling, deep-research, and autonomous-extraction tools. Returns clean Markdown and structured JSON for Claude, Cursor, and any MCP client. Defaults to local Ollama

478
Weekly Downloads
build.protocol_tooling.mcp#mcp#model-context-protocol#web-scraping#scraper#html-parser#metadata-extraction#link-extraction#content-processing#document-analysis#web-crawler

Install crawlforge-mcp-server in your MCP client

crawlforge-mcp-server is a Model Context Protocol server. Add it to your MCP client config once, restart, and the server's tools become available to your AI assistant. The same JSON snippet below works across all four major clients — only the config file path differs.

  1. Locate your client's MCP config file.
    • Cursor: ~/.cursor/mcp.json
    • Claude Desktop (macOS): ~/Library/Application Support/Claude/claude_desktop_config.json
    • Claude Desktop (Windows): %APPDATA%\Claude\claude_desktop_config.json
    • VS Code: Settings → Extensions → MCP
    • Windsurf: Settings → MCP Servers
  2. Add crawlforge-mcp-server to the mcpServers map — paste the snippet below into your config file. If you already have other MCP servers, merge the entry into the existing mcpServers object.
  3. Restart your client so it picks up the new server.
  4. Verify — ask the assistant to list available tools; crawlforge-mcp-server's tools should appear.
{
  "mcpServers": {
    "crawlforge-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "crawlforge-mcp-server"
      ]
    }
  }
}

Install crawlforge-mcp-server in Cursor

Open ~/.cursor/mcp.json in your editor, paste the snippet above into mcpServers, save, and restart Cursor. crawlforge-mcp-server will show up in the assistant's tool list on next launch.

Install crawlforge-mcp-server in Claude Desktop (macOS)

Open ~/Library/Application Support/Claude/claude_desktop_config.json in your editor, paste the snippet above into mcpServers, save, and restart Claude Desktop (macOS). crawlforge-mcp-server will show up in the assistant's tool list on next launch.

Install crawlforge-mcp-server in Claude Desktop (Windows)

Open %APPDATA%\Claude\claude_desktop_config.json in your editor, paste the snippet above into mcpServers, save, and restart Claude Desktop (Windows). crawlforge-mcp-server will show up in the assistant's tool list on next launch.

Install crawlforge-mcp-server in VS Code

Open Settings → Extensions → MCP in your editor, paste the snippet above into mcpServers, save, and restart VS Code. crawlforge-mcp-server will show up in the assistant's tool list on next launch.

npm package: crawlforge-mcp-server

Transport

crawlforge-mcp-server supports the following MCP transports. Most AI clients use stdio by default for locally-installed servers.

stdio

From the crawlforge-mcp-server README

<p align="center"> <img src="https://raw.githubusercontent.com/mysleekdesigns/crawlforge-mcp/main/assets/banner.jpg" alt="CrawlForge MCP Server" width="640"> </p> <p align="center"> <b>26 web scraping, crawling, deep-research &amp; autonomous-extraction tools for Claude, Cursor &amp; any MCP client.</b><br> Clean Markdown &amp; structured JSON from any site. Get started with <b>1,000 free credits</b> — no credit card required. </p> <p align="center"> <a href="https://opensource.org/licenses/MIT"><img src="https://img.shields.io/badge/License-MIT-yellow.svg" alt="License: MIT"></a> <a href="https://nodejs.org/"><img src="https://img.shields.io/badge/node-%3E%3D18.0.0-brightgreen" alt="Node.js Version"></a> <a href="https://modelcontextprotocol.io/"><img src="https://img.shield

Other Model Context Protocol servers in the same space as crawlforge-mcp-server. Each one adds different capabilities to your AI assistant — pick based on the data sources or workflows you need.

Browse the full MCP server directory or use Stork's one-line install to let your agent pick the right server automatically.