WEBCLAW

What is WEBCLAW?

WEBCLAW is an MCP (Model Context Protocol) server that provides 10 tools for web extraction. It runs in AI-powered editors and IDEs such as Claude Desktop, Claude Code, Cursor, Windsurf, Codex, and OpenCode. It is MIT licensed.

How to use WEBCLAW?

Run npx create-webclaw to install and auto‑detect your environment, which automatically writes the correct configuration for supported editors. Alternatively, you can install the binary via Homebrew (brew tap 0xMassi/webclaw && brew install webclaw) or download it from GitHub releases. For manual setup, add the following to your MCP configuration:

{
  "mcpServers": {
    "webclaw": {
      "command": "webclaw-mcp",
      "args": []
    }
  }
}

Key features of WEBCLAW

• scrape – extract clean content from any URL
• crawl – recursive site crawling with depth control
• search – web search with result scraping
• extract – structured JSON extraction using LLM
• summarize – page summaries
• brand – extract colors, fonts, logos
• diff – track content changes between snapshots
• map – discover URLs from sitemaps
• batch – parallel multi‑URL extraction
• research – deep multi‑source analysis

Use cases of WEBCLAW

• Scraping and cleaning article text from news or blog sites.
• Recursively crawling a website to map all accessible pages.
• Performing web searches and extracting structured results.
• Extracting brand design tokens (colours, fonts, logos) from a webpage.
• Running parallel batch extraction on multiple URLs simultaneously.

FAQ from WEBCLAW

What tools does WEBCLAW provide?

It offers 10 tools: scrape, crawl, search, extract, summarize, brand, diff, map, batch, and research – each focused on different web extraction tasks.

Which editors or AI clients are supported?

WEBCLAW auto‑detects and writes configuration for Claude Desktop, Claude Code, Cursor, Windsurf, Codex, and OpenCode.

Is WEBCLAW free and open source?

Yes, the MCP server is MIT licensed. The source code and releases are available on GitHub at https://github.com/0xMassi/webclaw.

How do I install WEBCLAW?

You can install it via npx create-webclaw, with Homebrew (brew tap 0xMassi/webclaw && brew install webclaw), or by downloading the binary from GitHub releases.

Can I configure WEBCLAW manually?

Yes, you can provide a JSON configuration with the command webclaw-mcp and no arguments in your MCP server settings.