Multi Fetch MCP Server

@alexyangjie

About Multi Fetch MCP Server

Extending mcp-server-fetch with parallel browsing

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "fetch": {
      "command": "uvx",
      "args": [
        "mcp-server-multi-fetch"
      ],
      "env": {
        "FIRECRAWL_API_KEY": "",
        "FIRECRAWL_API_URL": ""
      }
    }
  }
}

Tools

Fetches a URL from the internet and extracts its contents as markdown.

Fetches multiple URLs concurrently and returns an array of results. Input is an array of objects, each with:

Searches the web using the Firecrawl search API and scrapes results in markdown and link formats by default.

Overview

What is Multi Fetch MCP Server?

Multi Fetch MCP Server is a fork of the Fetch MCP Server that replaces direct HTTP fetching with the Firecrawl Python SDK. It enables LLMs to fetch web content, scrape multiple URLs concurrently, and search the web, converting HTML to markdown for easier consumption.

How to use Multi Fetch MCP Server?

Install via pip install mcp-server-multi-fetch firecrawl-py and set the FIRECRAWL_API_KEY environment variable. Then configure Claude.app (or any MCP client) using uvx mcp-server-multi-fetch. Use the fetch, fetch_multi, and search tools to retrieve and process web content.

Key features of Multi Fetch MCP Server

Based on the Fetch MCP Server, uses the Firecrawl SDK
Fetch single or multiple URLs concurrently
Web search via the Firecrawl search API
Content truncation with start_index for chunked reading
Customizable user-agent, proxy, and robots.txt behavior
Prompts for fetch and search operations

Use cases of Multi Fetch MCP Server

Reading large web pages in chunks to find specific information
Concurrently fetching multiple sources for research or comparison
Searching the web and scraping results into markdown
Integrating web content into AI‑powered workflows

FAQ from Multi Fetch MCP Server

What is the difference from the original Fetch MCP Server?

This fork replaces direct HTTP fetching with the Firecrawl Python SDK, requiring a Firecrawl API key (FIRECRAWL_API_KEY) instead of using plain HTTP requests.

What dependencies are required?

Requires Python with the mcp-server-multi-fetch and firecrawl-py packages. Optionally, Node.js can be installed for a more robust HTML simplification step.

How do I set up the Firecrawl API key?

Set the FIRECRAWL_API_KEY environment variable to your Firecrawl API key. Optionally, override the API endpoint with FIRECRAWL_API_URL.

Can I configure a proxy?

Yes, use the --proxy-url argument with HTTP, HTTPS, or SOCKS5 proxy URLs (e.g., --proxy-url http://192.168.1.1:8080).

How does robots.txt handling work?

By default, the server obeys a website’s robots.txt for model‑initiated requests (tools) but not for user‑initiated requests (prompts). This can be disabled with the --ignore-robots-txt flag.

Frequently asked questions

What is the difference from the original Fetch MCP Server?

This fork replaces direct HTTP fetching with the Firecrawl Python SDK, requiring a Firecrawl API key (`FIRECRAWL_API_KEY`) instead of using plain HTTP requests.

What dependencies are required?

Requires Python with the `mcp-server-multi-fetch` and `firecrawl-py` packages. Optionally, Node.js can be installed for a more robust HTML simplification step.

How do I set up the Firecrawl API key?

Set the `FIRECRAWL_API_KEY` environment variable to your Firecrawl API key. Optionally, override the API endpoint with `FIRECRAWL_API_URL`.

Can I configure a proxy?

Yes, use the `--proxy-url` argument with HTTP, HTTPS, or SOCKS5 proxy URLs (e.g., `--proxy-url http://192.168.1.1:8080`).

How does robots.txt handling work?

By default, the server obeys a website’s robots.txt for model‑initiated requests (tools) but not for user‑initiated requests (prompts). This can be disabled with the `--ignore-robots-txt` flag.

Comments

Basic information

More Browser Automation MCP servers

Fetch MCP

jae-jae

MCP server for fetch web page content using Playwright headless browser.

1.1K

Fetch

modelcontextprotocol

Model Context Protocol Servers

88.1K

Browserbase MCP Server

browserbase

Allow LLMs to control a browser with Browserbase and Stagehand

3.4K

MCP server w/ Browser Use

JovaniPink

FastAPI server implementing MCP protocol Browser automation via browser-use library.

X Twitter Scraper

Xquik-dev

Twitter scraper API skill for tweet search, advanced Twitter search, profile tweets, follower export, media download, monitors, webhooks, MCP, and posting automation: send tweets and replies.

135