MCP.so
Sign In

Crawl4AI MCP Server

@weidwonder

Repository

About Crawl4AI MCP Server

用于提供给本地开发者的 LLM的高效互联网搜索&内容获取的MCP Server， 节省你的token

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "crawl4ai-mcp-server": {
      "command": "python",
      "args": [
        "-m",
        "venv",
        "crawl4ai_env"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Crawl4AI MCP Server?

Crawl4AI MCP Server is an MCP (Model Context Protocol) server that equips AI assistant systems with multi‑engine search and LLM‑optimized web page content understanding. It supports DuckDuckGo (default) and Google search, and provides intelligent content extraction with citation‑enabled output formats.

How to use Crawl4AI MCP Server?

Install via cloning the repository, creating a Python 3.9+ virtual environment, installing dependencies (pip install -r requirements.txt) and the Playwright browser (playwright install), or via Smithery for Claude Desktop. The server exposes two tools: search (with parameters query, num_results, engine) and read_url (with parameters url and format). To use Google search, configure config.json with an API key and CSE ID.

Key features of Crawl4AI MCP Server

  • Multi‑engine search (DuckDuckGo and Google)
  • LLM‑optimized web content extraction with noise filtering
  • Automatic identification and retention of key content
  • Multiple output formats including markdown with citations
  • High‑performance asynchronous design based on FastMCP

Use cases of Crawl4AI MCP Server

  • AI assistants performing web research and fact‑checking
  • Summarizing and extracting core information from articles
  • Gathering search results from multiple engines simultaneously
  • Providing LLMs with clean, citation‑tracked web content

FAQ from Crawl4AI MCP Server

Which search engines are supported?

DuckDuckGo (default, no API key required) and Google (requires API key and CSE ID configured in config.json). The "engine" parameter can be set to "duckduckgo", "google", or "all".

What Python version is required?

Python 3.9 or higher is required.

What output formats does the read_url tool support?

It supports markdown_with_citations (default), fit_markdown, raw_markdown, references_markdown, fit_html, and markdown.

Is an API key needed to use DuckDuckGo search?

No, DuckDuckGo search works without any API key. Google search requires a Google API key and a Custom Search Engine ID.

What dependencies are needed beyond Python?

The Playwright browser must be installed (playwright install). All other dependencies are listed in requirements.txt.

Frequently asked questions

Which search engines are supported?

DuckDuckGo (default, no API key required) and Google (requires API key and CSE ID configured in `config.json`). The `"engine"` parameter can be set to `"duckduckgo"`, `"google"`, or `"all"`.

What Python version is required?

Python 3.9 or higher is required.

What output formats does the `read_url` tool support?

It supports `markdown_with_citations` (default), `fit_markdown`, `raw_markdown`, `references_markdown`, `fit_html`, and `markdown`.

Is an API key needed to use DuckDuckGo search?

No, DuckDuckGo search works without any API key. Google search requires a Google API key and a Custom Search Engine ID.

What dependencies are needed beyond Python?

The Playwright browser must be installed (`playwright install`). All other dependencies are listed in `requirements.txt`.

Comments

Basic information

Category

Other

License

MIT

Transports

stdio

Author

weidwonder

More Other MCP servers

Activepieces

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

23.2K

Sequential Thinking

modelcontextprotocol

Model Context Protocol Servers

88.2K

ICSS

chokcoco

不止于 CSS

20.7K

🚀 Model Context Protocol (MCP) Curriculum for Beginners

microsoft

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable,

16.7K

IDA Pro MCP

mrexodia

AI-powered reverse engineering assistant that bridges IDA Pro with language models through MCP.

9.9K