What is a #robots-txt MCP server?
An MCP server tagged #robots-txt implements the Model Context Protocol so AI assistants like Claude, Cursor, and VS Code can access robots-txt-related tools, data, or APIs.
Every MCP server and client below is tagged #robots-txt — install one to give Claude, Cursor, VS Code, or any other MCP-compatible client access to robots-txt tools.
zerhal
Free SEO audit MCP server. Analyze meta tags, headings, broken links, robots.txt, and competitor pages directly from Claude, Cursor, or Windsurf. No API key needed.
krissanders
MCP server that audits AI-bot visibility. Reports per-bot robots.txt verdicts for 22 AI user-agents (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.), Cloudflare AI-default flags, on-page schema, sitemap, llms.txt, SPA-shell detection, and cross-model brand mentions via P
Common questions about MCP servers and clients tagged #robots-txt
An MCP server tagged #robots-txt implements the Model Context Protocol so AI assistants like Claude, Cursor, and VS Code can access robots-txt-related tools, data, or APIs.
mcp.so currently lists 2 MCP servers and clients tagged #robots-txt.
Open any server below and copy its install snippet into Claude Desktop, Cursor, VS Code, or another MCP client's configuration — remote servers need no separate download.