What is a #local-llm MCP server?
An MCP server tagged #local-llm implements the Model Context Protocol so AI assistants like Claude, Cursor, and VS Code can access local-llm-related tools, data, or APIs.
10 #local-llm MCP Servers & Clients
Every MCP server and client below is tagged #local-llm — install one to give Claude, Cursor, VS Code, or any other MCP-compatible client access to local-llm tools.
All
MCP Client for Ollama (ollmcp)
jonigl
Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, streaming responses, human-in-the-loop, thinking mode, model params config, system prompts, and saved pre
Added last year
MCP + Ollama Local Tool Calling Example
rajeevchandra
Added last year
Cursor Chat History Vectorizer & Dockerized Search MCP
markelaugust74
API service to search vectorized Cursor IDE chat history using LanceDB and Ollama
Added last year
local-llm-obsidian-knowledge-base
PSFW
A template repository that includes a dev container for running a local LLM and included knowledge base. Add a git repo using `git subtree` or `git submodule` and update it using an MCP Client/Server relationship i.e. `VS Code` extension like `Cline` and the `Filesystem`/`Obsidia
Added last year
I
Inferbench
JoniMartin27
InferBench's MCP server lets coding agents run, serve and benchmark local LLMs (text + image, llama.cpp + Stable Diffusion) on your own hardware on demand. Measures real tokens/sec, picks the optimal quant for your GPU, and exposes a 124-model catalog. Local-first, no cloud requi
Added last month
NL
Nft Log Analyser
mashish
CP Log Analyzer automatically triages your log files using a local AI model.
Added 5 months ago
Oboyu (覚ゆ)
sonesuke
Self-hosted MCP Japanese text indexing & search—chunking+embeddings with BM25×vector rerank
Added last year
PydanticAI MCP Experiment
eschmidt42
Minimalist examples to provide your own MCP servers to your local llm models.
Added last year
LM
Local Model Suitability Mcp
OjasKord
Check whether a task can run on a local model instead of cloud before every inference call. Saves money on every call that does not need cloud.
Added 3 months ago
MCP-Ollama Client
Nagharjun17
Lightweight MCP client that uses a local Ollama LLM to query multiple MCP servers defined in config.json
Added last year
Frequently asked questions
Common questions about MCP servers and clients tagged #local-llm
How many #local-llm MCP servers and clients are there?
mcp.so currently lists 10 MCP servers and clients tagged #local-llm.
How do I install a #local-llm MCP server?
Open any server below and copy its install snippet into Claude Desktop, Cursor, VS Code, or another MCP client's configuration — remote servers need no separate download.