FitLLM

@click6067-ship-it

About FitLLM

Will this LLM fit on your GPU, multi-GPU rig or Mac? Exact VRAM & KV-cache math. Remote server: https://fitllm.run/api/mcp

#llm #vram #gpu #hardware #apple-silicon #quantization #multi-gpu #calculator

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "fitllm-engine": {
      "command": "npx",
      "args": [
        "fitllm",
        "GLM-4.7-Flash",
        "--gpu",
        "4090",
        "#",
        "✓",
        "FITS",
        "—",
        "21.9/24",
        "GB,",
        "free",
        "2.1",
        "GB"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Fitllm Engine?

Will this LLM fit your GPU or Mac? npx fitllm — accurate memory math for MLA/sliding-window/hybrid/MoE architectures that naive VRAM calculators get wrong by up to 18x. Single file, zero deps, conformance-vector tested. MIT.

How to use Fitllm Engine?

The README includes setup instructions such as npx fitllm "GLM-4.7-Flash" --gpu 4090 # ✓ FITS — 21.9/24 GB, free 2.1 GB.

Key features of Fitllm Engine

Architecture values checked against official HuggingFace config.json
Calibration: Qwen 3.6 35B-A3B @128K, 8-bit ≈ 54 GB (matches real local runs)
MLA per-token cost: GLM-4.7-Flash = (512 + 64) × 2 B × 47 layers = 54,144 B/token — pinned by conformance vectors
Claude Code: claude mcp add --transport http fitllm https://fitllm.run/api/mcp
Cursor / Windsurf: add to mcp.json → { "mcpServers": { "fitllm": { "url": "https://fitllm.run/api/mcp" } } }

Use cases of Fitllm Engine

Connect an MCP-compatible client to this repository's service.
Review the README-backed setup before enabling it in production.

FAQ from Fitllm Engine

Where is the source code for Fitllm Engine?

The source code is linked from the repository URL on this page.

Does Fitllm Engine include a standard MCP config?

If the README contains a parseable MCP configuration block, it is shown in the Config tab.

Frequently asked questions

Where is the source code for Fitllm Engine?

The source code is linked from the repository URL on this page.

Does Fitllm Engine include a standard MCP config?

If the README contains a parseable MCP configuration block, it is shown in the Config tab.

Comments

Basic information

More Developer Tools MCP servers

FastAPI-MCP

tadata-org

Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!

11.9K

mcp-excalidraw

yctimlin

MCP server and Claude Code skill for Excalidraw — programmatic canvas toolkit to create, edit, and export diagrams via AI agents with real-time canvas sync.

2.1K

Serena

oraios

A powerful MCP toolkit for coding, providing semantic retrieval and editing capabilities - the IDE for your agent

26.2K

TaskerArmy Agent

TaskerArmy

Ask Claude or ChatGPT what Shopify theme optimization tasks are pending on your store, a remote MCP server for TaskerArmy Agent accounts.

endoflife.ai

Free MCP server for software end-of-life intelligence: EOL dates, support status, and the 0-100 EOL Risk Score across 485 tracked products. Agents can check a single version, pull a product's full lifecycle schedule, or