io.github.arose26/gguf-mcp

About this integration

Inspect local GGUF/safetensors models: quantization, params, VRAM fit — headers only.

Transport

stdio

Authentication

none

Initial setup

none

Runtime

unattended

Evidence

documented

Version

0.1.1

Package

gguf-mcp

Last compatibility test

Not independently tested

Connect your agent

Publisher documents direct MCP-client startup through npx for local GGUF and safetensors header inspection. The publisher states there is no network, API-key or telemetry requirement for local inspection. Requires Node.js 18 or later and read access to authorized local model files. Package acquisition is a separate setup step. Configure the MCP client to run npx -y gguf-mcp; the manifest declares dist/index.js as its executable. Header inspection does not require loading model weights. Publisher documentation reviewed; no package, endpoint or tool was executed or security-audited.

Capabilities: Inspect local model headers, List tensor metadata, Estimate model memory requirements

Connected profiles

Additional details