AI & media / Inference AIops

Inference AIops

io.github.AIops-tools/inference-aiops · v0.10.4

Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.

Description supplied by the publisher in the MCP Registry. We have not tested this server.

Install

uvx inference-aiops

Assembled from the package metadata in the official MCP Registry (including any subcommand or flag the publisher lists). Some publishers do not list the subcommand that starts MCP mode, so confirm the command in the README, along with any required configuration and credentials, before connecting it to real data.

Signals

GitHub stars0
npm weekly downloads-
Last push2d ago
LicenceMIT
Open issues0
SECURITY.mdYes
LanguagePython
Latest version published2026-09-16

Signals captured from GitHub, npm and the official MCP Registry on October 15, 2026. See the scoring method.

Similar servers

AI Guardian

Score 75

Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

★ 0MITpushed 2d ago
AI & mediaCloud & infra

inferbench

Score 74

Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.

★ 0Apache-2.0pushed 7d ago
AI & media

LLM Latency Tracker

Score 70

Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

★ 12MITpushed 2d ago
AI & mediaCloud & infraRemote