agentmods.dev

JoniMartin27/inferbench

Benchmark local LLM inference speed (tokens/sec) on your own hardware — llama.cpp native + cloud APIs, 124-model catalog, optimal-quant picker, and an MCP serve mode.

This repository also configures its own agents. See what inferbench tells them →

Open on GitHub fervon.dev
2Stars on the repository
2Mods indexed here, across every type
1mo agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown
Sort RelevanceRecently updatedFewest tokensSecurity gradeRepo starsStars this weekTop rated 1 mods

run-inferbench-backend

01

JoniMartin27/inferbench

Skill Claude Code

Build, launch, smoke-test and drive the InferBench FastAPI backend (:7777) and its inference-engine orchestration. Use when asked to run, start, launch, boot, smoke-test, benchmark, or drive the inferbench backend / API / engines (llama.cpp, ollama, vLLM, SGLang, TGI), or to verify an engine actually starts and runs a…

not rated 2 1mo ago A 90 tokens original MIT