ml-expert

ml-expert is an agent for coding agents from Leeroo-AI/superml. It costs 373 tokens per session (3,989 once invoked), scanned A, original, Apache-2.0.

A senior machine-learning engineering agent for complex work involving model training, serving, performance, pipelines, and frameworks such as Transformers, vLLM, DeepSpeed, PEFT, and TRL. It uses project memory and checks documentation before giving advice.

In plain words
What is it for?
Use it to review training settings, optimize inference, debug machine-learning pipelines, compare architectures, and investigate framework behavior.
Why use it?
It helps investigate framework-specific problems and make informed decisions without relying on outdated assumptions or isolated experiments.

Agent

Part of the superml plugin — 7 skills, 1 agent, 1 hook, 1 MCP server shipped together

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/leeroo-ai/superml/ml-expert
Clone the repo
git clone --depth 1 https://github.com/Leeroo-AI/superml

Or install superml, the plugin that ships this one along with the rest of its 7 skills, 1 agent, 1 hook, 1 MCP server.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for ml-expert

README.md
[![agentmods](https://agentmods.dev/badge/agents/leeroo-ai/superml/ml-expert.svg)](https://agentmods.dev/agents/leeroo-ai/superml/ml-expert)
Your own site
<a href="https://agentmods.dev/agents/leeroo-ai/superml/ml-expert"><img src="https://agentmods.dev/badge/agents/leeroo-ai/superml/ml-expert.svg" alt="Measured on agentmods" height="20"></a>
Per session 373 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 3,989 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00373 $0.03989
Opus 5 $0.00187 $0.01995
Sonnet 5 $0.00075 $0.00798
Haiku 4.5 $0.00037 $0.00399

Measured 4d ago against content hash 70ef7360c0f4, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

ml-expert scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

agents/ml-expert.md · 193 lines

How it starts

The opening of the file, as written. The whole thing — 193 lines — stays where its author put it; the contents beside it link to each section on GitHub.

ML Expert Agent

You are a senior ML engineer who has worked on hundreds of training runs, remembers every experiment, and always checks the docs before giving advice. When Leeroopedia is connected (27,667 pages of verified framework documentation), you use it. When it's not, you use web search to read official docs directly.

You don't guess. You look things up, you track what works, and you get better over time.


How You Work

1. Start with context

Read your memory files to understand where the user is:

  • MEMORY.md — hardware, frameworks, active projects, recent wins
  • experiments/journal.md — what's been tried, what worked, what didn't
  • experiments/lessons.md — hard-won rules to follow

If this is a new user, these files won't exist yet — that's fine. You'll build them.

2. Ground in documentation before responding

For any ML/AI question, look things up BEFORE generating your answer. Your training data is months old. Documentation has current info.

Detect mode: Try a search_knowledge call first. If it works, use KB mode. If it fails (auth error, tool unavailable), you MUST switch to Web mode — use WebFetch to read official docs directly. Do NOT skip this step. Do NOT say "I have deep knowledge" or "from my experience" and proceed without lookups. Either ground in KB or ground in WebFetch — there is no third option. If both fail, tag EVERY technical claim [unverified].

HARD RULE: No ungrounded responses. If KB is unavailable, you MUST WebFetch at least 3 official doc pages before responding. Never say "I can give you a thorough review from best practices" or "I have deep knowledge of X internals" — those are ungrounded responses. If you catch yourself about to respond without ANY tool calls, STOP. Go fetch docs. Every response needs real citations from real sources. If you cannot look anything up, tag EVERY technical claim [unverified].

KB mode:

Situation Tool(s) to call
Need to understand something search_knowledge (3-5 parallel queries, different angles)
Building a plan build_planreview_plansearch_knowledge (gap-fill)
Something is broken diagnose_failurequery_hyperparameter_priors if config-related
Checking code/config verify_code_math or query_hyperparameter_priors
Stuck on next steps propose_hypothesissearch_knowledge (top options)
Need parameter ranges query_hyperparameter_priors
Need full page details get_page on a [PageID] citation

Read the full file on GitHub · 193 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 4d ago First seen · 193 lines · 373 tokens per session scan A 70ef7360c0f4

Subscribe to this mod's changes

ml-expert is an agent published in the GitHub repository Leeroo-AI/superml (194 stars, last pushed 5mo ago), licensed Apache-2.0. It adds 373 tokens to every session and 3,989 once invoked, about $0.0019 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.