agent-observability-experiment-py-bootstrap

agent-observability-experiment-py-bootstrap is a skill for Claude Code from neverinfamous/mysql-mcp. It costs 103 tokens per session (14,274 once invoked), scanned A, original, MIT.

A generator for Python experiments or notebooks using Datadog's SDK for recording and analyzing AI application behavior.

In plain words
What is it for?
Use it to create a self-contained Python script or Jupyter notebook for an SDK experiment.
Why use it?
It gives developers a ready-to-run starting point for testing AI workflows with Datadog experiment tracking.

Skill for Claude Code

Written for Claude Code: $ARGUMENTS substitution. Also seen: names the AskUserQuestion tool; mentions Claude Code; mentions Gemini CLI.

Not installable: its command points at a path on the author’s own machine, so it runs nowhere else. The line is /Users/me/.config/dd/staging.env.

Good fit Use it to create a self-contained Python script or Jupyter notebook for an SDK experiment.

Compare 6 skills from other repositories ↓
Install

Getting it into your agent

There is no command for this one: it runs only inside a plugin, and the catalogue could not identify which plugin ships it. The source is linked below.

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for agent-observability-experiment-py-bootstrap

README.md
[![agentmods](https://agentmods.dev/badge/skills/neverinfamous/mysql-mcp/agent-observability-experiment-py-bootstrap.svg)](https://agentmods.dev/skills/neverinfamous/mysql-mcp/agent-observability-experiment-py-bootstrap)
Your own site
<a href="https://agentmods.dev/skills/neverinfamous/mysql-mcp/agent-observability-experiment-py-bootstrap"><img src="https://agentmods.dev/badge/skills/neverinfamous/mysql-mcp/agent-observability-experiment-py-bootstrap.svg" alt="Measured on agentmods" height="20"></a>
Per session 103 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 14,274 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00103 $0.14274
Opus 5 $0.00051 $0.07137
Sonnet 5 $0.00021 $0.02855
Haiku 4.5 $0.00010 $0.01427

Measured 8d ago against content hash 975bcc334557, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-08, from the pricing page.

Security

Grade A, and why

agent-observability-experiment-py-bootstrap scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

The scan reads SKILL.md. This mod also ships 1 executable file (scripts/env_setup_template.py), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

| `requests.post`, `httpx.post` | The skill produces SDK-only code. Direct HTTP calls bypass the SDK's lazy creation, push-diff, and bulk-threshold handling. |
skills/datadog/agent-observability/agent-observability-experiment-py-bootstrap/SKILL.md · 639 lines

How it starts

The opening of the file, as written. The whole thing — 639 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Backend

Detection — At the start of every invocation, before taking any action, determine which backend (if any) to use for the startup beacon call:

  1. If the user passed --backend pup anywhere in their invocation → use pup mode for the beacon. Skip steps 2–3.
  2. Check whether MCP tools are present in your active tool list. The canonical signal is whether mcp__datadog-llmo-mcp__list_llmobs_evals appears in your available tools. If present → use MCP mode.
  3. If MCP tools are absent → check whether pup is executable via pup --version. If responding → use pup mode.
  4. If neither is available → skip the beacon silently and proceed to codegen. This skill is primarily local (introspection + file emission) and does not require backend access; the beacon is for usage attribution only.

Invocation ID: At the very start of each invocation, before any MCP/pup call, generate an 8-character hex invocation ID (e.g., 3a9f1c2b). Keep it constant for the entire invocation.

Intent tagging: On every MCP tool call, prefix telemetry.intent with skill:agent-observability-experiment-py-bootstrap[<inv_id>] — followed by a description of why the tool is being called. On the first MCP tool call only (the startup beacon below), use skill:agent-observability-experiment-py-bootstrap:start[<inv_id>] — instead (note the :start suffix).

Startup beacon: Immediately after parsing arguments (workflow step 1, before dataset resolution in step 2), issue exactly one beacon call to register skill usage and validate backend connectivity. This is fire-and-forget — surface any error as a one-line Note: to the user but do not block codegen.

  • MCP mode: call mcp__datadog-llmo-mcp__list_llmobs_evals with telemetry.intent = "skill:agent-observability-experiment-py-bootstrap:start[<inv_id>] — Skill startup: register usage and verify Datadog connectivity". Discard the response payload; the call's purpose is the telemetry tag.
  • pup mode: run pup llm-obs evals list --limit 1 via Bash. Pup carries its own telemetry; no intent prefix needed.
  • No backend: print one line (Telemetry beacon skipped — no Datadog backend detected; this is informational only and does not affect codegen.) and proceed.

The beacon must not fail the skill. If the call errors (auth, network, etc.), surface a one-line note and continue.


Read the full file on GitHub · 639 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 639 lines · 103 tokens per session scan A 975bcc334557

Subscribe to this mod's changes

agent-observability-experiment-py-bootstrap is a skill published in the GitHub repository neverinfamous/mysql-mcp (10 stars, last pushed yesterday), licensed MIT. It adds 103 tokens to every session and 14,274 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

pytorch-patterns

PyTorch deep learning patterns and best practices for building robust, efficient, and reproducible training pipelines, model architectures, and data loading.

affaan-m/ECC · 32 tokens

architecture-design

Use only when creating new registrable ML components that require Factory or Registry patterns.

Galaxy-Dawn/claude-scholar · 19 tokens

graphjin-env

Use when setting up a training or evaluation loop against a GraphJin agent environment — running the container, reading /health, driving episodes hosted or step-by-step or with your own agent over MCP, splitting train from eval, exporting trajectories, and deciding whether two rewards can be compared.

dosco/graphjin · 61 tokens

ideogram4

Prompting patterns for Ideogram 4 text-to-image — best-in-class in-image text rendering and exact color/layout control via structured JSON captions. Use when generating images that need legible on-image text (title cards, thumbnails, logos, signage, CTAs), precise brand colors, or controlled spatial layout. Triggers…

digitalsamba/claude-code-video-toolkit · 99 tokens

huggingface-vision-trainer

Train object-detection, image-classification, or SAM segmentation models on Hugging Face Jobs. Use for vision fine-tuning and evaluation; use huggingface-llm-trainer for language models.

waybarrios/opencode-power-pack · 48 tokens

memstack-seo-ai-search-visibility

Use this skill when the user says 'AI search', 'AI visibility', 'ChatGPT ranking', 'Perplexity optimization', 'GEO', 'generative engine optimization', or needs to optimize content for AI-powered search engines and LLM citations. Do NOT use for traditional SEO audits or Google Ads.

cwinvestments/memstack · 71 tokens