datadog-labs

datadog-labs/agent-skills

Skill Claude CodeCodex

Datadog skills for AI agents. Essential monitoring, logging, tracing and observability.

datadog-labs/agent-skills

Skill Claude CodeCodex

Run an iterative code-improvement hill-climb against real Datadog LLM-Obs data, locally, with Claude Code as the agent. Establishes a baseline eval, makes one focused change, re-scores with the same harness, keeps the change if it improves the score in the goal's direction (labeling within-noise gains tentative), and…

datadog-labs/agent-skills

Skill Claude CodeCodex

Bootstrap evaluators from production traces — by default propose online LLM-judge evaluators and, after you confirm, create them in Datadog as disabled drafts (never auto-enabled); on request emit Python SDK code or a framework-agnostic JSON spec instead. Use when user says "bootstrap evaluators", "generate…

datadog-labs/agent-skills

Skill Claude CodeCodex

End-to-end Agent Observability pipeline for an instrumented mlapp — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between…

datadog-labs/agent-skills

Skill Claude CodeCodex

Analyze LLM experiment results. Handles single or comparative experiments, exploratory or Q&A modes. Use when user says "analyze experiment", "compare experiments", "analyze against baseline", or provides one or two experiment IDs for analysis.

datadog-labs/agent-skills

Skill Claude CodeCodex

Bootstrap a reproducible LLM Observability experiment through the Python ddtrace SDK or the Node dd-trace SDK. Use for experiment, dataset, evaluator, benchmark, regression, or LLM-as-a-judge scaffolding. The legacy Python invocation remains supported.

datadog-labs/agent-skills

Skill Claude CodeCodex

Use when a developer wants to iterate on ONE specific Agent Observability / LLM Obs trace whose output they didn't like — re-running that trace against their LOCAL code, seeing a concise diff of the old vs new output, and looping (change code → replay → diff) until satisfied. Invoked as…

datadog-labs/agent-skills

Skill Claude CodeCodex

Classify whether user intent was satisfied in a Datadog Agent Observability trace or session. Three modes: (1) sessionid — classify a single CMD+I assistant session with RUM; (2) traceid — classify a single Agent Observability trace without RUM; (3) mlapp — sample and classify multiple sessions or traces from a given…

datadog-labs/agent-skills

Skill Claude CodeCodex

Root cause analysis on production LLM traces. Diagnoses why an LLM application is failing — works from eval judge verdicts, runtime errors, or structural anomalies depending on what signals are present. Walks the span tree from symptom to root cause. Use when user says "what's wrong with my app", "why is my eval…

datadog-labs/agent-skills

Skill Claude CodeCodex

Ensure the user has an authenticated Datadog account with a valid DDAPIKEY on the right region before any Datadog setup or instrumentation. Detects existing DDAPIKEY / DDAPPKEY / DDSITE, validates them against the Datadog API, and fixes the common wrong-region 403. If no usable key exists, signs the user in (OAuth) or…

datadog-labs/agent-skills

Skill Claude CodeCodex

APM - install, onboard, instrument, enable, set up, configure, traces, services, dependencies, performance analysis. Use for any request involving Datadog APM setup, instrumentation (SSI, ddtrace, agent install), or analysis.

datadog-labs/agent-skills

Skill Claude CodeCodex

Install the Datadog Agent on Kubernetes using the Datadog Operator — required before enabling Single Step Instrumentation (SSI), which automatically instruments applications for APM without code changes. Only use if no Datadog Agent is deployed on the cluster yet.

datadog-labs/agent-skills

Skill Claude CodeCodex

Enable Single Step Instrumentation (SSI) on Kubernetes — automatically instruments applications for APM without code changes. Only use if the Datadog Agent is already running on the cluster — if not, use agent-install first.

datadog-labs/agent-skills

Skill Claude CodeCodex

Generate a live Single Step Instrumentation (SSI) onboarding confirmation report — verifies APM instrumentation is working end-to-end with deep links into the Datadog UI. Only use after agent-install and enable-ssi have both completed successfully.

datadog-labs/agent-skills

Skill Claude CodeCodex

Diagnose and fix Single Step Instrumentation (SSI) issues on Kubernetes — SSI automatically instruments applications for APM without code changes. Only use if the agent and SSI are already configured but traces are missing or instrumentation is not working.

datadog-labs/agent-skills

Skill Claude CodeCodex

Verify Single Step Instrumentation (SSI) is working end-to-end on Kubernetes — SSI automatically instruments applications for APM without code changes. Only use after enable-ssi has run.

datadog-labs/agent-skills

Skill Claude CodeCodex

Create and manage APM service remapping rules — rewrite service names at ingestion time to collapse noisy inferred entities, clean up auto-generated names, handle org renames, or normalize naming conventions. Use for any request involving service renaming, service mapping, inferred service cleanup, peer.service…

datadog-labs/agent-skills

Skill Claude CodeCodex

Guides developers building Datadog Apps with TypeScript, React, the @datadog/apps scaffolder, and @datadog/vite-plugin. Use when a user wants to scaffold, run, debug, upgrade, build, upload, publish, upload without publishing (draft upload), add an upload-no-publish script, set up CI/CD, use OAuth or API/application…

datadog-labs/agent-skills

Skill Claude CodeCodex

Audit Trail investigations - who changed what, key compromise, cost spike root cause, compliance evidence (SOC 2/PCI), and AI activity auditing.

datadog-labs/agent-skills

Skill Claude CodeCodex

Audit what the Bits AI assistant (MCP server) has done in your Datadog org — tool calls by user, resources accessed, and anomaly flags for AI governance.

datadog-labs/agent-skills

Skill Claude CodeCodex

Generate auditor-ready compliance evidence from Datadog Audit Trail for SOC 2 and PCI DSS. Maps framework controls to specific query patterns and produces formatted output.

datadog-labs/agent-skills

Skill Claude CodeCodex

Investigate a Datadog product usage or cost spike by correlating Usage Metering data (when/what spiked) with Audit Trail config changes (who changed what in the preceding window).

datadog-labs/agent-skills

Skill Claude CodeCodex

Investigate a potentially compromised Datadog API key — timeline of actions, geo/IP breakdown, endpoints called, anomaly flags, and remediation steps.

datadog-labs/agent-skills

Skill Claude CodeCodex

Answer "who did what" security questions from Audit Trail — deletions, config changes, login activity, permission changes, actions from a specific user or IP.