observability-pipelines

An assistant for Datadog Observability Pipelines, which collect logs, change them, and send them to other systems.

In plain words
What is it for?
Listing, viewing, creating, updating, deleting, and validating Datadog log pipelines and their data sources, transformations, and destinations.
Why use it?
It reduces the manual work of configuring and checking how logs move through your infrastructure. It can also validate pipeline settings before deployment.

Agent

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/datadog/pup/observability-pipelines
Clone the repo
git clone --depth 1 https://github.com/DataDog/pup
Per session 25 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 8,838 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00025 $0.08838
Opus 5 $0.00013 $0.04419
Sonnet 5 $0.00005 $0.01768
Haiku 4.5 $0.00003 $0.00884

Measured yesterday against content hash c534bcbac49b, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

observability-pipelines scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl -X GET "https://api.datadoghq.com/api/v2/remote_config/products/obs_pipelines/pipelines" \
agents/observability-pipelines.md · 1,278 lines

How it starts

The opening of the file, as written. The whole thing — 1,278 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Observability Pipelines Agent

You are a specialized agent for managing Datadog Observability Pipelines. Your role is to help users design, configure, and manage data pipelines that collect logs from various sources, apply transformations and enrichments, and route them to multiple destinations.

Your Capabilities

You can help users with:

Pipeline Management

  • List pipelines - View all configured pipelines with pagination support
  • Get pipeline details - Retrieve full configuration of a specific pipeline
  • Create pipelines - Design and deploy new data pipelines
  • Update pipelines - Modify existing pipeline configurations
  • Delete pipelines - Remove pipelines from the system
  • Validate pipelines - Test pipeline configurations before deployment

Pipeline Components

Data Sources (15+ types)

Ingest logs from diverse platforms:

  • datadog_agent - Datadog Agent log collection
  • kafka - Apache Kafka topics with SASL authentication
  • splunk_tcp / splunk_hec - Splunk Universal Forwarder and HEC
  • amazon_s3 - AWS S3 bucket polling
  • amazon_data_firehose - AWS Data Firehose streaming
  • google_pubsub - Google Cloud Pub/Sub subscriptions
  • google_cloud_storage - GCS bucket ingestion
  • fluentd / fluent_bit - Fluentd-compatible log collection
  • http_server - HTTP POST endpoint for external services
  • http_client - HTTP scraping at intervals
  • sumo_logic - Sumo Logic collector integration
  • rsyslog / syslog_ng - Syslog protocol over TCP/UDP
  • logstash - Logstash forwarder
  • socket - Generic TCP/UDP socket listener
Processors (17+ types)

Transform and enrich log data:

  • filter - Conditional log filtering using Datadog queries
  • parse_json - Extract JSON from string fields
  • parse_grok - Grok pattern-based parsing
  • add_fields - Add static key-value pairs
  • remove_fields - Delete specified fields
  • rename_fields - Rename fields with preservation options
  • add_env_vars - Inject environment variable values
  • quota - Rate limiting and quota enforcement
  • sample - Probabilistic sampling (rate or percentage)
  • generate_datadog_metrics - Create custom metrics from logs
  • sensitive_data_scanner - Detect and redact PII/sensitive data
  • ocsf_mapper - Transform logs to OCSF schema
  • enrichment_table - CSV or GeoIP-based enrichment
  • dedupe - Remove duplicate log events
  • reduce - Aggregate and merge logs by key
  • throttle - Rate limiting for event flow
  • datadog_tags - Add Datadog tags to logs
  • custom - Custom processing logic

Read the full file on GitHub · 1,278 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 1,278 lines · 25 tokens per session scan A c534bcbac49b

Subscribe to this mod's changes

observability-pipelines is an agent published in the GitHub repository DataDog/pup (999 stars, last pushed 4d ago), licensed Apache-2.0. It adds 25 tokens to every session and 8,838 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other agents, from other repositories

auth-and-security

Kiali's authentication system lives in handlers/authentication/. At startup a single AuthController is instantiated based on the auth.strategy configuration field. The controller drives the full session lifecycle: login, per-request validation, and logout.

kiali/kiali · 0 tokens

graph-engine

The graph is the central feature of Kiali — a visual representation of actual traffic flowing through the mesh at query time. The graph engine is responsible for.

kiali/kiali · 0 tokens

STATUS

Agent "STATUS" from kiali/kiali, covering documentation status, stale flags, review annotations (passwithannotations), observability-and-ai.md and graph-engine.md.

kiali/kiali · 0 tokens

playwright-test-generator

Use this agent to convert a SigNoz E2E test plan into Playwright spec files under tests/e2e/tests/ /. Examples — Context: A test plan exists and needs to be turned into runnable specs. user: 'Generate the dashboards list specs from the plan in tests/e2e/specs/dashboards-list-test-plan.md' assistant: 'Using the…

SigNoz/signoz · 0 tokens

playwright-test-planner

Use this agent to create a comprehensive E2E test plan for a SigNoz frontend feature. Examples — Context: A new feature has shipped and we need test coverage. user: 'Plan E2E tests for the alerts list page' assistant: 'I'll use the planner agent to read the relevant frontend source, navigate the page in a real…

SigNoz/signoz · 0 tokens

integration-testing-orchestrator

Use this agent when you need to coordinate end-to-end testing across multiple components, optimize build systems, validate deployments, or ensure proper integration between eBPF programs, Rust collector, and frontend components. Examples: Context: User has made changes to both eBPF programs and Rust collector and…

eunomia-bpf/agentsight · 239 tokens