data engineering skills

386 tagged data engineering, measured the same way as everything else here.

Browse within: data-governance 76business-intelligence 72analytics-engineering 56data-ingestion 48data-integration 48data-science 48apache-spark 39airflow 38databricks 32dbt 27bigquery 23ai-automation 22apache-airflow 22ckan 20

adapter-ops

01

Zipstack/unstract

Skill Claude CodeCodex

Extend LLM and embedding adapters in unstract/sdk1. Use when adding new adapters (LLM or embedding), removing adapters, adding/removing models to existing adapters, or editing adapter configurations. Supports OpenAI-compatible providers, cloud providers (AWS Bedrock, VertexAI, Azure), and self-hosted models (Ollama).

7.2k 2d ago C 71 tokens AGPL-3.0

connector-ops

02

Zipstack/unstract

Skill Claude CodeCodex

Manage Unstract connectors - add, remove, or modify database, filesystem, and queue connectors. This skill handles backend code, JSON schemas, tests, logo fetching, and dependency management. Use when the user wants to create a new connector, delete an existing one, or modify connector behavior.

7.2k 2d ago C 62 tokens AGPL-3.0

worktree

03

Zipstack/unstract

Skill Claude CodeCodex

Creates git worktrees for isolated development. Use when user wants to "create a worktree", "start a new feature branch", "work on a fix in isolation", or needs a parallel development environment.

7.2k 2d ago A 44 tokens AGPL-3.0

build-dashboard

04

dathere/qsv

Skill Claude CodeCodex

Build an interactive HTML dashboard — a Data Schematic — with charts, filters, and tables. Use when creating a dashboard, an executive overview with KPI cards, turning query results into a shareable self-contained report, building a team monitoring snapshot, or needing multiple charts with filters in one…

3.8k yesterday A 65 tokens

data-profile

05

dathere/qsv

Skill Claude CodeCodex

Profile a CSV/TSV/Excel file - detect format, compute statistics, show value distributions.

3.8k yesterday A 22 tokens

dathere/qsv

Skill Claude CodeCodex

Build a Visual Data Dictionary — an interactive qsv viz smart dashboard (a Data Schematic) driven by an LLM-inferred JSON Schema data dictionary, with the dictionary browsable beside the charts. Use when the user asks for a visual data dictionary, a documented dashboard, a dictionary-driven dashboard or Data…

3.8k yesterday A 91 tokens

data-parity

07

AltimateAI/altimate-code

Skill Claude CodeCodex

Validate that two tables or query results are identical — or diagnose exactly how they differ. Discover schema, identify keys, profile cheaply, then diff. Use for migration validation, ETL regression, and query refactor verification.

803 yesterday A 48 tokens original MIT

data-viz

08

AltimateAI/altimate-code

Skill Claude CodeCodex

Build modern, interactive data visualizations and dashboards using code-based component libraries (shadcn/ui, Recharts, Tremor, Nivo, D3, Victory, visx). Use this skill whenever the user asks to visualize data, build dashboards, create analytics views, chart metrics, tell a data story, build a reporting interface…

803 yesterday A 189 tokens original MIT

dbt-develop

09

AltimateAI/altimate-code

Skill Claude CodeCodex

REQUIRED before writing or modifying ANY dbt model. Invoke this skill FIRST whenever a task says "create", "build", "add", "modify", "update", "fix", or "refactor" a dbt model, staging file, mart, incremental, or snapshot. Skipping this skill is the leading cause of silent-correctness bugs — models that compile and…

803 yesterday A 294 tokens original MIT

release-dbt-mcp

10

dbt-labs/dbt-mcp

Skill Claude CodeCodex

Release a new version of dbt-mcp to PyPi.

601 3d ago A 18 tokens original Apache-2.0

airflow-plugins

11

astronomer/agents

Skill Claude CodeCodex

Builds Airflow 3.1+ plugins that embed FastAPI apps, custom UI pages, React components, middleware, macros, and operator links directly into the Airflow UI. Use when building anything custom inside Airflow 3.1+ that involves Python and a browser-facing interface - creating an Airflow plugin, adding a custom UI page or…

429 14d ago A 147 tokens original Apache-2.0

airflow-state-store

12

astronomer/agents

Skill Claude CodeCodex

Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key/value stores (taskstatestore, assetstatestore) and the crash-safe ResumableJobMixin. Use when the user asks about task state store, checkpointing in tasks, persisting state across retries, job IDs surviving worker crashes…

429 14d ago A 315 tokens original Apache-2.0

blueprint

13

astronomer/agents

Skill Claude CodeCodex

Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML. Use when creating blueprint templates, composing DAGs from YAML, validating configurations, or enabling no-code DAG authoring for non-engineers.

429 14d ago A 49 tokens original Apache-2.0

dagster-expert

14

dagster-io/skills

Skill Claude CodeCodex

Expert guidance for working with Dagster and the dg CLI. ALWAYS use before doing any task that requires knowledge specific to Dagster, or that references assets, materialization, components, data tools or data pipelines. Common tasks may include creating a new project, adding new definitions, understanding the current…

200 4d ago A 100 tokens original Apache-2.0

pr-verify

15

docglow/docglow

Skill Claude CodeCodex

Verify a Docglow change actually works before submitting or merging a PR. Runs the conformance suite, then a behavioral verification pass (flag matrix, artifact-join spot checks, pipeline contract sweep, payload budget). Use when reviewing a PR, self-reviewing a branch before opening a PR, or when asked to "verify…

139 19d ago A 79 tokens original MIT

altimate-code

16

AltimateAI/data-engineering-skills

Skill Claude CodeCodex

Delegates dbt and warehouse work to altimate-code, a specialized CLI agent with 100+ purpose-built data tools. USE THIS SKILL FIRST whenever the task mentions or implies: warehouse access (Snowflake, BigQuery, Redshift, Databricks, Postgres, MySQL, DuckDB), column-level lineage, downstream-impact analysis, dbt builds…

122 1mo ago A 184 tokens original MIT

AltimateAI/data-engineering-skills

Skill Claude CodeCodex

Debugs and fixes dbt errors systematically. Use when working with dbt errors for: (1) Task mentions "fix", "error", "broken", "failing", "debug", "wrong", or "not working" (2) Compilation Error, Database Error, or test failures occur (3) Model produces incorrect output or unexpected results (4) Need to troubleshoot…

122 1mo ago A 112 tokens original MIT

AltimateAI/data-engineering-skills

Skill Claude CodeCodex

Develops and troubleshoots dbt incremental models. Use when working with incremental materialization for: (1) Creating new incremental models (choosing strategy, uniquekey, partition) (2) Task mentions "incremental", "append", "merge", "upsert", or "late arriving data" (3) Troubleshooting incremental failures (merge…

122 1mo ago A 112 tokens original MIT

data-divergence

19

andre-salvati/databricks-template

Skill Claude CodeCodex

Investigate why two datasets that should agree don't — two pipelines writing the same logical table, a rollup vs the detail it aggregates, a dashboard vs its source, one environment vs another. Use when row counts, totals, or date ranges disagree and the question is what happened rather than just what differs. Covers…

83 25d ago A 123 tokens original Apache-2.0

project-costs

20

andre-salvati/databricks-template

Skill Claude CodeCodex

Run the project cost report and write the analysis into it. Use when asked about this project's cloud spend, cost anomalies, spikes or trends, DBU/DSU consumption, per-job or per-pipeline cost, or the AWS vs Databricks split. Runs make project-costs (AWS Cost Explorer + Databricks system.billing), then analyses the…

83 25d ago A 93 tokens original Apache-2.0

sql-diagram

21

andre-salvati/databricks-template

Skill Claude CodeCodex

Diagram a SQL query and explain what it shows — either its execution steps (mode=plan) or its column lineage (mode=lineage) — then trace it through small data so the defects the picture cannot show become visible. Use when asked to visualize, diagram, explain or review what a query does, how it joins its tables, or…

83 25d ago A 121 tokens original Apache-2.0

misata

22

rasinmuhammed/misata

Skill Claude CodeCodex

Generate realistic multi-table test data, seed a development database, or build fixtures whose joins and totals actually hold. Use when the user needs test data, sample data, demo data, seed data, fixtures, a populated dev/staging database, or a relational dataset shaped to specific numbers (a revenue curve, a churn…

67 yesterday A 90 tokens original MIT

kafka-dlq-review

23

lensesio/agentic-engineering-for-apache-kafka

Skill Claude CodeCodex

Review dead letter queue implementations for completeness using the Lenses MCP server. Checks DLQ topic existence, configuration, monitoring, metadata preservation, retry logic, reprocessing paths and connector DLQ alignment. Use when user says "review dead letter queues", "check DLQ setup", "DLQ audit" or asks about…

56 11d ago A 93 tokens original MIT

lensesio/agentic-engineering-for-apache-kafka

Skill Claude CodeCodex

Generate a TestContainers Java test class that spins up ShadowTraffic in-process to populate a Kafka topic with synthetic data during tests. Invokes the kafka-shadowtraffic skill to build the ShadowTraffic config, then adapts it for a containerized test network and scaffolds a JUnit 5 test class with Kafka, optional…

56 11d ago A 165 tokens original MIT