basedosdados

18 mods across 1 repository, 49 stars between them.

architecture

01

basedosdados/pipelines

Agent Claude Code

Fetches or creates architecture tables for a Data Basis dataset on Google Drive. Each table in the dataset gets one Google Sheets file defining column names, types, descriptions, and metadata.

49 today A 38 tokens

cleaner

02

basedosdados/pipelines

Agent Claude Code

Writes and runs Python data cleaning code for a Data Basis dataset, producing partitioned Parquet output that conforms to the architecture table schema.

49 today A 30 tokens

context

03

basedosdados/pipelines

Agent Claude Code

Gathers all context needed to onboard a dataset to Data Basis — raw source URLs, documentation, organization, themes, coverage, and Drive folder path.

49 today A 32 tokens

dbt

04

basedosdados/pipelines

Agent Claude Code

Writes DBT SQL model files and schema.yml for a Data Basis dataset, then runs and fixes tests.

49 today A 24 tokens

discover

05

basedosdados/pipelines

Agent Claude Code

Resolves all reference IDs from the Data Basis backend needed for metadata creation — organizations, themes, tags, entities, statuses, and existing dataset/table IDs.

49 today A 33 tokens

metadata

06

basedosdados/pipelines

Agent Claude Code

Registers or updates all metadata in the Data Basis backend — dataset, tables, columns, observation levels, coverage, and updates. Handles both dev and prod environments.

49 today A 34 tokens

orchestrator

07

basedosdados/pipelines

Agent Claude Code

Orchestrates the full dataset onboarding workflow for Data Basis — from raw data → clean data → BigQuery → metadata in the backend. Spawn this agent when the user asks to onboard a dataset.

49 today A 43 tokens

pipeline-fixer

08

basedosdados/pipelines

Agent Claude Code

Orchestrates repair of failing Prefect 3 pipelines. Runs the pipeline-doctor skill to survey and triage, then dispatches one pipeline-investigator subagent per fixable cluster, each on its own branch and PR. Spawn when asked to fix broken pipelines, work through the failing-pipeline backlog, or get prod flows green…

49 today A 73 tokens

basedosdados/pipelines

Agent Claude Code

Investigates and fixes ONE failing Prefect pipeline cluster — reads the run logs, confirms the cause against the source and the code, makes the minimal change on its own branch, and verifies it. Dispatched by the pipeline-fixer orchestrator, one per cluster.

49 today A 57 tokens

pipeline

10

basedosdados/pipelines

Agent Claude Code

Builds a recurring Prefect 3 pipeline for an already-onboarded Data Basis dataset — download, clean, upload (dev+prod), dbt, and metadata refresh on a schedule.

49 today A 41 tokens

pr

11

basedosdados/pipelines

Agent Claude Code

Opens a GitHub pull request for a Data Basis dataset onboarding, with a structured changelog and checklist.

49 today A 24 tokens

raw-data-downloader

12

basedosdados/pipelines

Agent Claude Code

Downloads raw data files for a Data Basis dataset from the source URL(s). Handles diverse download mechanisms including direct HTTP, FTP, APIs, paginated endpoints, and portal scraping.

49 today A 40 tokens

uploader

13

basedosdados/pipelines

Agent Claude Code

Uploads cleaned Parquet files to BigQuery via the basedosdados Python package. Handles dev and prod environments.

49 today A 25 tokens

validator

14

basedosdados/pipelines

Agent Claude Code

Runs DBT tests and validates data quality for a Data Basis dataset. Flags anomalies and proposes fixes or escalates to the user.

49 today A 28 tokens

pipeline-doctor

16

basedosdados/pipelines

Skill Claude CodeCodex

Triage, diagnose, and fix failing Prefect 3 pipelines in this repo. Surveys recent failed flow runs and deployment arming state, groups failures by root cause, classifies each against a failure taxonomy, and drives fixes through branch → PR → label → dev run → merge. Use when asked to check on broken pipelines, find…

49 today A 88 tokens

pipelines AGENTS.md

17

basedosdados/pipelines

Instructions file CodexOpenCode

AGENTS.md instructions for basedosdados/pipelines, covering agents.md, project overview, environment details, repository structure and working with prefect pipelines.

49 today A 4,607 tokens

pipelines CLAUDE.md

18

basedosdados/pipelines

Instructions file

Claude Code instructions for basedosdados/pipelines, a project described as: 🔀 Orquestrador de fluxos de captura, ingestão e tratamento de dados da BD.

49 today A 4 tokens