pyspark skills

16 tagged pyspark, measured the same way as everything else here.

Browse within: codex-skill 12iceberg 12

data-divergence

01

andre-salvati/databricks-template

Skill Claude CodeCodex

Investigate why two datasets that should agree don't — two pipelines writing the same logical table, a rollup vs the detail it aggregates, a dashboard vs its source, one environment vs another. Use when row counts, totals, or date ranges disagree and the question is what happened rather than just what differs. Covers…

83 26d ago A 123 tokens original Apache-2.0

project-costs

02

andre-salvati/databricks-template

Skill Claude CodeCodex

Run the project cost report and write the analysis into it. Use when asked about this project's cloud spend, cost anomalies, spikes or trends, DBU/DSU consumption, per-job or per-pipeline cost, or the AWS vs Databricks split. Runs make project-costs (AWS Cost Explorer + Databricks system.billing), then analyses the…

83 26d ago A 93 tokens original Apache-2.0

sql-diagram

03

andre-salvati/databricks-template

Skill Claude CodeCodex

Diagram a SQL query and explain what it shows — either its execution steps (mode=plan) or its column lineage (mode=lineage) — then trace it through small data so the defects the picture cannot show become visible. Use when asked to visualize, diagram, explain or review what a query does, how it joins its tables, or…

83 26d ago A 121 tokens original Apache-2.0

acceptance-audit

04

elitongadotti/cockpit

Skill Claude CodeCodex

Audit a ticket's acceptance criteria against what the branch actually implements. Every item must be satisfied, and each must semantically match the implementation. Never edit or drop a criterion without the user's agreement.

2 19d ago A 44 tokens

pycegerb-yoda

05

elitongadotti/cockpit

Skill Claude CodeCodex

Write and review PySpark against Iceberg tables — schema discipline, native functions over UDFs, correct write mode, and table maintenance.

2 19d ago A 35 tokens

shift-notes

06

elitongadotti/cockpit

Skill Claude CodeCodex

Write and read the between-session handoff file so a fresh agent with no memory can pick up where the last one stopped without re-deriving context. Structured prose, not JSON — the model writes prose better.

2 19d ago A 47 tokens