streaming-patterns

streaming-patterns is a skill for Claude Code from Methasit-Pun/data_engineer_claude_skills. It costs 143 tokens per session (2,136 once invoked), scanned A, original, no licence file.

A guide to processing data as it arrives instead of waiting for large scheduled batches. It covers Kafka, Flink, Kinesis, and Spark Structured Streaming, along with message distribution, processing guarantees, delays, time windows, and late data.

In plain words
What is it for?
Use it when building real-time or near-real-time pipelines, redesigning batch processing for live updates, or planning message partitions and time-based processing.
Why use it?
It helps design systems that handle live data reliably and makes issues such as processing delays or out-of-order events easier to address.

Skill for Claude Code

Written for Claude Code: shipped in a Claude Code plugin.

Part of the data-engineer-skills plugin — 28 skills shipped together

Good fit Use it when building real-time or near-real-time pipelines, redesigning batch processing for live updates, or planning message partitions and time-based processing.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/methasit-pun/data_engineer_claude_skills/streaming-patterns
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add Methasit-Pun/data_engineer_claude_skills --skill streaming-patterns
Clone the repo
git clone --depth 1 https://github.com/Methasit-Pun/data_engineer_claude_skills

Made for: Claude Code.

Or install data-engineer-skills, the plugin that ships this one along with the rest of its 28 skills.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for streaming-patterns

README.md
[![agentmods](https://agentmods.dev/badge/skills/methasit-pun/data_engineer_claude_skills/streaming-patterns.svg)](https://agentmods.dev/skills/methasit-pun/data_engineer_claude_skills/streaming-patterns)
Your own site
<a href="https://agentmods.dev/skills/methasit-pun/data_engineer_claude_skills/streaming-patterns"><img src="https://agentmods.dev/badge/skills/methasit-pun/data_engineer_claude_skills/streaming-patterns.svg" alt="Measured on agentmods" height="20"></a>
Per session 143 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,136 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin unknown No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00143 $0.02136
Opus 5 $0.00072 $0.01068
Sonnet 5 $0.00029 $0.00427
Haiku 4.5 $0.00014 $0.00214

Measured 7d ago against content hash fa4c2f5df435, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-07, from the pricing page.

Security

Grade A, and why

streaming-patterns scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

05-etl-build/streaming-patterns/SKILL.md · 260 lines

The source is not reproduced here

No licence file

A repository with no LICENSE is all rights reserved by default, so the body is not copied here. The metadata, the measurements and the link are.

Read it on GitHub

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 260 lines · 143 tokens per session scan A fa4c2f5df435

Subscribe to this mod's changes

streaming-patterns is a skill published in the GitHub repository Methasit-Pun/data_engineer_claude_skills (1 stars, last pushed 1mo ago), with no licence file. It adds 143 tokens to every session and 2,136 once invoked, about $0.0007 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

altimate-code

Delegates dbt and warehouse work to altimate-code, a specialized CLI agent with 100+ purpose-built data tools. USE THIS SKILL FIRST whenever the task mentions or implies: warehouse access (Snowflake, BigQuery, Redshift, Databricks, Postgres, MySQL, DuckDB), column-level lineage, downstream-impact analysis, dbt builds…

AltimateAI/data-engineering-skills · 0 tokens

debugging-dbt-errors

Debugs and fixes dbt errors systematically. Use when working with dbt errors for: (1) Task mentions "fix", "error", "broken", "failing", "debug", "wrong", or "not working" (2) Compilation Error, Database Error, or test failures occur (3) Model produces incorrect output or unexpected results (4) Need to troubleshoot…

AltimateAI/data-engineering-skills · 112 tokens

documenting-dbt-models

Documents dbt models and columns in schema.yml. Use when working with dbt documentation for: (1) Adding model descriptions or column definitions to schema.yml (2) Task mentions "document", "describe", "description", "dbt docs", or "schema.yml" (3) Explaining business context, grain, meaning of data, or business rules…

AltimateAI/data-engineering-skills · 105 tokens

refactoring-dbt-models

Safely refactors dbt models with downstream impact analysis. Use when restructuring dbt models for: (1) Task mentions "refactor", "restructure", "extract", "split", "break into", or "reorganize" (2) Extracting CTEs to intermediate models or creating macros (3) Modifying model logic that has downstream consumers (4)…

AltimateAI/data-engineering-skills · 108 tokens

testing-dbt-models

Adds schema tests and data quality validation to dbt models. Use when working with dbt tests for: (1) Adding or modifying tests in schema.yml files (2) Task mentions "test", "validate", "data quality", "unique", "notnull", or "acceptedvalues" (3) Ensuring data integrity - primary keys, foreign keys, relationships (4)…

AltimateAI/data-engineering-skills · 110 tokens

bulk-rnaseq

End-to-end bulk RNA-seq orchestrator — takes raw FASTQ reads through QC and trimming (FastQC, fastp/Trim Galore), alignment and quantification (STAR, Salmon, featureCounts), assembles a gene-level counts matrix, then hands off to differential expression (pydeseq2), pathway/GSEA enrichment (pathway-enrichment), and…

K-Dense-AI/scientific-agent-skills · 218 tokens