cas-bigdatalab/piflow

πflow is a big data flow engine with spark support

539Stars on the repository
199Mods indexed here, across every type
2d agoLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

cas-bigdatalab/piflow

Skill Claude Code

A tool for creating or checking PiFlow-compatible coding-agent skills from completed data-processing tasks. It follows local templates and conventions to save the workflow as reusable skill files.

not rated 539 2d ago A 159 tokens

privacy_token_remover

146

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-cleaning tool that removes or replaces selected privacy identifiers, such as email addresses, IPv4 addresses, and phone numbers. It works on structured text data rather than images, audio, encrypted fields, or generated fake data.

not rated 539 2d ago A 112 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text tool that standardizes punctuation. It is intended for normalizing punctuation in text-processing workflows.

not rated 539 2d ago A 0 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-quality checker for a table’s quality flag field. It checks whether the field exists, is filled in, and contains only allowed values.

not rated 539 2d ago A 79 tokens

random_sampler

149

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool for randomly sampling records from JSONL data. JSONL is a text format with one JSON record per line; sampling is done without replacement, so a record cannot be selected twice.

not rated 539 2d ago A 132 tokens

random_selector

150

cas-bigdatalab/piflow

Skill Claude Code

A tool for randomly selecting records from a CSV file. You can choose a fraction of the records or a fixed count; if both are given, it uses the smaller result.

not rated 539 2d ago A 37 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A distributed tool for finding and removing identical documents from large collections. It uses Ray, a framework that splits work across multiple computers or processes, and compares file fingerprints.

not rated 539 2d ago A 118 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A distributed tool for finding and removing identical images from large collections. It uses Ray, a framework that splits work across multiple computers or processes.

not rated 539 2d ago A 110 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A distributed tool for finding and removing identical videos from large collections. It uses Ray, a framework that splits work across multiple computers or processes, and compares file fingerprints.

not rated 539 2d ago A 107 tokens

read_file_and_minus

155

cas-bigdatalab/piflow

Skill Claude CodeCodex

Minus all numbers in a text file by 5 and save to a new file. Use when user mentions read a file minus numbers by 15, process number file, batch calculation.

not rated 539 2d ago A 42 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

Multiply all numbers in a text file by 10 and save to a new file. Use when user mentions multiply numbers by 10, process number file, batch calculation.

not rated 539 2d ago A 40 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-checking tool that compares values in one table with reference values in another table. It checks whether child-table foreign keys point to existing parent records.

not rated 539 2d ago A 122 tokens

remote_formatter

158

cas-bigdatalab/piflow

Skill Claude CodeCodex

A remote data loader for datasets stored on Hugging Face Hub, an online repository for machine-learning datasets and models. It uses the DataJuicer Python package.

not rated 539 2d ago A 94 tokens

cas-bigdatalab/piflow

Skill Claude Code

A storage operation for saving analysis results and exporting them as CSV files. CSV is a simple table format that can be opened by spreadsheets and data tools.

not rated 539 2d ago A 27 tokens

schema_validator

160

cas-bigdatalab/piflow

Skill Claude CodeCodex

A schema-checking tool for structured data. A schema is a set of rules describing required fields, data types, allowed values, ranges, formats, and table-level limits.

not rated 539 2d ago A 171 tokens

scichem_normalizer

161

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-cleaning tool for mathematical notation, chemical formulas, reaction arrows, subscripts, full-width characters, and extra spaces. It is intended for laboratory records, paper excerpts, and other scientific text.

not rated 539 2d ago A 80 tokens

scsio_identify

162

cas-bigdatalab/piflow

Skill Claude CodeCodex

An image-based identification tool for marine life, such as animals and other organisms found in the sea.

not rated 539 2d ago A 41 tokens

slack-gif-creator

163

cas-bigdatalab/piflow

Skill Claude CodeCodex

Knowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack.".

not rated 539 2d ago A 51 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-cleaning tool that converts typographic characters such as curly quotation marks, long dashes, and ellipses into standard ASCII characters. ASCII is a basic character set widely accepted by software and plain-text formats.

not rated 539 2d ago A 87 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data filter that keeps samples whose proportion of special characters falls within a chosen range. A sample can be a row, document, or other individual data item.

not rated 539 2d ago A 98 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A filter for JSONL data that keeps or removes records based on specified field values. JSONL stores one JSON object per line.

not rated 539 2d ago A 101 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-normalization tool that converts British and American spelling variants to one consistent form, such as “colour” to “color.”

not rated 539 2d ago A 86 tokens

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: