cas-bigdatalab/piflow

πflow is a big data flow engine with spark support

539Stars on the repository
199Mods indexed here, across every type
2d agoLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-cleaning tool that removes lines made only of repeated symbols or divider characters.

not rated 539 2d ago A 0 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tabular-data tool that finds unusually high or low numeric values using several statistical methods, including IQR, Z-score, and Isolation Forest.

not rated 539 2d ago A 177 tokens

stopwords_filter

171

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that keeps samples whose share of stopwords is above a chosen minimum. Stopwords are common words such as “the” and “of.”

not rated 539 2d ago A 101 tokens

stratified_sampler

172

cas-bigdatalab/piflow

Skill Claude CodeCodex

A sampling tool that divides structured data into groups based on a chosen field, then selects records from each group without replacement.

not rated 539 2d ago A 152 tokens

suffix_filter

173

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data filter that keeps samples whose names or values have a specified file suffix.

not rated 539 2d ago A 91 tokens

systematic_sampler

174

cas-bigdatalab/piflow

Skill Claude CodeCodex

A sampling tool that selects records at a fixed interval from ordered data.

not rated 539 2d ago A 118 tokens

tab_space_normalizer

175

cas-bigdatalab/piflow

Skill Claude CodeCodex

A whitespace-cleaning tool for structured data files that expands tabs, removes trailing spaces, and can remove shared indentation.

not rated 539 2d ago A 146 tokens

table_collector

176

cas-bigdatalab/piflow

Skill Claude CodeCodex

A table-reading tool that collects rows from CSV, TSV, and Excel files into one structured records file.

not rated 539 2d ago A 151 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A table-structure checker that compares a data table with a standard schema, meaning the expected column names and column count.

not rated 539 2d ago A 110 tokens

text_action_filter

178

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that keeps text containing action words, such as verbs describing operations.

not rated 539 2d ago A 89 tokens

text_collector

179

cas-bigdatalab/piflow

Skill Claude CodeCodex

A plain-text file collector that reads TXT, Markdown, reStructuredText, log, and other text files from a file or directory and produces structured text records.

not rated 539 2d ago A 138 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that finds entities—such as named people, places, or things—that are independent of the surrounding words, using dependency relationships in the text.

not rated 539 2d ago A 101 tokens

text_fragment_remover

181

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-fragment removal tool that deletes exact phrases supplied by the user from a text field while preserving the other fields.

not rated 539 2d ago A 132 tokens

text_splitter

183

cas-bigdatalab/piflow

Skill Claude CodeCodex

A long-text splitting tool that divides documents by paragraphs, sentences, line length, non-empty lines, or research-paper section headings.

not rated 539 2d ago A 129 tokens

time_anomaly_marker

184

cas-bigdatalab/piflow

Skill Claude CodeCodex

A time-series analysis tool that marks unusual numeric values and sudden changes using Z-scores and differences between consecutive points.

not rated 539 2d ago A 60 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A date and currency normalizer that converts common dates to YYYY-MM-DD and changes prefixed dollar, euro, and yen amounts into numeric USD, EUR, or CNY values.

not rated 539 2d ago A 126 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A time-series smoothness checker that detects jumps between neighboring values and repeated up-and-down movement within a window.

not rated 539 2d ago A 96 tokens

time_window_sampler

187

cas-bigdatalab/piflow

Skill Claude CodeCodex

A sampler for JSONL time-series data, which is data recorded over time in one JSON object per line. It groups records into time windows and selects samples evenly from each window.

not rated 539 2d ago A 116 tokens

token_num_filter

188

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that keeps samples whose total token count falls within a chosen range. Tokens are the pieces of text used by language-processing systems.

not rated 539 2d ago A 99 tokens

tsv_formatter

189

cas-bigdatalab/piflow

Skill Claude CodeCodex

A formatter for TSV files, where columns are separated by tab characters. It loads and formats these files for further data processing.

not rated 539 2d ago A 93 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A checker that tests whether values in selected fields are unique across an entire table. Empty values are skipped, and multiple fields are checked separately.

not rated 539 2d ago A 67 tokens

v1_FormatConsistency

191

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-structure checker that compares a file's column names and column count with a standard schema, which is the expected table layout.

not rated 539 2d ago A 110 tokens

v9_MarkFieldCheck

192

cas-bigdatalab/piflow

Skill Claude CodeCodex

A structured-data checker that looks for a quality-control identifier field, such as QC0000, and adds it when it is missing.

not rated 539 2d ago A 110 tokens

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: