cas-bigdatalab/piflow

πflow is a big data flow engine with spark support

539Stars on the repository
199Mods indexed here, across every type
yesterdayLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

clean_links_mapper

49

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-processing component for cleaning or mapping links. The available description does not explain which link changes it makes or what inputs it accepts.

not rated 539 yesterday A 72 tokens

content_parser

50

cas-bigdatalab/piflow

Skill Claude CodeCodex

A preprocessing tool for turning collected JSONL, JSON, or TXT records into a consistent structure with titles, paragraphs, and content types. It can identify plain text, Markdown, and HTML structures.

not rated 539 yesterday A 139 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A check for logical relationships between two columns in structured data files such as CSV, TSV, and Excel. It supports six comparison operators and can combine multiple rules.

not rated 539 yesterday A 127 tokens

data_masking

52

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that masks sensitive fields in structured data by replacing characters while keeping the field and its position. It can mask phone numbers, identity numbers, names, email addresses, and bank cards.

not rated 539 yesterday A 114 tokens

data_merge_concat

53

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that appends multiple structured data files with the same columns row by row into one file. This operation is often called concatenation or vertical merging.

not rated 539 yesterday A 139 tokens

data_merge_join

54

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that joins multiple structured data files using a selected key, producing one file with related fields combined. A JOIN matches records that share the same key value.

not rated 539 yesterday A 115 tokens

data_normalizer

55

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that rescales numeric fields in JSONL files using either Z-score standardization or Min-Max scaling. It keeps the original values and marks which values were changed.

not rated 539 yesterday A 129 tokens

data_split_by_field

56

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that splits a structured data table into separate files based on one field. Each unique value in that field gets its own output file.

not rated 539 yesterday A 124 tokens

data_splitter

57

cas-bigdatalab/piflow

Skill Claude CodeCodex

A JSONL dataset splitter that divides one file into multiple subsets by percentage. JSONL is a format with one JSON record per line, and the tool supports random or field-based splitting that preserves category proportions.

not rated 539 yesterday A 135 tokens

data_type_converter

58

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-type conversion tool for changing fields between types such as numbers, text, and dates.

not rated 539 yesterday A 73 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A file-output stop operator for Dataspace, a storage area used by a data workflow. It receives one file from an earlier workflow step and uploads it to a specified relative directory, keeping the input filename.

not rated 539 yesterday A 63 tokens

doc-coauthoring

61

cas-bigdatalab/piflow

Skill Claude CodeCodex

Guide users through a structured workflow for co-authoring documentation. Use when user wants to write documentation, proposals, technical specs, decision docs, or similar structured content. This workflow helps users efficiently transfer context, refine content through iteration, and verify the doc works for readers.…

not rated 539 yesterday A 77 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A document-cleaning tool that identifies exact duplicate documents using MD5 hashes, which are fingerprints calculated from file contents.

not rated 539 yesterday A 111 tokens

docx_pack

63

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that rebuilds a DOCX file from an unpacked directory of its XML files.

not rated 539 yesterday A 17 tokens

docx_text_extract

64

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that extracts readable text from DOCX files, the file format used by Microsoft Word documents.

not rated 539 yesterday A 14 tokens

docx_to_markdown

65

cas-bigdatalab/piflow

Skill Claude CodeCodex

A converter that turns DOCX files, the file format used by Microsoft Word, into Markdown, a plain-text format for structured documents.

not rated 539 yesterday A 15 tokens

docx_unpack

66

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that unpacks a DOCX file, the file format used by Microsoft Word, into a directory of its underlying XML files.

not rated 539 yesterday A 13 tokens

docx_validate

67

cas-bigdatalab/piflow

Skill Claude CodeCodex

A document checker for DOCX files, the standard editable document format used by Microsoft Word.

not rated 539 yesterday A 11 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A dataset tool that finds records which match exactly, using pandas, a Python library for working with tables.

not rated 539 yesterday A 59 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool for finding similar, rather than identical, duplicate records in a dataset and applying a chosen retention rule.

not rated 539 yesterday A 73 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-cleaning tool that finds and removes similar repeated paragraphs, sentences, or continuous fragments within each text record.

not rated 539 yesterday A 132 tokens

duplicate_row_check

71

cas-bigdatalab/piflow

Skill Claude CodeCodex

A table checker that finds exact duplicate rows, either across all columns or a chosen set such as name and email.

not rated 539 yesterday A 67 tokens

empty_formatter

72

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool for creating empty datasets or other empty data structures for initialization and testing.

not rated 539 yesterday A 83 tokens

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: