cas-bigdatalab/piflow

πflow is a big data flow engine with spark support

539Stars on the repository
199Mods indexed here, across every type
yesterdayLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

cas-bigdatalab/piflow

Skill Claude CodeCodex

An image filter that identifies images likely to contain watermarks and keeps images that are probably watermark-free.

not rated 539 yesterday A 101 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A 7z archive preview tool that scans folders for 7z files, lists their contents, and can show text snippets.

not rated 539 yesterday A 167 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A RAR archive preview tool that scans folders for RAR files, lists their contents, and can show text snippets.

not rated 539 yesterday A 158 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A TAR archive preview tool that scans folders for TAR files and lists their contents, with optional text snippets.

not rated 539 yesterday A 179 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A ZIP archive extraction tool that handles regular and split ZIP files, which are stored across files such as .z01 and .z02.

not rated 539 yesterday A 79 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A ZIP archive preview tool that scans folders for ZIP files, lists their contents, and can show text snippets.

not rated 539 yesterday A 162 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-cleaning tool that removes invisible or disruptive characters, such as zero-width spaces, byte-order marks, and bidirectional control characters.

not rated 539 yesterday A 80 tokens

key_value_grouper

107

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-processing tool that groups or handles values by their keys in an input list.

not rated 539 yesterday A 96 tokens

keyword_extractor

108

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-processing tool that reads tables or JSONL records and adds a field containing the main keywords from each text.

not rated 539 yesterday A 126 tokens

language_filter

109

cas-bigdatalab/piflow

Skill Claude CodeCodex

A language-detection filter for text columns that keeps or removes selected languages and adds a detected-language field.

not rated 539 yesterday A 41 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that keeps samples written in a chosen language when the language detector is confident enough. The confidence score indicates how certain the detection is.

not rated 539 yesterday A 106 tokens

local_formatter

111

cas-bigdatalab/piflow

Skill Claude CodeCodex

A local dataset loader that reads data from files or folders on the same computer.

not rated 539 yesterday A 95 tokens

lowinfo_filter

112

cas-bigdatalab/piflow

Skill Claude CodeCodex

A filter that removes records containing too little useful information from a dataset.

not rated 539 yesterday A 0 tokens

markdown_stripper

113

cas-bigdatalab/piflow

Skill Claude CodeCodex

A Markdown-to-plain-text tool that removes formatting such as headings, links, code blocks, quotes, and list markers. Markdown is a text notation used to format documents.

not rated 539 yesterday A 102 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data filter that keeps JSONL records whose selected text fields stay within a chosen maximum line length. JSONL is a text format with one JSON record per line.

not rated 539 yesterday A 109 tokens

meta_tags_aggregator

115

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tagging tool that combines metadata tags with similar meanings into shared categories.

not rated 539 yesterday A 101 tokens

mineru_file_parse

116

cas-bigdatalab/piflow

Skill Claude CodeCodex

A file-parsing tool from the MinerU project that extracts information from supported document files.

not rated 539 yesterday A 70 tokens

mineru_url_parse

117

cas-bigdatalab/piflow

Skill Claude CodeCodex

A document parser that sends an online file URL to the MinerU service and returns the parsed result as a ZIP archive. MinerU can process PDFs, Word documents, presentations, spreadsheets, and images, including their text, formulas, and pictures.

not rated 539 yesterday A 71 tokens

missing_value_remover

118

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-cleaning step that removes rows containing missing values from structured files.

not rated 539 yesterday A 0 tokens

mixture_formatter

119

cas-bigdatalab/piflow

Skill Claude CodeCodex

A dataset-mixing tool that randomly selects samples from multiple datasets, combines them, and exports a new mixed dataset.

not rated 539 yesterday A 118 tokens

mojibake_repairer

120

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-repair tool that detects mojibake—garbled text caused by reading a file with the wrong character encoding—and tries multiple encoding conversions to restore it.

not rated 539 yesterday A 105 tokens

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: