cas-bigdatalab/piflow

πflow is a big data flow engine with spark support

539Stars on the repository
199Mods indexed here, across every type
2d agoLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

video_deduplicator

193

cas-bigdatalab/piflow

Skill Claude CodeCodex

A video deduplication tool that uses MD5 hashes, digital fingerprints of file contents, to find and remove exact duplicate videos.

not rated 539 2d ago A 87 tokens

weighted_sampler

194

cas-bigdatalab/piflow

Skill Claude CodeCodex

A sampler for JSONL records that uses a numeric weight field to decide how often each record is selected. It supports sampling with or without replacement.

not rated 539 2d ago A 118 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that measures repeated word sequences, called n-grams, and keeps only samples within a chosen repetition range.

not rated 539 2d ago A 106 tokens

words_num_filter

196

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text filter that keeps samples whose total word count falls within a chosen range.

not rated 539 2d ago A 99 tokens

xlsx_pack

197

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that repackages an XML directory into an XLSX spreadsheet file. XLSX is the spreadsheet file format used by Microsoft Excel and many compatible tools.

not rated 539 2d ago A 17 tokens

xlsx_unpack

198

cas-bigdatalab/piflow

Skill Claude CodeCodex

A tool that unpacks an XLSX spreadsheet into a directory of XML files. XML is a text format that stores the spreadsheet's internal structure and data.

not rated 539 2d ago A 13 tokens

xlsx_validate

199

cas-bigdatalab/piflow

Skill Claude CodeCodex

An XLSX file-format validation skill. XLSX is the spreadsheet file format used by Microsoft Excel and many compatible tools.

not rated 539 2d ago A 11 tokens

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: