cas-bigdatalab

60 mods across 1 repository, 539 stars between them.

cas-bigdatalab/piflow

Skill Claude CodeCodex

A PDF metadata extractor that reads document details such as title, author, subject, and page count, then returns them as JSON.

539 23d ago A 39 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A structured-data cleaning tool that removes rows with no values from CSV, TSV, and Excel files, then writes the result in the same format.

539 23d ago A 112 tokens

csv_formatter

03

cas-bigdatalab/piflow

Skill Claude CodeCodex

A CSV formatting tool for loading and formatting comma-separated value files, including converting CSV data to JSON Lines format. It requires Python and the data-juicer package.

539 23d ago A 86 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A PDF metadata extractor that reads document details such as title, author, subject, and page count, then returns them as JSON.

539 23d ago A 39 tokens

pdf_text_extract

05

cas-bigdatalab/piflow

Skill Claude CodeCodex

A PDF text extractor that reads the written content of a PDF and saves it as a plain-text file.

539 23d ago A 31 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A text-file transformation step that reads a file, sends its contents and your instructions to a large language model, and creates a new text file for the next workflow step.

539 23d ago A 36 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A workflow placeholder used when no suitable business skill exists yet. It keeps the workflow's data flow intact until a real skill can replace it.

539 23d ago A 49 tokens

sink_stop

08

cas-bigdatalab/piflow

Skill Claude CodeCodex

A workflow ending point that receives the result from earlier steps and saves it to a chosen path. A DAG is a workflow arranged as connected steps, so this node has no later step.

539 23d ago A 44 tokens

source_stop

09

cas-bigdatalab/piflow

Skill Claude CodeCodex

A workflow starting point that declares an input file and makes that data available to later steps. A DAG is a workflow arranged as connected steps, so this node has no earlier step.

539 23d ago A 45 tokens

DC2_SpaceCleaning

10

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-file tool that removes extra spaces at the beginning and end of text values. It works with structured files such as CSV, TSV, and Excel files.

539 23d ago A 118 tokens

DC3_RoundOff

11

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-file tool that rounds numeric fields according to settings in a configuration file. It then saves the result in the same file format.

539 23d ago A 105 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-file tool that adds a sequential ID column when the chosen ID field is missing. The IDs start at 1 and are placed in the first column.

539 23d ago A 121 tokens

Pi_DataSorting

13

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-file tool that sorts rows by a chosen field, either from smallest to largest or from largest to smallest.

539 23d ago A 83 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-quality tool that checks whether changes between neighboring points in a time series stay within a reasonable range. It identifies and marks unusual records, then saves the result in the same format.

539 23d ago A 117 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-quality tool that checks selected fields for empty or missing values such as NULL or NA. It identifies and marks records containing them, then saves the result in the same format.

539 23d ago A 107 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-quality tool that checks whether selected fields stay consistent within groups sharing the same values in specified fields. It marks groups where another selected field has multiple values.

539 23d ago A 129 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A data-quality tool that checks whether a key numeric measure stays unchanged for too long across consecutive time periods. It identifies and marks potentially abnormal records.

539 23d ago A 136 tokens

QC14_TimePeakValue

18

cas-bigdatalab/piflow

Skill Claude CodeCodex

A time-series check that finds runs of at least a specified number of neighboring readings where every change exceeds a set threshold. It identifies these continuous sharp changes.

539 23d ago A 131 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A time-series check that looks for changes larger than a set tolerance between readings within a chosen time window. It identifies and marks unusually large changes.

539 23d ago A 152 tokens

QC16_TimeMissing

20

cas-bigdatalab/piflow

Skill Claude CodeCodex

A time-series check that verifies whether records appear at the expected intervals, such as every 2, 30, or 60 minutes. It finds missing or extra time points and saves the checked data in the original format.

539 23d ago A 146 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A dictionary check that compares field values with the allowed entries in a standard list. Records containing values outside that list are marked and output as exceptions.

539 23d ago A 142 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A numeric data check that reads structured files such as CSV, TSV, or Excel and tests whether numeric fields stay within specified limits. It saves the checked data in the same format.

539 23d ago A 87 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A custom data check that applies user-defined condition expressions, similar to rules written in Hive SQL. Related data values must satisfy the stated constraints; failing records are marked and output as exceptions.

539 23d ago A 130 tokens

cas-bigdatalab/piflow

Skill Claude CodeCodex

A batch data check that compares several columns with upper and lower limits from a threshold table. It marks values that are outside the limits or missing, then saves the results in the original file format.

539 23d ago A 147 tokens