Reference documentation for the BenchAnswerGenerator operator. Covers the constructor, full run() signature, actual generation behavior, and integration notes for unified bench evaluation pipelines. Use when: generating model answers from benchmark question rows before passing the dataframe into…
Reference documentation for the ChunkedPromptedGenerator operator. Covers the constructor, file-path based chunking flow, actual prompt construction, and output file writing behavior. Use when: the dataframe stores file paths, the file content may exceed a single LLM context window, and you want the generated results…
Reference documentation for the EmbeddingGenerator operator. Covers the constructor, embedding serving requirements, actual dataframe flow, and runnable pipeline usage. Use when: converting one text column in a dataframe into embedding vectors for retrieval, clustering, similarity search, or downstream vector-based…
Reference documentation for the FormatStrPromptedGenerator operator. Covers the constructor, prompt template restrictions, placeholder-to-column mapping, actual prompt-building logic, and runnable example usage. Use when: one generation task needs multiple dataframe columns combined into a single prompt through a…
Reference documentation for the PromptedGenerator operator. Covers constructor parameters, run() signature, actual row-processing behavior, and pipeline usage notes. Use when: integrating PromptedGenerator into a DataFlow pipeline for single-field LLM generation.
Reference documentation for the RandomDomainKnowledgeRowGenerator operator. [Purpose] Calls an LLM repeatedly with the same domain-generation prompt and writes the generated results into one column of an existing DataFrame. [When to use] Use it when you already have a seed DataFrame with the exact target row count and…
Reference documentation for the RetrievalGenerator operator. [Purpose] Reads one text column from storage, forwards every non-empty row to llmserving.generatefrominput(...), and writes the returned list into a new output column. [Default backend] Use LightRAGServing by default. [Important] run() is async. The operator…
Reference documentation for the Text2MultiHopQAGenerator operator. [Purpose] Generates multi-hop QA pairs from one text column and writes two output columns: one for qapairs and one for metadata. [When to use] Use it when you want reasoning-style QA pairs derived from longer text chunks. If only simple single-hop QA…
Plan and write a standard DataFlow pipeline from a target and representative JSONL data. Use when a user asks to select DataFlow operators, trace field dependencies, generate runnable pipeline code, or repair a pipeline with schema or field-flow errors.
Build reusable DataFlow prompttemplate classes for existing operators with two-round structured intake, two-stage auditable outputs, and static acceptance checks. Trigger when users ask to generate/rewrite/optimize prompttemplate or reuse operator logic with new prompt requirements.
Promote exceptionally reviewed DataFlow pipelines into reusable task-pattern skills, or update an inferior same-task skill while preserving comparison evidence and history.
Reuse a reviewed pipeline pattern for constructing benchmark-aligned math reasoning SFT records from question-and-answer datasets with verifiable final answers.
Independently audit a generated DataFlow training-data pipeline and its trial artifacts with delegated rubric reviewers before it can be delivered or scaled.
Analyzer Skill is the Codex/Agent-facing capability for running LoopAI Analyzer independently. It analyzes evaluation outputs, writes Analyzer reports, emits stream events, returns unified success/error payloads, and can compare current results with a historical baseline.
Use this skill when the user wants LoopAI to validate training data, generate and approve training YAML, run LLaMA-Factory SFT or Verl GRPO, configure rewards, monitor or reconnect to Trainer workers, compare checkpoints, export a trained model, or inspect Trainer failures from starter.yaml or runtime state.
Use this skill when LoopAI needs dataset discovery, acquisition, web-page collection, DataMixer lakehouse operations, data processing, indexing, recipe planning, or production training-data export. In long-running Codex SDK loops, when Analyzer produces an analysis report, failure taxonomy, or user request that…