rocketride-configuring-pipelines

Configuring & Validating RocketRide Pipelines

Takes an approved topology (from rocketride-designing-pipelines) to a validated pipeline.pipe ready to run. Reliability comes from tools and a checklist, not cleverness: fetch schema → fill only real fields → checklist gate → validate() → re-validate until clean. Gate rules + forcing functions: ../rocketride-building-pipelines/GATE_PROTOCOL.md.

Step 1 — Configure each node (schema-driven, one at a time)

For every node in the approved topology, in order:

1. Fetch the schema (L2): describe_component / tools/fetch-node-schema.py <node> / .rocketride/schema/<node>.json. Never configure from memory. (Forcing function 5.) Fetch one node at a time — never bulk-load every schema (FF#17). If you already fetched this node's schema while designing (Phase 1b) this session, reuse it with --cache-ok (serves the cached copy with no reconnect — still schema-grounded, just not re-fetched); a full re-fetch only on a cache miss.

2. State what the schema says before filling: the required fields, any conditional rules in prose ("if batch_size set, max_batch_wait_ms is required"), and the profile shape for LLM/embedding/store nodes. (Forcing function 10.)

3. Fill only fields the schema defines. Use ${ROCKETRIDE_*} env references for secrets — never literal keys. Secret values never travel through tools or the model: over MCP, credentials are configured out-of-band — list_integrations reports per-integration readiness and (with a name) returns concrete setup steps to relay to the user. LLM/embedding/store nodes use a profile block:

   "config": { "profile": "openai-5", "openai-5": { "apikey": "${ROCKETRIDE_OPENAI_KEY}" }, "parameters": {} }
   

   Source nodes need the full source config, not {}: { "hideForm": true, "mode": "Source", "parameters": {}, "type": "<provider>" }.

   The block above is the <Good> shape. The <Bad> shape — guessed from memory — fails validation and leaks a key:

   "config": { "model": "gpt-5", "apikey": "sk-...", "max_tokens": 4096 }
   

   Three bugs in one line: a literal key (must be ${ROCKETRIDE_*}), no profile wrapper, and max_tokens is not a real field (the schema calls it modelTotalTokens). Fetch the schema, then copy the <Good> shape — never type config from memory.

4. Run the 9-point checklist as a gate (full list in PIPELINE_ANTIPATTERNS.md). State each item yes/no for this node before moving on — do not skip and claim "applied":

   Node <id>: 1 ext✓ 2 components-order✓ 3 literal-guid✓ 4 source-match✓ 5 unique-id✓ 6 input-array✓ 7 lane-types✓ 8 acyclic/no-orphan✓ 9 ROCKETRIDE_ env✓