collinear-ai/simlab

SimLab is the data layer for creating simulations to QA, evaluate, hillclimb, and refine agents.

24Stars on the repository
12Mods indexed here, across every type
27d agoLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

agent-baselining

01

collinear-ai/simlab

Skill Claude CodeCodex

Run an agent across SimLab tasks on Daytona to establish baseline performance scores.

24 27d ago A 0 tokens

claude-agent-sdk

02

collinear-ai/simlab

Skill Claude CodeCodex

Use this recipe when you already have an agent built with the Claude Agent SDK and want to run it in SimLab.

24 27d ago A 0 tokens

google-adk

03

collinear-ai/simlab

Skill Claude CodeCodex

Use this recipe when you want to run a Google Agent Development Kit agent inside SimLab.

24 27d ago A 0 tokens

collinear-ai/simlab

Skill Claude CodeCodex

Use this recipe when the user has an existing LangGraph or LangChain-based agent and wants to run it inside SimLab.

24 27d ago A 0 tokens

openai-agents-sdk

05

collinear-ai/simlab

Skill Claude CodeCodex

Use this recipe when you already have an agent built with the OpenAI Agents SDK and want to run it in SimLab.

24 27d ago A 0 tokens

persona-recipe

06

collinear-ai/simlab

Skill Claude CodeCodex

Define custom NPC personas in a SimLab task generation config and generate tasks with tailored stakeholder interactions.

24 27d ago A 0 tokens

secure-agent-eval

07

collinear-ai/simlab

Skill Claude CodeCodex

Run an agent with and without OneCLI's credential proxy to verify correctness, credential isolation, and rate limit resilience.

24 27d ago A 0 tokens

collinear-ai/simlab

Skill Claude CodeCodex

You are running an autonomous experiment loop that optimizes a system prompt for an AI agent evaluated on SimLab tasks. You will modify system-prompt.md, run the agent against tasks, measure the average reward, and iterate.

24 27d ago A 0 tokens

tinker-sft

09

collinear-ai/simlab

Skill Claude CodeCodex

Fine-tune a model on expert agent trajectories collected from SimLab using Tinker's supervised learning pipeline.

24 27d ago A 0 tokens

example-skill

10

collinear-ai/simlab

Skill Claude CodeCodex

Use this directory for reusable workflow notes that the coding agent can discover.

24 27d ago A 0 tokens

pdf-xlsx-reporting

11

collinear-ai/simlab

Skill Claude CodeCodex

Use this skill when a task asks you to summarize or extract data from PDF and XLSX files that already exist in the workspace.

24 27d ago A 0 tokens

cookbook-builder

12

collinear-ai/simlab

Skill Claude CodeCodex

Brainstorm, design, and scaffold new SimLab cookbook recipes from a rough idea.

24 27d ago A 0 tokens