138 tagged llmops, measured the same way as everything else here.
Browse within: openai 40large-language-models 35self-hosted 35agentic-workflows 18copilot 18mkdocs 18newsletter 18agent-orchestration 15coding-agents 14annotations 12feedback-loop 12hypothesis-testing 12prompt-engineering 12regression-testing 12
Skill Claude CodeCodex
Knowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack.".
Skill Claude CodeCodex
A test skill created specifically for deletion testing.
Skill Claude CodeCodex
A test skill created by LiteLLM automated tests.
Skill Claude CodeCodex
Tune and review Langfuse autoscaling for web, web-iso, and web-ingestion. Use for Terraform scale settings, RPM targets, scaling bounds, task counts, cost/performance tradeoffs, or Datadog evidence in the infrastructure repo.
Skill Claude CodeCodex
Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends Codex's capabilities with specialized knowledge, workflows, or tool integrations.
Skill Claude CodeCodex
Configure and troubleshoot Turborepo monorepos. Use for turbo.json, task pipelines, dependsOn, caching, filters, affected packages, CI optimization, environment variables, package boundaries, or shared internal packages.
Skill Claude CodeCodex
Standards for creating redteam plugins and graders. Use when creating new plugins, writing graders, or modifying attack templates.
Skill Claude CodeCodex
Write, refine, run, and QA promptfoo evaluation suites: promptfooconfig.yaml, prompts, providers, vars, tests, assertions, model-graded rubrics, transforms, datasets, exports, and CI gates. Use for non-redteam eval coverage, regression tests, or new eval matrices. Do not use for adversarial redteam plugin or strategy…
Skill Claude CodeCodex
Create or refine promptfoo redteam setup configs: purpose, targets, plugins, strategies, frameworks, multi-input target inputs, policy text, grader guidance, contexts, and static-code-derived target/threat mapping. Use when preparing a red team scan plan from live probes, code evidence, or provider configs, or when…
Skill Claude CodeCodex
Diagnose low evaluation scores and generate actionable improvement recommendations.
Skill Claude CodeCodex
Configure feedback functions and selectors for TruLens evaluations.
Skill Claude CodeCodex
Instrument LLM apps with TruLens OTEL-based tracing - from setup to debugging and optimization.
Skill Claude CodeCodex
Runs every test suite in the paddler workspace on the fastest available device. Use when the user asks to run the tests, run all the tests, run the full test suite, or check that everything still passes.
Skill Claude CodeCodex
Runs every test suite in the paddler workspace on the fastest available device, and produces code coverage report. Use when the user asks to run the code coverage, or to check the coverage.
Skill Claude CodeCodex
Debug LLM applications using the Phoenix CLI. Fetch traces, analyze errors, structure trace review with open coding and axial coding, inspect datasets, review experiments, query annotation configs, and use the GraphQL API. Use whenever the user is analyzing traces or spans, investigating LLM/agent failures, deciding…
Skill Claude CodeCodex
Review Python OpenInference instrumentation code for correctness and completeness. Use this skill when reviewing a Python instrumentor package — whether it's a new instrumentor, a PR that modifies one, or when the user asks to audit/review/check an existing instrumentor's code quality. Trigger on phrases like "review…
Skill Claude CodeCodex
Run, interpret, and iterate on the OpenInference GenAI conformance MVP at python/openinference-instrumentation/scripts/conformance/. Use when the user mentions GenAI conformance, OTel GenAI semantic conventions, Weaver registry live-check, the dual-write conversion (genaiconversion.py, enablegenaisemconv), genai.…
Skill Claude CodeCodex
Add a new model to an existing provider.
Skill Claude CodeCodex
Review a provider implementation for correctness and consistency with other providers.
Skill Claude CodeCodex
From idea to production in just few lines: Graph-Based Programmable Neuro-Symbolic LM Framework - a production-first LM framework built with decade old Deep Learning best practices.
Skill Claude CodeCodex
Colour, font and design-token rules for the docs site — when hex is banned, when it is correct, and which surfaces ignore the theme. Use when styling docs components or editing CSS under docs/src.
Skill Claude CodeCodex
Manage git worktrees with their own dev ports, symlinked .env files, playground, and simulations. Use when the user asks to create, set up, list, enter, or remove a worktree.
Skill Claude CodeCodex
Design, run, and analyze AI test suites on Rhesis — explore endpoints, build test foundations from a spec, create requirements and metrics, execute tests, and analyze results. Use when testing an AI endpoint, pasting a Product Requirements Document (PRD) or product spec, or working with Rhesis via MCP.
Skill Claude CodeCodex
Onboard or periodically reverify and benchmark a Hugging Face model on an exact target GPU platform. Use when asked to add a model recipe, refresh a maintained recipe on a supplied GPU server, benchmark serving, create reproducible experiments and a durable results report, fully qualify and tune the model's Emmy…