math-inc

60 mods across 1 repository, 1.3k stars between them.

guidance

49

math-inc/OpenGauss

Skill Claude CodeCodex

Control LLM output with regex and grammars, guarantee valid JSON/XML/code generation, enforce structured formats, and build multi-step workflows with Guidance - Microsoft Research's constrained generation framework.

1.3k 4mo ago A 38 tokens original MIT

instructor

50

math-inc/OpenGauss

Skill Claude CodeCodex

Extract structured data from LLM responses with Pydantic validation, retry failed extractions automatically, parse complex JSON with type safety, and stream partial results with Instructor - battle-tested structured output library.

1.3k 4mo ago A 41 tokens original MIT

llama-cpp

51

math-inc/OpenGauss

Skill Claude CodeCodex

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

1.3k 4mo ago A 76 tokens copy · 95% MIT

obliteratus

52

math-inc/OpenGauss

Skill Claude CodeCodex

Remove refusal behaviors from open-weight LLMs using OBLITERATUS — mechanistic interpretability techniques (diff-in-means, SVD, whitened SVD, LEACE, SAE decomposition, etc.) to excise guardrails while preserving reasoning. 9 CLI methods, 28 analysis modules, 116 model presets across 5 compute tiers, tournament…

1.3k 4mo ago A 103 tokens copy · 95% MIT

outlines

53

math-inc/OpenGauss

Skill Claude CodeCodex

Guarantee valid JSON/XML/code structure during generation, use Pydantic models for type-safe outputs, support local models (Transformers, vLLM), and maximize inference speed with Outlines - dottxt.ai's structured generation library.

1.3k 4mo ago B 50 tokens copy · 92% MIT

tensorrt-llm

54

math-inc/OpenGauss

Skill Claude CodeCodex

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

1.3k 4mo ago A 75 tokens copy · 97% MIT

serving-llms-vllm

55

math-inc/OpenGauss

Skill Claude CodeCodex

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

1.3k 4mo ago A 75 tokens copy · 92% MIT

math-inc/OpenGauss

Skill Claude CodeCodex

PyTorch library for audio generation including text-to-music (MusicGen) and text-to-sound (AudioGen). Use when you need to generate music from text descriptions, create sound effects, or perform melody-conditioned music generation.

1.3k 4mo ago A 54 tokens copy · 88% MIT

clip

57

math-inc/OpenGauss

Skill Claude CodeCodex

OpenAI's model connecting vision and language. Enables zero-shot image classification, image-text matching, and cross-modal retrieval. Trained on 400M image-text pairs. Use for image search, content moderation, or vision-language tasks without fine-tuning. Best for general-purpose image understanding.

1.3k 4mo ago A 60 tokens original MIT

llava

58

math-inc/OpenGauss

Skill Claude CodeCodex

Large Language and Vision Assistant. Enables visual instruction tuning and image-based conversations. Combines CLIP vision encoder with Vicuna/LLaMA language models. Supports multi-turn image chat, visual question answering, and instruction following. Use for vision-language chatbots or image understanding tasks. Best…

1.3k 4mo ago A 64 tokens original MIT

math-inc/OpenGauss

Skill Claude CodeCodex

Foundation model for image segmentation with zero-shot transfer. Use when you need to segment any object in images using points, boxes, or masks as prompts, or automatically generate all object masks in an image.

1.3k 4mo ago A 45 tokens original MIT

math-inc/OpenGauss

Skill Claude CodeCodex

State-of-the-art text-to-image generation with Stable Diffusion models via HuggingFace Diffusers. Use when generating images from text prompts, performing image-to-image translation, inpainting, or building custom diffusion pipelines.

1.3k 4mo ago A 50 tokens original MIT