sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

About the project

SGLang is a framework for running inference for large language models and multimodal models, meaning it processes inputs to produce model outputs such as text or other media. It is used to serve and accelerate open AI models and related workloads.

This repository also configures its own agents. See what sglang tells them →

37kStars on the repository
32Mods indexed here, across every type
todayLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

sgl-project/sglang

Skill Claude CodeCodex

Use when adding a new diffusion model or Diffusers pipeline to SGLang.

not rated 37k +260 changed 10d ago A Snyk: passSkillSpector: warn 24 tokens original Apache-2.0

sgl-project/sglang

Skill Claude CodeCodex

Use when benchmarking denoise latency or profiling a diffusion bottleneck in SGLang.

not rated 37k +260 changed 10d ago A SkillSpector: pass 26 tokens original Apache-2.0

sgl-project/sglang

Skill Claude CodeCodex

Use when quantizing a diffusion DiT with NVIDIA ModelOpt and making the resulting FP8 or NVFP4 checkpoint loadable, verifiable, and benchmarkable in SGLang Diffusion.

not rated 37k +260 today A Snyk: passSkillSpector: pass 49 tokens original Apache-2.0

sgl-project/sglang

Skill Claude CodeCodex needs its repo

Use when choosing the fastest SGLang Diffusion flags for a model, GPU, and VRAM budget.

not rated 37k +260 changed 10d ago A Snyk: passSkillSpector: pass 29 tokens original Apache-2.0

sgl-project/sglang

Skill Claude Code needs its repo

Workflow for upgrading/integrating cache-dit in SGLang diffusion (multimodalgen): DBCache, DMD calibrator, TaylorSeer, SVDQuant DQ; porting upstream PRs and resolving conflicts against the per-request knob system; adding new cache knobs; building the sglang generate CLI test matrix; precision validation (PSNR / log…

not rated 37k +260 today A 161 tokens original Apache-2.0

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: