jstzwj

jstzwj/ai-infra-plugins

Plugin Claude Code

Curated Claude Code plugins for AI infrastructure engineering, including GPU kernels, compilers, runtimes, benchmarking, and model serving systems.

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

NVIDIA Megatron-LM & Megatron Core - GPU-optimized framework for training large language models with tensor parallelism, pipeline parallelism, data parallelism (DDP/FSDP), context parallelism, expert parallelism, FP8/FP4 quantization, CUDA graphs, MoE (Mixture of Experts), multimodal models, and TensorRT-LLM export.…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for bitsandbytes, the k-bit quantization library for PyTorch enabling accessible large language models. Use this skill whenever the user mentions bitsandbytes, LLM.int8(), QLoRA, 4-bit quantization, 8-bit quantization, NF4, FP4, 8-bit optimizers, block-wise quantization…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for NVIDIA CUDA C++ - the parallel computing platform and programming model for GPU acceleration. Covers CUDA Programming Guide (Release 13.2) and CUDA C++ Best Practices Guide (Release 13.2). Includes programming model, memory management, asynchronous execution, CUDA…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

NVIDIA cuTile is a high-level, array-based programming framework for CUDA that abstracts away thread-level programming. Instead of writing SIMT (Single Instruction, Multiple Threads) code, developers write tile-based kernels that operate on multidimensional tiles of data. The cuTile compiler then maps these tiles to…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

NVIDIA CUTLASS CUDA Template Library - comprehensive reference for high-performance matrix multiplication (GEMM), convolution, tensor operations, and CuTe DSL across all GPU architectures (Volta through Blackwell).

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for DeepSpeed - the distributed deep learning training and inference optimization library. Covers ZeRO optimization (Stages 0-3), ZeRO-Offload, ZeRO-Infinity, SuperOffload, ZenFlow, pipeline parallelism, tensor parallelism (AutoTP), sequence parallelism (Ulysses/ALST)…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

The following reference files contain in-depth documentation for each component.

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for JAX - Google's library for high-performance numerical computing and machine learning research. Covers JAX core (transformations, tracing, jaxprs, pytrees), jax.numpy, jax.lax, jax.nn, jax.random, automatic differentiation (grad, customjvp, customvjp…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for MLIR (Multi-Level Intermediate Representation) - the extensible compiler infrastructure framework from the LLVM project. Covers the MLIR language reference, IR core concepts (Operations, Values, Blocks, Regions, Types, Attributes), dialect definitions (ODS…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for NVIDIA NCCL (Collective Communications Library), the GPU communication library for multi-GPU and multi-node collectives. Use this skill whenever the user mentions NCCL, all-reduce, all-gather, reduce-scatter, broadcast, gather/scatter, all-to-all, ncclSend/ncclRecv…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

NVIDIA Nsight Systems is a system-wide performance analysis tool that delivers an at-a-glance view of how an application uses the compute resources of the target machine. It is designed to help developers understand and optimize the performance of their GPU-accelerated applications by providing detailed timelines and…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for ONNX Runtime - the cross-platform high-performance inference and training engine for ONNX models. Covers C/C++ API, Python API (InferenceSession, OrtValue, SessionOptions), all Execution Providers (CUDA, TensorRT, OpenVINO, DNNL, CoreML, NNAPI, WebGPU, DirectML, QNN…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for PyTorch - the GPU-accelerated tensor computation and deep learning framework. Covers tensor operations, automatic differentiation, neural network modules (nn), optimization, distributed training, CUDA support, automatic mixed precision (AMP), torch.compile/Dynamo…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for Ray - a unified framework for scaling AI and Python applications. Covers Ray Core (tasks, actors, objects, scheduling, placement groups, namespaces, runtime environment, fault tolerance, compiled graphs, direct transport), Ray Data (datasets, transformations…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for SGLang - a high-performance serving framework for large language models and multimodal models. Covers SGLang architecture, ServerArgs configuration, OpenAI-compatible API server, native API, offline engine API, attention backends (FlashInfer, FlashAttention, Triton…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for TensorFlow - the end-to-end open source platform for machine learning. Covers TensorFlow 2.x Python API (tensors, operations, variables, autograd, tf.function, tf.data, Keras, distributed training), C++ core (graph execution, kernels, session, distributed runtime…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

The following reference files contain in-depth documentation for each chapter.

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for TileLang - a concise domain-specific language (DSL) for developing high-performance GPU/CPU kernels built on Apache TVM. Covers the complete programming model (3-level abstraction), language API (memory management, compute primitives, control flow, data movement)…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for OpenAI Triton - a language and compiler for writing highly efficient custom Deep-Learning primitives on GPUs. Covers Python API (triton.language, triton.runtime, triton.compiler), MLIR dialects and passes, backends (NVIDIA CUDA, AMD ROCm/HIP), experimental features…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Apache TVM is an open-source machine learning compilation framework that optimizes and deploys ML models across diverse hardware backends. It follows the principles of Python-first development and universal deployment.

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for vLLM - a high-throughput and memory-efficient inference and serving engine for large language models (LLMs). Covers vLLM architecture (V0 and V1), engine APIs (LLMEngine, AsyncLLMEngine, LLM), OpenAI-compatible API server, configuration system, model executor and…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference documentation and skill for xFormers, Facebook Research's toolbox to accelerate research on Transformers. Use this skill whenever the user mentions xformers, memoryefficientattention, FMHA, flash attention, SwiGLU, RMSNorm, RoPE, ropepadded, 2:4 structured sparsity, sparsify24, sequence…

jstzwj/ai-infra-plugins

Skill Claude CodeCodex

Comprehensive reference for XLA (Accelerated Linear Algebra) compiler - covering architecture, operation semantics, HLO IR, compilation pipeline, GPU/CPU/TPU backends, PJRT API, MLIR integration, custom calls, autotuning, SPMD partitioning, debugging tools, and build system.