distributed training skills

40 tagged distributed training, measured the same way as everything else here.

Browse within: GRPO 19Post-Training 19Multi-Agent 14Multimodal 14agentic-rl 14DeepSpeed 11ai-research 10Mixed Precision 9PyTorch 8agentskills 8FSDP 7DDP 6Accelerate 5FSDP2 5

debug-hang

01

redai-infra/Relax

Skill Claude CodeCodex

A troubleshooting workflow for Ray, a system that runs machine-learning jobs across multiple computers or GPUs, when a distributed training job stops making progress.

580 4d ago A 67 tokens original Apache-2.0

redai-infra/Relax

Skill Claude CodeCodex

Integrate a new NVIDIA NeMo Gym environment into Relax as a three-step recipe. Use when adding or debugging a recipe under examples/nemogymagentic/recipes; covers data preparation, a local private Gym service, direct Ray training launch, verifier validation, callback networking, lifecycle cleanup, and failure triage.

580 4d ago A 73 tokens original Apache-2.0

verl-to-relax

03

redai-infra/Relax

Skill Claude CodeCodex

Migrate RL training recipes from verl to Relax framework. Use when user wants to port reward functions, tool environments, training scripts, or any recipe code from the verl (volcengine/verl) codebase to Relax. Handles reward, rollout, tool/env, dataset, and launch script conversion. Supports both colocate (default)…

580 4d ago A 78 tokens original Apache-2.0

remote-gpu-trainer

04

Hanyuyuan6/remote-gpu-trainer

Skill Claude CodeCodex

Use when running, debugging, verifying, or delivering a deep-learning experiment on an owned or rented GPU, especially AutoDL or a remote SSH host; also use for Windows + Clash/Mihomo high-port SSH banner timeouts, fake-IP, or TUN routing interference. Covers launch, checkpoint/resume, detached monitoring…

62 22d ago A 174 tokens original MIT