Pretraining skills

6 tagged Pretraining, measured the same way as everything else here.

Browse within: Context Parallel 6Distributed Training 6FSDP2 6Float8 6Model Architecture 6Pipeline Parallel 6Tensor Parallel 6TorchTitan 6llama 6

minimind-learning

01

joyehuang/minimind-notes

Skill Claude CodeCodex

A Chinese-language learning assistant for MiniMind, a small language-model project, that records study notes and recognizes common machine-learning terms.

not rated 222 +4 4mo ago A SkillSpector: warn 76 tokens original Apache-2.0

huaweicloud/huaweicloud-skills

Skill Claude CodeCodex

Manage CloudRobo model training tasks and simulation reinforcement learning (SimRL) tasks — create pretrain (TRAINFROMSCRATCH) and finetune (MODELTUNING) tasks with FFT/SFT/LORA/QLORA/DEEPSPEED methods; manage the full task lifecycle (create/read/update/delete/stop/restart/resume/draft); save and resubmit draft…

not rated 59 +6 yesterday A 264 tokens original MIT

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: