Pretraining skills

5 tagged Pretraining, measured the same way as everything else here.

Browse within: Context Parallel 6Distributed Training 6FSDP2 6Float8 6Model Architecture 6Pipeline Parallel 6Tensor Parallel 6TorchTitan 6llama 6

minimind-learning

01

joyehuang/minimind-notes

Skill Claude CodeCodex

A Chinese-language learning assistant for MiniMind, a small language-model project, that records study notes and recognizes common machine-learning terms.

not rated 184 +7 3mo ago A 76 tokens original Apache-2.0