Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
torchtitan
1 item with this tag.
Sep 02, 2026
Learn: SOTA Large-Scale Training
gpu
distributed-training
3d-parallelism
fp8
transformer-engine
megatron
torchtitan
deepseek-v3
llama-3
mfu
activation-recomputation
fault-tolerance
moe