Gunjan Dhanuka — Learning Notes

dtensor

1 item with this tag.

  • Sep 02, 2026

    FSDP (Fully Sharded Data Parallel)

    • gpu
    • distributed-training
    • fsdp
    • fsdp2
    • pytorch
    • dtensor
    • sharded-data-parallelism
    • zero
    • collectives

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source