Gunjan Dhanuka — Learning Notes

kernel-fusion

4 items with this tag.

  • Sep 02, 2026

    FlashAttention

    • gpu
    • flashattention
    • attention
    • io-aware
    • online-softmax
    • kernel-fusion
    • recomputation
    • hopper
    • blackwell
    • llm-systems
  • Sep 02, 2026

    Kernel Fusion

    • gpu
    • kernel-fusion
    • memory-wall
    • arithmetic-intensity
    • torch-compile
    • triton
    • llm-systems
  • Sep 02, 2026

    torch.compile (TorchDynamo / TorchInductor)

    • gpu
    • torch-compile
    • torchinductor
    • torchdynamo
    • aotautograd
    • triton
    • kernel-fusion
    • codegen
    • llm-systems
  • Sep 02, 2026

    Learn: The Memory Wall & FlashAttention

    • gpu
    • flashattention
    • kernel-fusion
    • online-softmax
    • memory-wall
    • io-aware
    • attention
    • arithmetic-intensity
    • hopper
    • blackwell

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source