Gunjan Dhanuka — Learning Notes

memory-bound

5 items with this tag.

  • Sep 10, 2026

    Learn: The Quadratic Bottleneck & IO-Aware Attention

    • attention
    • transformers
    • flashattention
    • online-softmax
    • io-aware
    • memory-bound
    • long-context
    • foundations
  • Sep 02, 2026

    Arithmetic Intensity

    • gpu
    • arithmetic-intensity
    • roofline
    • flops
    • bandwidth
    • memory-bound
    • compute-bound
    • llm-systems
  • Sep 02, 2026

    KV Cache

    • gpu
    • kv-cache
    • inference
    • serving
    • decode
    • memory-bound
    • gqa
    • mqa
    • llm-systems
  • Sep 02, 2026

    Prefill vs. Decode

    • gpu
    • prefill
    • decode
    • inference
    • ttft
    • tpot
    • compute-bound
    • memory-bound
    • llm-systems
  • Sep 02, 2026

    Roofline Model

    • gpu
    • roofline
    • arithmetic-intensity
    • ridge-point
    • memory-bound
    • compute-bound
    • performance-modeling
    • llm-systems

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source