Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
memory-bound
5 items with this tag.
Sep 10, 2026
Learn: The Quadratic Bottleneck & IO-Aware Attention
attention
transformers
flashattention
online-softmax
io-aware
memory-bound
long-context
foundations
Sep 02, 2026
Arithmetic Intensity
gpu
arithmetic-intensity
roofline
flops
bandwidth
memory-bound
compute-bound
llm-systems
Sep 02, 2026
KV Cache
gpu
kv-cache
inference
serving
decode
memory-bound
gqa
mqa
llm-systems
Sep 02, 2026
Prefill vs. Decode
gpu
prefill
decode
inference
ttft
tpot
compute-bound
memory-bound
llm-systems
Sep 02, 2026
Roofline Model
gpu
roofline
arithmetic-intensity
ridge-point
memory-bound
compute-bound
performance-modeling
llm-systems