Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
foundations
3 items with this tag.
Sep 10, 2026
Positional Encoding
attention
positional-encoding
sinusoidal
learned-embedding
relative-position
transformers
foundations
Sep 10, 2026
Learn: Scaled Dot-Product Attention
attention
transformers
sdpa
softmax
foundations
Sep 10, 2026
Learn: The Quadratic Bottleneck & IO-Aware Attention
attention
transformers
flashattention
online-softmax
io-aware
memory-bound
long-context
foundations