Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
gelu
1 item with this tag.
Sep 10, 2026
Learn: Multi-Head Attention & the Transformer Block
attention
multi-head-attention
transformer-block
pre-ln
post-ln
layernorm
ffn
gelu
flops
scaling-laws