Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
scaling-laws
3 items with this tag.
Sep 10, 2026
Learn: Multi-Head Attention & the Transformer Block
attention
multi-head-attention
transformer-block
pre-ln
post-ln
layernorm
ffn
gelu
flops
scaling-laws
Sep 02, 2026
Reward Overoptimization (Goodhart)
reward-overoptimization
reward-hacking
goodhart
scaling-laws
warm
kl-regularization
rl-for-llms
Sep 02, 2026
10 · Frontier RL — Infra & Open Problems
rl-infra
async-rl
off-policy
rlvr
agentic-rl
entropy-collapse
reward-overoptimization
post-training
scaling-laws
frontier