Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
bigbird
2 items with this tag.
Sep 10, 2026
Sparse Attention
attention
sparse-attention
longformer
bigbird
global-tokens
dilation
random-attention
long-context
Sep 10, 2026
Learn: Sparse & Sliding-Window Attention
attention
transformers
sparse-attention
sliding-window
longformer
bigbird
attention-sinks
streaming
long-context
flops