attention

Sep 11, 2026

• attention
• sota
• synthesis
• frontier
• rope
• gqa
• mla
• flashattention
• nsa
• sparse-attention
• ssm
• hybrids
• multimodal
• capstone
• transformers

Sep 10, 2026

• attention
• transformers
• sdpa
• softmax
• foundations

Sep 10, 2026

• attention
• multi-head-attention
• transformer-block
• pre-ln
• post-ln
• layernorm
• ffn
• gelu
• flops
• scaling-laws

Sep 10, 2026

• attention
• positional-encoding
• sinusoidal
• rope
• alibi
• relative-position
• long-context
• transformers

Sep 10, 2026

• attention
• transformers
• flashattention
• online-softmax
• io-aware
• memory-bound
• long-context
• foundations

Sep 10, 2026

• attention
• kv-cache
• mqa
• gqa
• mla
• deepseek
• inference
• long-context
• transformers

Sep 10, 2026

• attention
• transformers
• sparse-attention
• sliding-window
• longformer
• bigbird
• attention-sinks
• streaming
• long-context
• flops

Sep 10, 2026

• attention
• linear-attention
• kernel-trick
• performers
• linformer
• state-space-models
• s4
• mamba
• ssm
• subquadratic
• long-context
• hybrids
• transformers

Sep 10, 2026

• attention
• vision-transformer
• vlm
• multimodal
• cross-attention
• flamingo
• llava
• q-former

Sep 10, 2026

• attention
• long-context
• rope
• position-interpolation
• yarn
• ntk-aware
• ring-attention
• kv-cache
• evaluation
• ruler
• transformers