Gunjan Dhanuka — Learning Notes
Search
Search
Dark mode
Light mode
Reader mode
Explorer
subquadratic
6 items with this tag.
Sep 12, 2026
Delta Rule (DeltaNet)
attention
linear-attention
delta-rule
deltanet
fast-weights
associative-memory
error-correction
subquadratic
chunkwise
Sep 12, 2026
Gated DeltaNet (GDN)
attention
linear-attention
delta-rule
gated-deltanet
gdn
mamba2
data-dependent-decay
subquadratic
qwen
hybrid
Sep 10, 2026
Linear Attention
attention
linear-attention
kernel-trick
performers
linformer
recurrent
subquadratic
long-context
recall-gap
Sep 10, 2026
Mamba (Selective State-Space Model)
mamba
ssm
selective-ssm
s6
state-space-models
parallel-scan
subquadratic
long-context
attention-alternative
Sep 10, 2026
State-Space Models (SSMs)
ssm
state-space-models
s4
hippo
recurrence
convolution
subquadratic
long-context
attention-alternative
Sep 10, 2026
Learn: Linear & Sub-Quadratic Attention (& the SSM Turn)
attention
linear-attention
kernel-trick
performers
linformer
state-space-models
s4
mamba
ssm
subquadratic
long-context
hybrids
transformers