Gunjan Dhanuka — Learning Notes

subquadratic

6 items with this tag.

  • Sep 12, 2026

    Delta Rule (DeltaNet)

    • attention
    • linear-attention
    • delta-rule
    • deltanet
    • fast-weights
    • associative-memory
    • error-correction
    • subquadratic
    • chunkwise
  • Sep 12, 2026

    Gated DeltaNet (GDN)

    • attention
    • linear-attention
    • delta-rule
    • gated-deltanet
    • gdn
    • mamba2
    • data-dependent-decay
    • subquadratic
    • qwen
    • hybrid
  • Sep 10, 2026

    Linear Attention

    • attention
    • linear-attention
    • kernel-trick
    • performers
    • linformer
    • recurrent
    • subquadratic
    • long-context
    • recall-gap
  • Sep 10, 2026

    Mamba (Selective State-Space Model)

    • mamba
    • ssm
    • selective-ssm
    • s6
    • state-space-models
    • parallel-scan
    • subquadratic
    • long-context
    • attention-alternative
  • Sep 10, 2026

    State-Space Models (SSMs)

    • ssm
    • state-space-models
    • s4
    • hippo
    • recurrence
    • convolution
    • subquadratic
    • long-context
    • attention-alternative
  • Sep 10, 2026

    Learn: Linear & Sub-Quadratic Attention (& the SSM Turn)

    • attention
    • linear-attention
    • kernel-trick
    • performers
    • linformer
    • state-space-models
    • s4
    • mamba
    • ssm
    • subquadratic
    • long-context
    • hybrids
    • transformers

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source