Gunjan Dhanuka — Learning Notes

sliding-window

3 items with this tag.

  • Sep 14, 2026

    Local/Global Interleaved Attention

    • attention
    • local-global
    • sliding-window
    • gemma
    • kv-cache
    • rope
    • long-context
    • soft-capping
    • gqa
  • Sep 10, 2026

    Sliding-Window Attention

    • attention
    • sparse-attention
    • sliding-window
    • local-attention
    • mistral
    • long-context
    • receptive-field
    • kv-cache
  • Sep 10, 2026

    Learn: Sparse & Sliding-Window Attention

    • attention
    • transformers
    • sparse-attention
    • sliding-window
    • longformer
    • bigbird
    • attention-sinks
    • streaming
    • long-context
    • flops

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source