Gunjan Dhanuka — Learning Notes

qsa

2 items with this tag.

  • Sep 12, 2026

    QSA (Qwen Sparse Attention)

    • attention
    • sparse-attention
    • qsa
    • qwen
    • trainable-sparse
    • block-selection
    • indexer
    • compression
    • long-context
    • deepseek
  • Sep 12, 2026

    On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability

    • qwen
    • alibaba
    • qsa
    • gated-deltanet
    • sparse-attention
    • hybrid
    • moe
    • muon
    • long-context
    • deepseek
    • n-gram

Created with Quartz v5.0.0 © 2026

  • Personal site
  • Research
  • Field notes
  • Source