Alternatives to RoPE
Options that appear in the same research papers as RoPE, by co-occurrence.
| Alternative | Papers (with RoPE) | Avg viability |
|---|---|---|
| LLM | 1 | — |
| KV Cache | 1 | — |
| Fine-Tuning | 1 | — |
| autoregressive models | 1 | — |
| multi-head attention | 1 | — |
| attention sink frames | 1 | — |
| multi-head RoPE jitter | 1 | — |
| MHA2MLA-VLM | 1 | — |
| Key-Value (KV) cache | 1 | — |
| Multi-Head Latent Attention (MLA) | 1 | — |
| modality-adaptive partial-RoPE | 1 | — |
| modality-decoupled low-rank approximation | 1 | — |