ScienceToStartup
Dashboard
Research
Trends
Topics
Saved
Articles
Changelog
Careers
About
Enterprise
Resources
Home
Resources
State Reports
Efficient Transformers
State of Efficient Transformers
3 papers · avg viability 5.3
Download CSV
View topic page
Top papers
Retrieval-Aware Distillation for Transformer-SSM Hybrids
(6.0)
ZeroS: Zero-Sum Linear Attention for Efficient Transformers
(5.0)
Shiva-DiT: Residual-Based Differentiable Top-$k$ Selection for Efficient Diffusion Transformers
(5.0)