sparse attention

Subquadratic Emerges with Promising Sparse Attention LLM, Challenging AI Norms

Miami-based AI startup Subquadratic has recently emerged from stealth mode, claiming to have resolved a significant mathematical bottleneck that has hindered large language models (LLMs) for nearly a decade. The company introduced its new m...