DeepSeek added a new sparse attention variant to their arsenal, showing impressive long context efficiency. This method works on existing models, surpassing the long context scores compared to previous versions.
Specs
Params671B
LicenseMIT
Tags
modelsmodels/llmsmodels/llms/reasoningmultilingualartifacts/15
Related Models




