An English and Chinese 8B model with sparse attention, supporting a 1M context window.
Specs
Params9B
LicenseApache-2.0
Tags
modelsmodels/llmsmultilingualartifacts/19
Related Models
An English and Chinese 8B model with sparse attention, supporting a 1M context window.