INTELLECT-1-Instruct

A 10B model based on the Llama architecture. The model was trained and distributed on a global scale, spanning multiple countries and even continents. Distributed training could have substantial policy implications. For now, we know it works okay. Many policy changes could make international players invest way more in these techniques.
PrimeIntellect is smart about it - they train on smaller blocks of GPUs not reserved by customers. Might as well figure out how to put those extra GPUs to use?