Nanbeige

A looped transformer that rivals much larger models. However, due to the looping, it is rather slow, which calls into question its utility compared with a larger model.

A small yet very capable 3B model. It punches way above its weight while still being resilient enough to perform well in unseen benchmarks (often rare for new open model entries!).