BAGEL-7B-MoT

A multimodal model using the Mixture-of-Transformer-Experts (MoT) architecture, which uses two encoders (one for pixels, one for semantic features of images). It can also generate and edit images. Truly multimodal models are picking up steam in the open-source world!