MosaicBERT Collection A collection of BERT-based models of different sequence lengths trained on the C4 dataset. Details: https://mosaicbert.github.io/ • 5 items • Updated Dec 27, 2023 • 5
MPT Collection The MPT collections is a series of decoder-style transformer models trained from scratch by MosaicML. Details: https://www.mosaicml.com/mpt • 9 items • Updated Nov 27, 2023 • 7