MosaicML

MoscaicML was a startup acquired by Databricks in July 6, 2023 for $1.3B. In March 2024, they were behind the announcement of Databricks’s new Foundation Model - DBRX

Some libraries by MosaicML are:

• LLM Foundary  code for training, finetuning, evaluating, and deploying LLMs for inference with Composerand the MosaicML platform.

• Composer is an  open-source deep learning training library. Built on top of pytorch, this library makes it easier to implement distributed training workflows on large-scale clusters.  Use Composer to speedup experimentation workflow if training neural networks of any size, including:

  • Large Language Models (llms)
  • Diffusion models
  • Embedding models (e.g. BERT)
  • Transformer-based models
  • Convolutional Neural Networks (CNNs)

• Streaming

• and more

huggingface – mosaicml (Mosaic ML, Inc.)