# MosaicML

- Page: https://shared.btbytes.com/p/mosaicml
- Date: 2024-03-28
- Tags: llm

[MoscaicML](https://www.databricks.com/research/mosaic) was a startup acquired by Databricks in [July 6, 2023](https://www.datanami.com/2023/07/06/what-is-mosaicml-and-why-is-databricks-buying-it-for-1-3b/) for $1.3B. In March 2024, they were behind the [announcement](https://www.databricks.com/blog/announcing-dbrx-new-standard-efficient-open-source-customizable-llms) of Databricks's new Foundation Model - DBRX

Some libraries by MosaicML are:

- [LLM Foundary](https://github.com/mosaicml/llm-foundry)  code for training, finetuning, evaluating, and deploying LLMs for inference with [Composer](https://github.com/mosaicml/composer)and the [MosaicML platform](https://forms.mosaicml.com/demo?utm_source=github.com&utm_medium=referral&utm_campaign=llm-foundry).
- [Composer](https://github.com/mosaicml/composer) is an  open-source deep learning training library. Built on top of pytorch, this library makes it easier to implement distributed *training workflows* on large-scale clusters.  Use Composer to speedup  experimentation workflow if training neural networks of any size, including:

	- Large Language Models ([llm](https://shared.btbytes.com/p/llm)s)
	- Diffusion models
	- Embedding models (e.g. BERT)
	- Transformer-based models
	- Convolutional Neural Networks (CNNs)
- [Streaming](https://github.com/mosaicml/streaming)
- [and more](https://www.databricks.com/research/mosaic)

[huggingface](https://shared.btbytes.com/p/huggingface) -- [mosaicml (Mosaic ML, Inc.)](https://huggingface.co/mosaicml)