Databricks has just launched a new LLM designed to allow users to build and fine-tune their own custom LLMs.
The company hopes that by releasing this model, it will further democratize access to artificial intelligence and allow its users to build their own models based on their own data.
According to Databricks, the new model, DBX, outperforms current open source LLMs using standard benchmarks. It also beats GPT 3.5 on several benchmarks.
It was created by Mosaic AI, trained on NVIDIA DGX Cloud and built on the MegaBlocks open source project.
“At Databricks, our vision has always been to democratize data and artificial intelligence. We do this by providing data intelligence to every enterprise — helping them understand and use their private data to build their own AI systems. DBRX is the result of that goal,” said Ali Ghodsi, co-founder and CEO of Databricks.
Dirk Groeneveld, chief software engineer at the Allen Institute for Artificial Intelligence (AI2), added: “We are at an important turning point for AI that requires a community of researchers, engineers and technologists to better understand it and drive significant innovation. That’s why our team at AI2 is deeply committed to advancing the science of Generative AI through open model development, and we’re excited to see new models like DBRX bring greater transparency, accessibility and collaboration to the industry.”