We are proud to announce two new analyst reports recognizing Databricks in the data engineering and data streaming space: IDC MarketScape: Worldwide Analytic Stream Processing Software, 2024 (Leader)Forrester Wave™: Cloud Data Pipelines, Q4 2023 (Lea...
Databricks announced the public preview of Mosaic AI Agent Framework & Agent Evaluation alongside our Generative AI Cookbook at the Data + AI Summit 2024. These tools are designed to help developers build and deploy high-quality Agentic and Retriev...
Thank you again for attending Data + AI Summit 2024. There’s still time for you to revisit your favourite sessions and keynotes from the conference — available on demand. The full lineup of sessions will be hosted on the Databricks YouTube channel.
If you are shocked by this title, it is probably because our feelings on big data are based on two incorrect assumptions: Big data was a hype of the 2010s, everything was big data, but soon everyone realized that big is undefined, and the size of the...
The recent Data + AI Summit 2024 was our biggest ever. Over 16,000 of our top customers, prospects, and partners attended in person, and an additional 40,000+ tuned in virtually. It was a packed four days filled with crucial product announcements, tr...
We are enhancing the Community login process to provide a more secure and streamlined experience for all users. To avoid losing access to your Community account, please update your primary and secondary email addresses now (refer to “Action Required”...
Author: @youssefmrini Data & AI Summit 2024 is a wrap! With 16k attendees and 40k virtual, vibrant parties, it was the most exciting edition so far. Did you miss the keynotes & all the announcements? Don’t worry, we’re giving you a full recap. Here a...
Databricks Named a Leader Again Databricks has been named a Leader in the 2024 Gartner® Magic Quadrant™ for Data Science and Machine Learning Platforms. This new report includes generative AI — a key addition in our opinion since the last report was ...
Great news
Today, we are excited to announce Databricks LakeFlow, a new solution that contains everything you need to build and operate production data pipelines. It includes new native, highly scalable connectors for databases including MySQL, Postgres, SQL Se...
Can you say something more about the "Real Time Mode for Apache Spark"? I can not find anything about it anywhere.- Is it "just" spark continuous processing?- Will it be available with "normal" pyspark in databricks, or only through DLT?- Can it stre...
Over the last year, we have seen a surge of commercial and open-source foundation models showing strong reasoning abilities on general knowledge tasks. While general models are an important building block, production AI applications often employ Comp...
San Francisco / New York – June 12, 2024 – Databricks, the Data and AI company, and Shutterstock, Inc., a leading global creative platform, today announced Shutterstock ImageAI, Powered by Databricks, a text-to-image Generative AI model optimized for...
Today, we are excited to announce Databricks AI/BI, a new type of business intelligence product built from the ground up to deeply understand your data's semantics and enable anyone to analyze data for themselves. AI/BI is built on a compound AI syst...
At Databricks, our mission is to democratize data + AI. An open approach to sharing and collaboration is critical to maximize reach and impact. Within our data intelligence platform, the Delta Sharing open protocol helps our customers easily and secu...
We are excited to announce that we are open sourcing Unity Catalog, the industry’s first open source catalog for data and AI governance across clouds, data formats, and data platforms. Here are the most important pillars of the Unity Catalog vision: ...
This is awesome news.When we switched to Unity Catalog a while back, I couldn't help feeling a little uncomfortable putting all of our eggs into a closed catalog.Making Unity Catalog open source is a big relief!Awesome
We recently introduced DBRX: an open, state-of-the-art, general-purpose LLM. DBRX was trained, fine-tuned, and evaluated using Mosaic AI Training, scaling training to 3072 NVIDIA H100s and processing more than 12 trillion tokens in the process. Train...
exciting!
