We are very excited about trying out the new capabilities announced this morning as well as unity catalog. Excited to see how Databricks and Mosaic ML build their relationship and integrate in the future!
Great Keynote this morning… promising future plans especially with Unity catalog..
Hi, there, Any recommendations to enable multiple table consistency cross delta tables?
To my knowledge, Delta Lake tables should be consistent and support ACID transactions. In summary, each transaction is processed serially and each cluster will contain a snapshot of the Delta Lake table(s).See more info here: https://docs.databricks....
I would like to know about best practices when finetuning a transformer model and most common problems during the process
Good time and good information.
Really excited that Data bricks is championing the cause of unifying the whole data analytics value chain. it’s a great service to the data community.
Happy to see that Databricks makes their Data Clean Room slowly publicly available. Looking forward to more updates.
Currently the limit is 150 (theoretical) on a cluster but realistically it seems to be slightly lower. Can this number be increased to say 300?
For Azure Databricks, having the high concurrency cluster selected might help your use case.More info: https://learn.microsoft.com/en-us/azure/databricks/archive/compute/configure
So many announcement today:LakehouseIQLakehouse FederationDelta Lake 3.0 - Unify in top of Iceberg, Huidi & DeltaVector SearchUnity Catalog for AILakehouse Monitoring & ObservabilityLakehouse AppDatabricks Marketplace GAwhich one are u the most exist...
Very excited about Lakehouse Monitoring, it’s exactly what we need for data quality.
Lakehouse AI is a game changer. Looking forward to build LLM on it.
Want to see what’s the main reason to migrate? #summit23
From what I've seen, Databricks is rapidly growning and working with other open-source technologies to build an all-encompasing data solution. Snowflake was a great pioneer into separating the storage from compute costs of a traditional database, but...
I've loved learning about the different databricks offerings from the inbound pipeline with delta-live tables, the modeling capabilities in the Lakehouse, and the governance in Unity Catalog. If I also want to get started using third party alternativ...
Looking forward
Great Conference, it was cool learning about creating my own LLM, and the risks associated with LLM.sMy favorite activity was the Spin at Dark on Tuesday night!
