As a Big Data Engineer, I have had a great time exploring sessions and understanding how different companies have adopted Databricks and switched from legacy systems. Also, as an ML practitioner, I was interested in exploring new ML capabilities from...
I am here to learn more about Databricks products, offerings and updates. I've already gone to several breakout sessions such as how Effectiv uses lakehouse to organize their advertising initiatives and data pipelines, how unity catalog is used to or...
Attending the Data + AI Summit by Databricks 2023 for the first time and the experience has been great so far. Meeting so many great minds and getting to know about Databricks experiences. Attended an awesome Keynote this morning and learned about La...
Hey - I was really happy to learn that you can take the certs at the conference!!
Very exciting and looking forward to learn more about the platform
Learning more about the capabilities of unity catalog at the data and AI summit. I’m looking forward to implementing unity catalog in my current role. I’m hoping to better our documentation of the data lineage and improve data governance!
Just learned databricks warehouse as compared to snowflake. They actually have a very competitive product built in.will explore more.
We actually compared Snowflake and Databricks as part of a POC to determine what analytics architecture to deploy for the enterprise. Once Datsbricks released the SQL warehouse it was an obvious choice due to the open source framework and control ove...
So far I used only Hive, now I want to test Unity-CatalogI am following this guide:https://docs.databricks.com/data-governance/unity-catalog/get-started.htmlI see the table created under main catalog. Previsouly they were created under hive_metastore...
When data ai summit come to japan
or Europe, as it used to be
I am working on Generative AI, and would like to know more from databrick.
nice!what would you like to know from Databricks?
Even through we have option to use databricks cluster for SQL query , when we should use SQL warehouse ?
a sql warehouse can be used for interactive SQL querying.If you want to do batch processing using sql, a classic cluster is a better choice (because cheaper), but for interactive queries, performance is key. SQL warehouses are pretty fast and optimi...
What would be reason of teams choosing to have their data in #parquet instead of #delta.
no need for a log, always a full overwrite f.e.
Hello,What is the correct way to install packages from requierements.txt within databricks repo. Do I need to add some utils notebooks with additional scripts to my repo and run them before any of the script from the file? I suppose adding pip instal...
The .py files are very handy if you create classes etc. They contain modules which you can import into a notebook with the import statement. They are not meant to be run.
The summit is a great place to meet fellow data practitioners and learn more about how other companies are using Databricks so we can best leverage the full power of the tool. I am specially interested into hearing tips about better cost management t...
There was a session on migration to unity catalog today. Maybe you can check the videos. 
Hello everyone! My name is Rio Jia, currently pursuing my master's in data science at Vanderbilt University, and also have the privilege of interning in data science at Dell Technologies this summer. I learned a lot from the various sessions and expo...
