Databricks Community

eimis_pacheco

Hi Everyone,Hope everything is well.My name is Eimis Pacheco, and I am going to the Databricks Data + AI summit of this year in San Francisco. I wanted to ask who from Austin will go to the event too, in case you guys would like to hang out. This is ...

eimis_pacheco

Hi Community,I hope you're doing well.I wanted to ask you the following: I want to go to Databricks AI + Data Summit this year, but it's super expensive for me. And hotels in San Francisco, as you know, are super expensive.So, I wanted to know how I ...

eimis_pacheco · 09-29-2023

Hello Community,Today I was in Tips and Tricks - Optimizations webinar and I started being confused, they said:"Don't partition tables <1TB in size and plan carefully when partitioning• Partitions should be >=1GB" Now my confusion is if this recommen...

eimis_pacheco · 09-28-2023

Hi community!I was in a Databricks webinar and one of the participants said "Delta Live Tables seems to have some limitations when using with Unity Catalog. Is the idea to get parity with Hive?" and someone answered "DLT + Unity Catalog combination h...

eimis_pacheco · 09-19-2023

Hi Community I have a doubt. The bronze layer always causes confusion for me. Someone mentioned, "File Format: Store data in Delta Lake format to leverage its performance, ACID transactions, and schema evolution capabilities" for bronze layers.Then, ...

eimis_pacheco

Thank you for your answer. Thanks

eimis_pacheco · 10-17-2023

Hi @Retired_mod ,Sorry for asking again but this recommendation of "don't partition tables <1TB" but this recommendation applies when this is written on disk or when the job is actually running in memory too? (sorry if the answer is obvious)Because i...

eimis_pacheco · 10-17-2023

Hi @Retired_mod ,Thank you for your answer. Wondering then why Databricks recommends the usage of both solutions (DLT and Unity Catalog) even with the existence of this imcompatibilities?Best Regards

eimis_pacheco · 09-22-2023

Thank you very much for your answers and insights @Retired_modRegards!

eimis_pacheco · 09-22-2023

Thank you very much for your answer @swethaNandan.Regards!

Databricks Community

User Stats

User Activity

Who from Austin will be attending the Databricks Data + AI summit 2025?

Databricks AI + Data Summit discount coupon

Confused with databricks Tips and Tricks - Optimizations regarding partitining

What are the Delta Live Tables limitations with relation to Unity Catalog?

Is it not needed to preserve the data in its original format anymore with the usage of medallion?

Re: Databricks AI + Data Summit discount coupon

Re: Confused with databricks Tips and Tricks - Optimizations regarding partitining

Re: What are the Delta Live Tables limitations with relation to Unity Catalog?

Re: Is it not needed to preserve the data in its original format anymore with the usage of medallion

Re: What are the best practices in bronze layer regarding the column data types?