Databricks Community

AP · 08-01-2022

Hi, I am trying to take advantage of the treasure trove of the information that metastore contains and take some actions to improve performance. In my case, the metastore is managed by databricks, we don't use external metastore.How can I connect to ...

AP · 07-31-2022

So databricks gives us great toolkit in the form optimization and vacuum. But, in terms of operationaling them, I am really confused on the best practice.Should we enable "optimized writes" by setting the following at a workspace level?spark.conf.set...

AP · 08-03-2022

Hello Lindsay, Yes. @Werner Stinckens has done an excellent job of distilling a few things down for me. Thank you!

AP · 08-01-2022

Thanks Prabakar. I appreciate your response. However, I already have the details. Now, my question is what do I do with those details? I have the details in the following formatconfig=DbMetastoreConfig{host=somemetastoreprefix.mysql.database.azure.co...

AP · 08-01-2022

Thanks Werner for sharing the link. It helped a bit. But I am still not completely intuitive on what exactly happens when we configure auto optimize. Can you please tell me the workflow that happens when we enable auto-optimize. For ex: It says auto-...

Databricks Community

User Stats

User Activity

How can we connect to the databricks managed metastore

AutoOptimize, OPTIMIZE command and Vacuum command : Order, production implementation best practices

Re: AutoOptimize, OPTIMIZE command and Vacuum command : Order, production implementation best practices

Re: How can we connect to the databricks managed metastore

Re: AutoOptimize, OPTIMIZE command and Vacuum command : Order, production implementation best practices