Databricks Community

Nik_Vanderhoof

Hello,I recently learned about the DatabricksWorkflowTaskGroup operator for Airflow that allows one to run multiple Notebook tasks on a shared job compute cluster from Airflow.Is a similar feature possible to run multiple non-Notebook tasks from Airf...

Nik_Vanderhoof

Can you share the commands you have tried, the errors they produced, and which Databricks Runtime versions you used? Those will help to debug.

Nik_Vanderhoof

Hi,Yes, Databricks does support creating external tables whose storage is not managed by Unity Catalog. Have you seen the following page of documentation: https://docs.databricks.com/aws/en/tables/external? It describes how to create external tables,...

Nik_Vanderhoof

Hi! Have you seen this article from Databricks? https://docs.databricks.com/aws/en/dlt/unity-catalogIt mentions that the ability for Delta Live Tables to register streaming tables and views in unity catalog is now in public preview, but that pipeline...

Nik_Vanderhoof

Hi! It depends on whether you're using Scala or Python.If you're using Scala, you should be able to import `io.delta.exceptions.MetadataChangedException`, which you can see defined here: https://github.com/delta-io/delta/blob/master/spark/src/main/sc...

Nik_Vanderhoof

In several ways, liquid clustering is more flexible than either hive-style partitioning or z-ordering.Liquid clustering allows us to change clustering keys without re-writing the entire table. Since stakeholders often query only more recent data, thi...

Databricks Community

User Stats

User Activity

DatabricksWorkflowTaskGroup

Re: Can external tables be created backed by current cloud files without ingesting files in Databric

Re: Can external tables be created backed by current cloud files without ingesting files in Databric

Re: Lineage not visible for table created in DLT

Re: How can we import the exception "MetadataChangedException"?

Re: Fatctors deciding to choose between zorder, partitioning and liquid clustering