Databricks

rudyevers · 12-08-2023

I try to get my head around the quality monitoring functionality in Unity Catalog. I configured one of the tables in our unity catalog. My assumption is that the profile and drift metrics tables are automatically created. But when I get an internal e...

rudyevers · 11-27-2023

We are currently upgrading our Lakehouse to use the Unity Catalog benefits. We will mostly use external tables because alle our DETLA tables are already stored in Azure Storage. I try to figure out how to update the table property "delta.lastUpdateve...

rudyevers · 11-28-2023

Hi @Kaniz,OK! My assumption was right. So that is what we have to live with for now. But a sort of refresh table function would be nice for external DELTA tables The project team was quite early with adopting DELTA as storage format but is willing t...

rudyevers · 11-28-2023

Hi @Kaniz Thank you for your reponse. I am aware that you can change your DELTA with de DDL statements, but in our case we write directly to storage and not to the unity catalog. So when a external table is created referring to a external location it...

rudyevers · 11-27-2023

No this is not possible because the workspace is not part of the virtual network and since than can not access the storage over it's private endpoint. It is all mentioned in de documentation:https://www.databricks.com/blog/2020/02/28/securely-access...

Databricks

User Stats

User Activity

Unity catalog internal error - quality monitoring

Unity catalog - external table lastUpdateversion

Re: Unity catalog - external table lastUpdateversion

Re: Unity catalog - external table lastUpdateversion

Re: Access storage account with private endpoint