Databricks Community

Isi · 03-27-2025

Hi everyone,We’re facing a strange issue when trying to access a Databricks Volume from a job that is triggered via the Databricks REST API (not via Workflows). These jobs are executed using container services, which may be relevant, perhaps due to i...

Isi

Hey @drag7ter You’re absolutely right, currently, there is no official API field that explicitly returns the recipient activation status (I just have tested it), even though the Databricks API documentation references a field called activated boolea...

Isi

Hey @Nagarathna @Lucas_TBrabo I’d like to share my opinion and some tips that might help:1. You should try to avoud filtering by spark_partition_id because you can create skewed partitions, you should use with repartition() and spark can optimize t...

Isi

Hey @ep208 ,From the error message you’re seeing (LOCATION_OVERLAP), it seems that Unity Catalog is still tracking a table or volume that points to the same path you’re now trying to reuse:abfss://datalake@datalakename.dfs.core.windows.net/Delta/Proj...

Isi

Hey @chsoni12 ,Using UC:Databricks tracks metadata dependencies between the source and the clone. This means:VACUUM on the source table will not delete any data files if they are still referenced by the shallow clone.Even after the retention period, ...

Isi

Hey @leandro09 ,My opinion this kind of error is often related to Terraform state still tracking a resource that was created or managed by another user, and your current user doesn’t have permissions to update or read it.terraform state listThis will...

Databricks Community

User Stats

User Activity

Unable to access Databricks Volume from job triggered via API (Container Services)

Re: Delta sharing recipient auth status

Re: How to write trillions of rows to unity catalog table.

Re: How to resolve Location Overlap

Re: Impact of VACUUM Operations on Shallow Clones in Databricks

Re: Databricks Bundle Deployment Question