Databricks Community

MoJaMa · 03-11-2026

Databricks ABAC lets you apply a single schema-level policy across columns of any data type — no more managing one mask function per type. Here's how to use the VARIANT data type to make it work. If you've implemented column masking in Unity Catalog,...

MoJaMa · 06-28-2021

MoJaMa · 06-25-2021

MoJaMa · 06-25-2021

MoJaMa · 06-25-2021

MoJaMa

This may not be solvable here. Do you have Support via Databricks? You'll need to create a Support Ticket (direct if AWS else MSFT ticket if Azure). If not, ping your Account Team for help. Just saying cos it might require the type of debugging that'...

MoJaMa

What identity is the job running as? Do you have any settings on the all-purpose cluster that you are not setting on the job-cluster? Maybe you need to provide roles/bigquery.jobUser on project analytics to the job compute service account?

MoJaMa

@zenwanderer Have you looked into Query Watchdog? For Classic All-Purpose clusters this might be your best bet. https://docs.databricks.com/aws/en/compute/troubleshooting/query-watchdog

MoJaMa

I don't know if it's a copy paste error on your side but you reference an error: 'key not found: all_info_dlt_cx_utils_cod ' I notice it's missing an "e". Can you check the code-base for any typos? Maybe there's a typo in a dlt.read() or spark.table...

MoJaMa

That icon just means it's the default catalog for the workspace. See image1 that shows the tooltip when I mouse over it. Image2 shows where it's setup. Workspace Admin --> Advanced --> Other --> Default catalog for the workspace.

Databricks Community

User Stats

User Activity

One Policy to Mask Them All: ABAC + VARIANT in Unity Catalog

I'm a customer and enabled CMK for notebooks. How can I check that the encryption key is actually used?

Does Databricks support VPC migration for an E2 workspace for both Customer Managed VPC and Databricks Managed VPC?

Regarding DBFS encryption using CMK: Is there a way to patch existing workspaces so DBFS can be encrypted using a customer managed key? or is this only for new workspaces?

Does Databricks support instance pools of Azure reserved instances?

Re: Can't able to enable Saml SSO

Re: Job compute fails due to BQ permissions

Re: Kill/Cancel a Notebook Cell Running Too Long on an All-purpose Cluster

Re: DLT Pipeline Error -key not found: all_info_dlt_cx_utils_cod resulting in a NoSuchElementExcepti

Re: Databricks Default Catalog with House Icon