cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Limitations for Unity Catalog on single user access mode clusters

Nes_Hdr
New Contributor II

Hello! 

According to Databricks documentation on azure :

"On Databricks Runtime 15.3 and below, fine-grained access control on single user compute is not supported. Specifically:

  • You cannot access a table that has a row filter or column mask.
  • You cannot access dynamic views.
  • To read from any view, you must have SELECT on all tables and views that are referenced by the view."

Well, I am using DBR 15.4 LTS and getting the following error message when running an optimize job (OPTIMIZE table name) on some tables that have a row filter:

Py4JJavaError: An error occurred while calling o388.sql. : java.util.concurrent.ExecutionException: com.databricks.sql.managedcatalog.UnityCatalogServiceException: [RequestId=d5be0519-**** ErrorClass=INVALID_PARAMETER_VALUE.ROW_COLUMN_ACCESS_POLICIES_NOT_SUPPORTED_ON_ASSIGNED_CLUSTERS] Query on table **** with row filter or column mask not supported on assigned clusters.

This is my job cluster configuration: 

Nes_Hdr_0-1732872787713.png

Can you please help me figure out when could possible cause such an error ? 

Thanks a lot! 

 

 

 

2 REPLIES 2

MuthuLakshmi
Databricks Employee
Databricks Employee

@Nes_Hdr Do you have Serverless enabled for your workspace?

  1. Fine-grained access control on single user compute: Databricks Runtime 15.4 LTS does support fine-grained access control on single user compute, but it relies on serverless compute to run data filtering. This means that when a query accesses objects like tables with row filters or column masks, the single user compute resource passes the query to the serverless compute to execute the data filtering.
  2. Error Message: The error message you are encountering, ROW_COLUMN_ACCESS_POLICIES_NOT_SUPPORTED_ON_ASSIGNED_CLUSTERS, indicates that the query on the table with row filters or column masks is not supported on assigned clusters. This suggests that the single user cluster you are using might not be configured to leverage serverless compute for these operations.

    In the documentation it was mentioned that Serverless needs to be enabled in that workspace. 
    https://learn.microsoft.com/en-us/azure/databricks/compute/access-mode-limitations#assigned-limitati...

    Hope this helps! 


Nes_Hdr
New Contributor II

@MuthuLakshmi Thank you very much for the reply! 

Yes, I have serverless compute enabled on the workspace, but the cluster I am using is not serverless. 
The error happens whenever access mode is "Single user" (see pictures below). It also happens when using DBR 16.

Nes_Hdr_0-1733132175192.png 

Nes_Hdr_1-1733132228955.png

 

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group