cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

My cluster can't access any tables in data catalogs

bamhn
New Contributor II

My goal is to have table access control in the data science and engineering workspace. So I enabled access control to my cluster using this config "spark.databricks.acl.dfAclsEnabled": "true" and my cluster is shown as Table ACLs enabled now (shield logo).

image.pngBut when I tried to see my tables in the data section, it shows an error in the picture below.

image 

Any suggestions for my problem?

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

It depends also on the type of the cluster https://docs.databricks.com/clusters/create-cluster.html#access-mode

You also need to enable it for workspace https://docs.databricks.com/administration-guide/access-control/table-acl.html#enable-table-acl

and your subscription needs to be premium.

LoiLN
New Contributor III

Can I ask you a question, where you can get the "spark.databricks.acl.dfAclsEnabled": "true" config spark value. I also try a lot of times to enable ACLs in the cluster in the data science and engineering workspace like you. But I just only see SQL only like official document: Enable Hive metastore table access control on a cluster (legacy) | Databricks on AWS.
Thanks.

LoiLN_0-1691159752815.png

 

 

Karthik_Venu
New Contributor II

Here is my use case: 

https://community.databricks.com/t5/data-engineering/structured-streaming-using-delta-as-source-and-...

And I get this error: "py4j.security.Py4JSecurityException: Method public org.apache.spark.sql.Dataset org.apache.spark.sql.streaming.DataStreamReader.table(java.lang.String) is not whitelisted on class class org.apache.spark.sql.streaming.DataStreamReader "

 

How do we disable table access control for a cluster when the underlying streaming source and sink tables are under unity catalog?

 

Thanks

 

 

 

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group