cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

My cluster can't access any tables in data catalogs

bamhn
New Contributor II

My goal is to have table access control in the data science and engineering workspace. So I enabled access control to my cluster using this config "spark.databricks.acl.dfAclsEnabled": "true" and my cluster is shown as Table ACLs enabled now (shield logo).

image.pngBut when I tried to see my tables in the data section, it shows an error in the picture below.

image 

Any suggestions for my problem?

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

It depends also on the type of the cluster https://docs.databricks.com/clusters/create-cluster.html#access-mode

You also need to enable it for workspace https://docs.databricks.com/administration-guide/access-control/table-acl.html#enable-table-acl

and your subscription needs to be premium.

LoiLN
New Contributor III

Can I ask you a question, where you can get the "spark.databricks.acl.dfAclsEnabled": "true" config spark value. I also try a lot of times to enable ACLs in the cluster in the data science and engineering workspace like you. But I just only see SQL only like official document: Enable Hive metastore table access control on a cluster (legacy) | Databricks on AWS.
Thanks.

LoiLN_0-1691159752815.png

 

 

Karthik_Venu
New Contributor II

Here is my use case: 

https://community.databricks.com/t5/data-engineering/structured-streaming-using-delta-as-source-and-...

And I get this error: "py4j.security.Py4JSecurityException: Method public org.apache.spark.sql.Dataset org.apache.spark.sql.streaming.DataStreamReader.table(java.lang.String) is not whitelisted on class class org.apache.spark.sql.streaming.DataStreamReader "

 

How do we disable table access control for a cluster when the underlying streaming source and sink tables are under unity catalog?

 

Thanks

 

 

 

 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.