cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

My cluster can't access any tables in data catalogs

bamhn
New Contributor II

My goal is to have table access control in the data science and engineering workspace. So I enabled access control to my cluster using this config "spark.databricks.acl.dfAclsEnabled": "true" and my cluster is shown as Table ACLs enabled now (shield logo).

image.pngBut when I tried to see my tables in the data section, it shows an error in the picture below.

image 

Any suggestions for my problem?

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

It depends also on the type of the cluster https://docs.databricks.com/clusters/create-cluster.html#access-mode

You also need to enable it for workspace https://docs.databricks.com/administration-guide/access-control/table-acl.html#enable-table-acl

and your subscription needs to be premium.

LoiLN
New Contributor III

Can I ask you a question, where you can get the "spark.databricks.acl.dfAclsEnabled": "true" config spark value. I also try a lot of times to enable ACLs in the cluster in the data science and engineering workspace like you. But I just only see SQL only like official document: Enable Hive metastore table access control on a cluster (legacy) | Databricks on AWS.
Thanks.

LoiLN_0-1691159752815.png

 

 

Karthik_Venu
New Contributor II

Here is my use case: 

https://community.databricks.com/t5/data-engineering/structured-streaming-using-delta-as-source-and-...

And I get this error: "py4j.security.Py4JSecurityException: Method public org.apache.spark.sql.Dataset org.apache.spark.sql.streaming.DataStreamReader.table(java.lang.String) is not whitelisted on class class org.apache.spark.sql.streaming.DataStreamReader "

 

How do we disable table access control for a cluster when the underlying streaming source and sink tables are under unity catalog?

 

Thanks

 

 

 

 

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!