My cluster can't access any tables in data catalogs
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-16-2023 06:52 PM
My goal is to have table access control in the data science and engineering workspace. So I enabled access control to my cluster using this config "spark.databricks.acl.dfAclsEnabled": "true" and my cluster is shown as Table ACLs enabled now (shield logo).
But when I tried to see my tables in the data section, it shows an error in the picture below.
Any suggestions for my problem?
- Labels:
-
Access
-
Cluster
-
DataCatalog
-
Table access control
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-17-2023 01:12 AM
It depends also on the type of the cluster https://docs.databricks.com/clusters/create-cluster.html#access-mode
You also need to enable it for workspace https://docs.databricks.com/administration-guide/access-control/table-acl.html#enable-table-acl
and your subscription needs to be premium.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-04-2023 07:36 AM
Can I ask you a question, where you can get the "spark.databricks.acl.dfAclsEnabled": "true" config spark value. I also try a lot of times to enable ACLs in the cluster in the data science and engineering workspace like you. But I just only see SQL only like official document: Enable Hive metastore table access control on a cluster (legacy) | Databricks on AWS.
Thanks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-01-2024 01:11 PM
Here is my use case:
And I get this error: "py4j.security.Py4JSecurityException: Method public org.apache.spark.sql.Dataset org.apache.spark.sql.streaming.DataStreamReader.table(java.lang.String) is not whitelisted on class class org.apache.spark.sql.streaming.DataStreamReader "
How do we disable table access control for a cluster when the underlying streaming source and sink tables are under unity catalog?
Thanks

