Cannot CREATE TABLE with 'No Isolation Shared' cluster
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-08-2022 08:39 PM
Recently I ran into a number issues running with our notebooks in Interactive Mode. For example, we can't create (delta) table. The command would run and then idle for no apparent exception. The path is created on AWS S3 but delta log is never created. The cell running the command simply idles.
After much trial and error, it turns out 'No Isolate Shared' was the issue. It seems to make sense in retrospect this would be the issue. Has anyone else run into this problem?
- Labels:
-
Cluster policy
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2022 01:21 AM
Hi @Lawrence Chen if you are an account admin and if you enabled the "Admin Protection" feature means you will have this limitation. To overcome this you can create a non-admin user with "no isolation shared cluster" or you can create other cluster mode with admin access.
Take a look at this document to know more about the "Admin Protection" feature and its benefits and Limitations
https://docs.databricks.com/administration-guide/account-settings/no-isolation-shared.html
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-12-2022 03:02 PM
Thx @Harun Raseed Basheer . Please also see my reply to @Youssef Mrini
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2022 07:54 AM
The Admin can disable the possibility to use the no Isolate Shared cluster. I recommend you to switch to Single user where UC is activated. Don't worry you won't need to change your code. If you encounter this kind of issues, make sure to open a ticket
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-12-2022 03:02 PM
I have confirmed my issue is indeed caused by having 'Admin Protection' enabled. However, I haven't enabled UC in my workspace.
It makes sense, however, to avoid No Isolation Shared and Switched to Single User mode.
Related issue, however, is that under 'Shared Access' mode cluster with Instance Profile attached, I am getting the following error
java.util.concurrent.ExecutionException: shaded.databricks.org.apache.hadoop.fs.s3a.AWSClientIOException: getFileStatus on s3a://.../_delta_log:
com.amazonaws.AmazonClientException: No AWS Credentials provided by AwsCredentialContextTokenProvider : com.amazonaws.SdkClientException: Unable to load AWS credentials from any provider in the chain: [com.databricks.backend.daemon.driver.aws.AwsLocalCredentialContextTokenProvider@124d1895: No role specified and no roles available., com.databricks.backend.daemon.driver.aws.ProxiedIAMCredentialProvider@35e6f19a: User does not have any IAM roles]: No AWS Credentials provided by AwsCredentialContextTokenProvider : com.amazonaws.SdkClientException: Unable to load AWS credentials from any provider in the chain: [com.databricks.backend.daemon.driver.aws.AwsLocalCredentialContextTokenProvider@124d1895: No role specified and no roles available., com.databricks.backend.daemon.driver.aws.ProxiedIAMCredentialProvider@35e6f19a: User does not have any IAM roles]
