cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Cannot CREATE TABLE with 'No Isolation Shared' cluster

lawrence009
Contributor

Recently I ran into a number issues running with our notebooks in Interactive Mode. For example, we can't create (delta) table. The command would run and then idle for no apparent exception. The path is created on AWS S3 but delta log is never created. The cell running the command simply idles.

After much trial and error, it turns out 'No Isolate Shared' was the issue. It seems to make sense in retrospect this would be the issue. Has anyone else run into this problem?

4 REPLIES 4

Harun
Honored Contributor

Hi @Lawrence Chen​ if you are an account admin and if you enabled the "Admin Protection" feature means you will have this limitation. To overcome this you can create a non-admin user with "no isolation shared cluster" or you can create other cluster mode with admin access.

Take a look at this document to know more about the "Admin Protection" feature and its benefits and Limitations

https://docs.databricks.com/administration-guide/account-settings/no-isolation-shared.html

Thx @Harun Raseed Basheer​ . Please also see my reply to @Youssef Mrini​ 

youssefmrini
Honored Contributor III
Honored Contributor III

The Admin can disable the possibility to use the no Isolate Shared cluster. I recommend you to switch to Single user where UC is activated. Don't worry you won't need to change your code. If you encounter this kind of issues, make sure to open a ticket

I have confirmed my issue is indeed caused by having 'Admin Protection' enabled. However, I haven't enabled UC in my workspace.

It makes sense, however, to avoid No Isolation Shared and Switched to Single User mode.

Related issue, however, is that under 'Shared Access' mode cluster with Instance Profile attached, I am getting the following error

java.util.concurrent.ExecutionException: shaded.databricks.org.apache.hadoop.fs.s3a.AWSClientIOException: getFileStatus on s3a://.../_delta_log:

com.amazonaws.AmazonClientException: No AWS Credentials provided by AwsCredentialContextTokenProvider : com.amazonaws.SdkClientException: Unable to load AWS credentials from any provider in the chain: [com.databricks.backend.daemon.driver.aws.AwsLocalCredentialContextTokenProvider@124d1895: No role specified and no roles available., com.databricks.backend.daemon.driver.aws.ProxiedIAMCredentialProvider@35e6f19a: User does not have any IAM roles]: No AWS Credentials provided by AwsCredentialContextTokenProvider : com.amazonaws.SdkClientException: Unable to load AWS credentials from any provider in the chain: [com.databricks.backend.daemon.driver.aws.AwsLocalCredentialContextTokenProvider@124d1895: No role specified and no roles available., com.databricks.backend.daemon.driver.aws.ProxiedIAMCredentialProvider@35e6f19a: User does not have any IAM roles]

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!