Running sql command on Single User cluster vs Shared.

[udi_azulay]

Hi, 

when i am running the below simple code over my Unity Catalog on a Shared cluster, it works very well.

But on a Single User - i am getting : 

Failed to acquire a SAS token for list on /__unitystorage/schemas/1bb5b053-ac96-471b-8077-8288c56c8a20/tables/90a7830e-2d62-4b51-8e7b-64de6d367859/_delta_log due to java.util.concurrent.ExecutionException: org.apache.spark.sql.AnalysisException: 403: Your token is missing the required scopes for this endpoint.

Please advice!

%python

from pyspark.sql import SparkSession

sql_query = f"SELECT * from z_product_engineering_mpe_mit_trace.trace_api.lot_at_operation limit 2"

# Create a Spark session

spark = SparkSession.builder \

    .appName("Python Spark SQL") \

    .getOrCreate()

# Read data from Databricks table into a DataFrame

df = spark.sql(sql_query)

display(df)

[Debayan]

Hi, Could you please refer to the limitations here: https://docs.databricks.com/en/compute/access-mode-limitations.html . Please let us know if this helps. 

[Kaniz_Fatma]

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance!