VZLA
Databricks Employee
Databricks Employee

Hi @kasiviss42, Thank you for sharing the error details!

To provide better guidance, could you clarify the following details about your environment and use case?

  1. Cluster Configuration:

    • Are you using a single-user cluster or a shared/multi-user cluster? If single-user, have you set spark.databricks.unityCatalog.singleUserAutoGlobalScope to true?
  2. Workload Details:

    • What type of operation or workload are you running when this error occurs (e.g., a Spark job, Delta Lake operation, or background process)?
    • Are you using thread pools, asynchronous tasks, or submitting jobs programmatically?
  3. Specific Context:

    • Does this issue occur consistently or intermittently?
    • Have you noticed if certain operations or configurations (e.g., checkpointing, writing to S3, or specific thread usage) trigger the error?
  4. Setup and Logs:

    • Are you running this on a free trial or a production workspace?
    • Can you share the specific stack trace or log details (excluding sensitive information) to help identify where the issue arises?