[STREAMING_TABLE_OPERATION_NOT_ALLOWED.REQUIRES_SHARED_COMPUTE]

[Chris_sh]

Currently trying to refresh a Delta Live Table using a Full Refresh but an error keeps coming up saying that we have to use a shared cluster or a SQL warehouse. I've tried both a shared cluster and a SQL warehouse and the same error keeps coming up. Anyone run into this?

SQL Error [500051] [42601]: [Databricks][DatabricksJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: org.apache.hive.service.cli.HiveSQLException: Error running query: [STREAMING_TABLE_OPERATION_NOT_ALLOWED.REQUIRES_SHARED_COMPUTE] org.apache.spark.sql.AnalysisException: [STREAMING_TABLE_OPERATION_NOT_ALLOWED.REQUIRES_SHARED_COMPUTE] The operation REFRESH is not allowed: Cannot REFRESH a Streaming Table `dw_bronze`.`dlt`.`[Redacted]` from an Assigned or No isolation shared cluster, please use a SHARED cluster or a Databricks SQL warehouse instead.

[Kaniz · Accepted solution]

Hi @Chris_sh, When you're trying to do a "Full Refresh" on a Delta Live table using an "Assigned" cluster, which is not allowed. In a shared cluster, the Spark driver runs on the same node as the executor, enabling it to access the Delta cache.