Terraform Error: Cannot create sql table context deadline

Volker — Thu, 16 May 2024 14:43:51 GMT

I am currently trying to deploy external parquet tables to the Databricks UC using terraform. However, for some tables I get the following error:

Error: cannot create sql table: Post "https://[MASKED]/api/2.0/sql/statements/": context deadline exceeded

This is probably due to a high degree of partitioning of the underlying parquet tables. The terraform databricks provider sets the timeoutto max 50s (https://github.com/databricks/terraform-provider-databricks/blob/main/catalog/resource_sql_table.go#L21) and this can also not be changed as far as I have seen.

Did anybody else experience this error and knows a way to circumvent this?

Re: Terraform Error: Cannot create sql table context deadline

Volker — Mon, 17 Jun 2024 15:44:40 GMT

Hey @Retired_mod,

thanks for your reply and sorry for the late reply from my side. I couldn't fix the problem with the databricks terraform provider unfortunately. I now switched to using liquibase to deploy tables to databricks.

topic Terraform Error: Cannot create sql table context deadline in Data Engineering

Terraform Error: Cannot create sql table context deadline

Re: Terraform Error: Cannot create sql table context deadline