Terraform Error: Cannot create sql table context deadline
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-16-2024 06:40 AM - edited 05-16-2024 07:43 AM
I am currently trying to deploy external parquet tables to the Databricks UC using terraform. However, for some tables I get the following error:
Error: cannot create sql table: Post "https://[MASKED]/api/2.0/sql/statements/": context deadline exceeded
This is probably due to a high degree of partitioning of the underlying parquet tables. The terraform databricks provider sets the timeoutto max 50s (https://github.com/databricks/terraform-provider-databricks/blob/main/catalog/resource_sql_table.go#...) and this can also not be changed as far as I have seen.
Did anybody else experience this error and knows a way to circumvent this?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-17-2024 08:44 AM
Hey @Retired_mod,
thanks for your reply and sorry for the late reply from my side. I couldn't fix the problem with the databricks terraform provider unfortunately. I now switched to using liquibase to deploy tables to databricks.

