โ11-18-2024 04:24 AM
Hi Community,
I'm running into an issue, when executing Databricks CLI Bundle Deploy I dont get the Terraform State file (.tfstate). I know that I should get one but even when defining the state_apth on my YAML (.yml) DABS file I still do not get it.
Does anybody have a solution or suggestion?
Thanks in advanced.
Regards,
Fabian
โ11-18-2024 04:42 AM
Hi @FabianGutierrez ,
Could you remove tilde (~) from your state_path? In linux tilde is a shortcut for a user's home directory. Try to specify path starting from a root (/).
โ11-18-2024 05:59 AM
Hi @szymon_dybczak , For Developmen mode its mandatory and for Production mode I did removed/replaced it but still no file.
โ11-20-2024 04:57 AM
If any updates on this would be really helpful.
Thanks.
โ11-20-2024 05:28 AM
Hi @FabianGutierrez ,
Sorry, I didn't notice your reply. What version of cli you're using? Try to upgrade to newest version if possible
โ11-20-2024 05:54 AM
Hi @szymon_dybczak , we did that also from the very beginning when troubleshooting. We are using v0.233.0. Also Terraform compiler (binary) 1.9.8 Windows AMD64 and Databricks Terraform provider 1.54.0 Windows AMD64.
There error is still present eventhough latest version for Win compatible.
โ11-20-2024 07:18 AM
Ok, so for testing purposes remove state_path mapping from yaml path. The default path for state shoud be ${workspace.root}/state.
Also, you can run enable debug mode in databricks cli. Maybe we can find some useful information from execution:
Troubleshoot the Databricks CLI | Databricks on AWS
โ11-20-2024 08:28 AM
We tried it as well and we got the following insides with --debug and now with log file, thanks for the link.
We can not seem to find the "local Terraform state" but also the .tfstate does not get placed (uploaded) in the ${workspace.root}/state location.
Any thoughts?
โ11-20-2024 08:31 AM
By the way, we are not using User workspace as the default to deploy our DAB, we are using /Shared/release/<bundle_name>/
โ11-20-2024 09:18 AM - edited โ11-20-2024 09:20 AM
Forgot to also share this print screen of the last section in the logs. Somehow the State file keeps getting ignored (not found) so how can the deployment still take place I wonder.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group