topic Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to a in Data Engineering

Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to another?

Anonymous — Wed, 23 Jun 2021 22:32:05 GMT

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to another?

aladda — Wed, 23 Jun 2021 23:09:04 GMT

Not currently as the queries, dashboards etc are likely tied to the underlying tables/dataset so the migration probably extends beyond just those artifacts. Would be helpful to understand your use case

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to another?

sajith_appukutt — Thu, 24 Jun 2021 02:20:34 GMT

Queries and Dashboards API provides the functionality to list existing queries / dashboards . Perhaps use this functionality to automate migration of queries.

If you want to migrate table definitions from the metastore as well - check out https://github.com/databrickslabs/migrate

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to another?

valiro21 — Mon, 08 Aug 2022 14:13:03 GMT

We are currently trying to do the same thing, meaning to deploy from Dev to Qa/Prod the queries and dashboards.

For queries it is possible, We tested this in a python script and the queries were successfully recreated in the new environment . I am not sure how to fix the links to the data sources yet.

For the dashboards, it does not work as the widgets are ignored/not parsed when I tried to call the API to create a dashboard. Just an empty dashboard is created. I even tried a simple dashboards with a single text widget and it still didn't work. Maybe it will after this gets out of the preview.

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to a

PrateekGulati — Thu, 06 Jul 2023 05:37:27 GMT

Hi Valentin1,

We have similar use-case. We created a separate workspaces for Dev and QA, following this Databricks Blog Post. We are able to export and import queries from Dev to QA using the queries api, but this is not working for dashboards.

Can you tell me what approach you took finally to migrate the assets across workspace?

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to a

Anonymous — Wed, 12 Jul 2023 08:22:29 GMT

Hi @sajith_appukutt

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to a

joseheliomuller — Thu, 07 Sep 2023 06:03:08 GMT

The ability to easily migrate queries and dashboards across Databricks Workspace it extremely important.

In my company we have dev, stg and production workspaces, with same pipeline creating the data.

We create our dashboards in DEV and then we have to redo MANUALLY in staging and production workspace!

Now it has been released that Databricks will enforce to save the queries in the Shared folder and not in repos anymore.

Not been able to save the queries in a version control or able to migrate dashboards across environments is such a bad move of Databricks, it is basically forcing us to use another tool such as Tableau or Power BI.

Is there any place I can raise a ticket or a request to allow queries and dashboards to be in repos and ability to migrate them across different workspaces?

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to a

djhs — Tue, 14 Nov 2023 14:14:59 GMT

I'm currently also struggling with moving dashboards from our dev workspace to our prod workspace using the Databricks API in our CI/CD pipelines. Simply being able to create a dashboard with a json spec (exported through the Databricks API) would solve my issue and potentially from many others who responded to this issue.

Re: Can we migrate Databricks SQL components such as queries, dashboards etc from one workspace to a

djhs — Tue, 14 Nov 2023 16:18:10 GMT

I also tried to leverage this endpoint (inferred from devtools): https://<workspace_id>.cloud.databricks.com/sql/api/dashboards/import with the exported dashboard (the dbdash file) in the request payload. It returns a 200 but nothing happens. Maybe someone else knows how to hack around this.