08-02-2024 07:33 AM
I'm getting the following error when trying to install UCX on a specific workspace.
I have already installed ucx from my machine on other workspace and works, now on this workspace i'm getting this error
ERROR [d.l.blueprint.parallel][installing_dashboards_1] installing dashboards(PosixPath('/home/azureuser/.databricks/labs/ucx/lib/src/databricks/labs/ucx/queries/assessment/azure'), parent_path='/Applications/ucx/dashboards') task failed: validation failed: [resource name must be unique; found duplicates: [dashboards/01ef50d8e5181d0da8a8e14375e6e1f6/pages/01ef50d8e5181db889750db5573f7051/widgets/01ef50d8e5181dd18c03e42417ea6ba3]]: Traceback (most recent call last):
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
return func(*args, **kwargs), None
^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/retries.py", line 54, in wrapper
raise err
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/retries.py", line 33, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/lib/src/databricks/labs/ucx/install.py", line 608, in _create_dashboard
dashboard = Dashboards(self._ws).create_dashboard(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/labs/lsql/dashboards.py", line 953, in create_dashboard
sdk_dashboard = self._ws.lakeview.create(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/service/dashboards.py", line 714, in create
res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/core.py", line 153, in do
response = retryable(self._perform)(method,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/retries.py", line 54, in wrapper
raise err
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/retries.py", line 33, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/azureuser/.databricks/labs/ucx/state/venv/lib/python3.12/site-packages/databricks/sdk/core.py", line 264, in _perform
raise self._make_nicer_error(response=response, **payload) from None
databricks.sdk.errors.platform.InvalidParameterValue: validation failed: [resource name must be unique; found duplicates: [dashboards/01ef50d8e5181d0da8a8e14375e6e1f6/pages/01ef50d8e5181db889750db5573f7051/widgets/01ef50d8e5181dd18c03e42417ea6ba3]]
08-06-2024 06:13 AM
We found a workaround for our migration to Unity. We thought the best solution was to create virtual machines on which to install UCX. Since there are several people on the team, this seemed like the most convenient and scalable solution. The problem occurs after the second installation of UCX on two different workspaces. Basically, with the newly instantiated machine and the installation of UCX on a single workspace, it works. However, when we try to install it on other environments, it gives this error. The solution we found is to create a virtual machine for each environment on which we will install UCX. It doesn't seem like the best solution, but for now it works while we try to understand where the problem lies. Our VM has Ubuntu 24.04 LTS as the operating system.
08-07-2024 06:53 AM
Issue was resolved in lsql v0.7.4, a ucx dependency: https://github.com/databrickslabs/lsql/releases/tag/v0.7.4
1. Upgrade the Databricks cli: https://github.com/databricks/cli/releases/
2. Upgrade ucx: `databricks labs install ucx`
08-02-2024 09:32 AM
some time it is azure issue, I have done this in AWS and it worked
08-05-2024 12:18 AM
thanks for your answer but how can i solve it?
my databricks is on azure i can't change it
08-06-2024 06:13 AM
We found a workaround for our migration to Unity. We thought the best solution was to create virtual machines on which to install UCX. Since there are several people on the team, this seemed like the most convenient and scalable solution. The problem occurs after the second installation of UCX on two different workspaces. Basically, with the newly instantiated machine and the installation of UCX on a single workspace, it works. However, when we try to install it on other environments, it gives this error. The solution we found is to create a virtual machine for each environment on which we will install UCX. It doesn't seem like the best solution, but for now it works while we try to understand where the problem lies. Our VM has Ubuntu 24.04 LTS as the operating system.
08-06-2024 06:11 AM
Hi @antonuzzo96, looks like there are duplicate resource names within the workspace, such as dashboards or widgets, could you please confirm?
08-06-2024 06:15 AM
No duplicates of any kind, including dashboards, workflows, widgets, or any other assets.
08-07-2024 06:53 AM
Issue was resolved in lsql v0.7.4, a ucx dependency: https://github.com/databrickslabs/lsql/releases/tag/v0.7.4
1. Upgrade the Databricks cli: https://github.com/databricks/cli/releases/
2. Upgrade ucx: `databricks labs install ucx`
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group