I am getting started with DABs and just recently ran into a following error after deployment trying to run my bundle that has a wheel installation job.
Error: failed to reach TERMINATED or SKIPPED, got INTERNAL_ERROR: Task main_task failed with message: Library installation failed for library due to user error. Error messages:
Library from /Workspace is not allowed on non Unity Catalog cluster.
Please switch to DBR 13.1+ Shared cluster or 13.2+ Assigned cluster to use /Workspace libraries.
Is it so that it is not possible to deploy into a workspace folder and use that to install a wheel if unity catalog is not configured? If possible how could I switch my DBR (13.3) to use /Workspace libraries? From DABs documentation I was not able to find information whether UC is required.
Hi @AndyM ,
The error message you encountered indicates that the library installation failed due to a restriction related to the Unity Catalog. Let’s break down the issue and explore the solution:
Unity Catalog and Workspace:
Automatic vs. Manual Enablement:
/Workspacefolder, which is not allowed on non-Unity Catalog clusters.
DBR Version and Unity Catalog:
Remember that Unity Catalog enhances data governance, so configuring it correctly ensures a smoother experience when managing your data assets. 🌟
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!