I am currently in the middle of the Data Engineering Associate course on the Databricks Partner Academy. I am on module 4 - "Build Data Pipelines with Delta Live Tables", and trying to complete the lab "DE 4.1 - DLT UI Walkthrough". I have successfully set up the Delta Live Tables pipeline as specified in the lab, minus one thing - I am instructed to select "DBAcademy DLT" for the cluster policy, however that is not listed as an option when I click on the drop down for available cluster policies. The only option I have in my drop down is "None".
I do not believe I have missed a setup step, and I have gone all the way back to the video where the cluster was created in module 1. I believe I have permissions to create a cluster policy, but I am not sure why "DBAcademy DLT" is not listed as a policy after running the setup scripts, and I have not been able to find any source code to get the policy added to my cluster policies. It is not allowing me to complete the lab as the pipeline is erroring out without it.
Has anyone else run into this issue or have any suggestions how I can fix it / where I can find the source code to create that cluster policy?
Hi @Haylyon , We haven't heard from you since the last response from @SeRo , and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to others.
Also, please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!