03-16-2022 01:32 AM
Hi all,
Can we update the Databricks from existing to newer at notebook level?
I know we can create a newer cluster and attach the note book to update to the newer version. but, can we also update DB at notebook as we update the libraries?
if we can't, then how can we see the impact of the newer version on the existing notebooks?
Thank you
Kiran C
03-16-2022 02:43 AM
Hi @Kiran Chalasani
Can you elaborate on what do you mean by 'Update DB at notebook'?
If you meant about updating to the latest platform version of Databricks, this action is managed by us. According to our release calendars, your workspace will be updated to the latest version.
You should periodically restart your clusters to incorporate the new changes and updates on the cluster level.
Apart from that, no other action is required at the workspace or notebook level.
03-16-2022 02:43 AM
Hi @Kiran Chalasani
Can you elaborate on what do you mean by 'Update DB at notebook'?
If you meant about updating to the latest platform version of Databricks, this action is managed by us. According to our release calendars, your workspace will be updated to the latest version.
You should periodically restart your clusters to incorporate the new changes and updates on the cluster level.
Apart from that, no other action is required at the workspace or notebook level.
03-16-2022 04:03 AM
Hi Kavya,
Thanks for your reply. If I would like to update from 7.3LTS to 9.1LTS, I thought may be I have to create a new cluster and attach the notebooks to it during the update. Later, check for the compatibility of libraries and UDF at notebook level.
is that right? or any other way to do it?
Thank you
03-16-2022 04:22 AM
Yeah, that is right.
You will have to upgrade the cluster and check if the library version is compatible with other inbuilt libraries by writing your code/UDF in the notebook.
You can find the builtin DBR libraries at https://docs.databricks.com/release-notes/runtime/9.1.html
Other installation methods: https://docs.databricks.com/libraries/index.html#libraries
03-16-2022 04:26 AM
Thanks for the confirmation and the support.
03-24-2022 06:51 AM
Hi @Kiran Chalasani , Would you like to mark @Kavya Manohar Parag 's answer as the best if that helped resolve your issue?
04-14-2022 06:36 AM
Hey there @Kiran Chalasani
Just checking in. Glad that you were able to resolve your query. Would you be happy to mark the answer as best so that other members can find the solution more quickly?
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.