Update Databricks at notebook level?

[KC_1205]

Hi all,

Can we update the Databricks from existing to newer at notebook level?

I know we can create a newer cluster and attach the note book to update to the newer version. but, can we also update DB at notebook as we update the libraries?

if we can't, then how can we see the impact of the newer version on the existing notebooks?

Thank you

Kiran C

[User16753725182 · Accepted solution]

Hi @Kiran Chalasani​ 

Can you elaborate on what do you mean by 'Update DB at notebook'?

If you meant about updating to the latest platform version of Databricks, this action is managed by us. According to our release calendars, your workspace will be updated to the latest version.

You should periodically restart your clusters to incorporate the new changes and updates on the cluster level.

Apart from that, no other action is required at the workspace or notebook level.

[KC_1205]

Hi Kavya,

Thanks for your reply. If I would like to update from 7.3LTS to 9.1LTS, I thought may be I have to create a new cluster and attach the notebooks to it during the update. Later, check for the compatibility of libraries and UDF at notebook level.

is that right? or any other way to do it?

Thank you

[User16753725182]

Yeah, that is right.

You will have to upgrade the cluster and check if the library version is compatible with other inbuilt libraries by writing your code/UDF in the notebook.

You can find the builtin DBR libraries at https://docs.databricks.com/release-notes/runtime/9.1.html

Other installation methods: https://docs.databricks.com/libraries/index.html#libraries

[KC_1205]

Thanks for the confirmation and the support.

[Anonymous]

Hey there @Kiran Chalasani​ 

Just checking in. Glad that you were able to resolve your query. Would you be happy to mark the answer as best so that other members can find the solution more quickly?