Yeah, that is right.

You will have to upgrade the cluster and check if the library version is compatible with other inbuilt libraries by writing your code/UDF in the notebook.

You can find the builtin DBR libraries at https://docs.databricks.com/release-notes/runtime/9.1.html

Other installation methods: https://docs.databricks.com/libraries/index.html#libraries