I have built an HMC model using cmdstand. In my local machine, I have install cmdstan for the following approach.
import cmdstanpy
cmdstanpy.install_cmdstan()
But in Databricks I need to reinstall it every time when I train a new model, from the notebook. I have installed the cmdstanpy in the library section of the cluster, but couldn't figure out how to install cmdstan in the cluster directly such that when I restart my cluster again it has the cmdstan ready.
Approaches tried
- Installing cmdstan from notebook before training the model
- Launch web terminal and install cmdstan inside it(but this approach doesn't work if I'm using notebooks to run code)