topic Re: How to install cmdstanpy in dbx cluster in Data Engineering

How to install cmdstanpy in dbx cluster

MadrasSenpai — Mon, 12 Jun 2023 19:14:21 GMT

I have built an HMC model using cmdstand. In my local machine, I have install cmdstan for the following approach.

import cmdstanpy
cmdstanpy.install_cmdstan()

But in Databricks I need to reinstall it every time when I train a new model, from the notebook. I have installed the cmdstanpy in the library section of the cluster, but couldn't figure out how to install cmdstan in the cluster directly such that when I restart my cluster again it has the cmdstan ready.

Approaches tried

Installing cmdstan from notebook before training the model
Launch web terminal and install cmdstan inside it(but this approach doesn't work if I'm using notebooks to run code)

Re: How to install cmdstanpy in dbx cluster

Anonymous — Fri, 16 Jun 2023 06:10:31 GMT

Hi @Rajamannar Aanjaram Krishnamoorthy

Great to meet you, and thanks for your question!

Let's see if your peers in the community have an answer to your question. Thanks.

Re: How to install cmdstanpy in dbx cluster

MadrasSenpai — Tue, 25 Jul 2023 06:21:23 GMT

Hi @Anonymous there is no progress for this question, may I know what are the next steps for it?