Databricks Community

data_scientist3 · ‎05-15-2025

I deployed a streamlit app on Databricks cluster but the libraries in the requirments.txt file were not installed when the app is deployed. I'm getting this error when a function that uses OpenAI is called."ImportError: Could not import openai python package. Please install it with pip install openai."

Any help will be appreciated. Thanks

stbjelcevic · 2 weeks ago

Hi @data_scientist3 ,

Would you share how you deployed the Streamlit app (Databricks Apps vs running Streamlit from a notebook/job cluster) and your cluster’s Databricks Runtime version? That’ll help me tailor the exact steps to your setup.

Option 1: If you deployed a Databricks App (Streamlit app via Apps)

Ensure a requirements.txt is included at the root of your app’s source code. Apps resolve dependencies from that file when the app is deployed; redeploy after updating it.

Option 2: Install requirements.txt to the cluster (workspace files)

If your requirements.txt is in the Databricks workspace, install it as a cluster library:

Upload or locate the requirements.txt in Workspace files (Workspace > Import).
Compute > your cluster > Libraries > Install new > Source: Workspace > select the requirements.txt path and Install.
Requirements-file installs are supported in Databricks Runtime 15.0+ (for workspace files). If you’re on an older runtime, use PyPI or volumes instead.