Databricks Community

pemidexx · 04-29-2025

I am working on a Dash-based app that includes a call to a Databricks-hosted LLM endpoint. I am trying to track those calls with MLFlow. My code is (roughly) like this:from openai import OpenAIimport mlflowmlflow.set_tracking_uri("databricks")mlflow....

pemidexx · 11-22-2024

I am trying to pass a column of data from python/pandas to Spark, then run AI_QUERY. However, when I attempt to pass modelParameters (such as temperature), the function fails. Below is a minimal example: import pandas as pdqueries = pd.DataFrame([ ...

pemidexx · 05-22-2025

I would recommend updating this post to include discussion of uv as a depenedency manager instead of conda. MLflow added support for uv in version 2.20.0 (docs here, PR here). The current section 4.5.1 is somewhat misleading given the availability of...

pemidexx · 05-01-2025

Thank you for the push in the right direction! I was able to solve the issue with this codeos.environ["DATABRICKS_CLIENT_ID"] = "" os.environ["DATABRICKS_CLIENT_SECRET"] = "" os.environ["DATABRICKS_TOKEN"] = os.environ.get("VAR_CONFIGURED_WITH_DATABR...

pemidexx · 05-01-2025

Good question - unfortunately yes, if I set DATABRICKS_TOKEN I get a different error2025/05/01 13:27:40 DEBUG mlflow.utils.databricks_utils: Failed to create databricks SDK workspace client, error: ValueError('validate: more than one authorization me...

pemidexx · 01-28-2025

Thanks @SepidehEb for this great overview. I especially like the table under "Selecting node type with the right CPU, Disk, and Memory". Would you consider creating a similar table with GPU node types? And in general, would love your advice on what a...

pemidexx · 12-10-2024

@brian_law In the section above on HuggingFace cache you recommend using DBFS for the model cache. Can a shared path (such as a Workspace of Volume) be used as well?

Databricks Community

User Stats

User Activity

MLFlow Authentication from Databricks App for GenAI Tracing

AI_QUERY does not accept modelParameters argument

Re: Managing Machine Learning Library Dependency on Databricks

Re: MLFlow Authentication from Databricks App for GenAI Tracing

Re: MLFlow Authentication from Databricks App for GenAI Tracing

Re: MLOps Gym - Advanced Guide to Cluster Configuration for MLOps

Re: Introducing the DeepSpeed Distributor on Databricks