cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

rubenteixeira
by New Contributor III
  • 5810 Views
  • 4 replies
  • 1 kudos

Permission denied: Lightning Logs

I'm doing parameter tuning for a NeuralProphet model (you can see in the image the parameters and code for training)When I try to parallelize the training, it gives me Permission Error.Why can't I access the folder '/databricks/spark/work/*'? Do I ne...

altri1 MicrosoftTeams-image
  • 5810 Views
  • 4 replies
  • 1 kudos
Latest Reply
susanameiras
  • 1 kudos

Hi Ruben!I am facing exactly the same error running a similar approach when using runtime 16.2 ML. I didn't have this issue when using runtime 12.2 LTS ML or 13.3 ML. Did you find a solution?Many thanks!

  • 1 kudos
3 More Replies
User15787040559
by Databricks Employee
  • 1894 Views
  • 2 replies
  • 0 kudos

Can we retrieve experiment results via MLflow API or is this only possible using UI?

Yes, you can use the API https://www.mlflow.org/docs/latest/python_api/index.html

  • 1894 Views
  • 2 replies
  • 0 kudos
Latest Reply
diogo_vieira
  • 0 kudos

And how about tracing data? Do you know how to read likespark.read.format("mlflow-experiment").load() ?

  • 0 kudos
1 More Replies
AntonDBUser
by New Contributor III
  • 1339 Views
  • 6 replies
  • 1 kudos

Hosting R apps and models

Hello!Has anyone tried to host an R Shiny app using Databricks apps? It is very useful for Python apps, but it would be nice to know if anyone have any workaround to make it work with R Shiny Apps.We also wonder about Databricks model hosting for R m...

  • 1339 Views
  • 6 replies
  • 1 kudos
Latest Reply
AntonDBUser
New Contributor III
  • 1 kudos

Hi @parthSundarka!We tried, but had some problems making it work. Do you have a more complete code example? That would be very helpfull!BR, Anton

  • 1 kudos
5 More Replies
ledsouza
by New Contributor
  • 914 Views
  • 5 replies
  • 0 kudos

Community Edition workspace not found

Suddenly got logout from my account in the Community Edition. When I tried to login again, I received this error message: "We were not able to find a Community Edition workspace with this email. Please login to accounts.cloud.databricks.com to find t...

  • 914 Views
  • 5 replies
  • 0 kudos
Latest Reply
parzival
New Contributor II
  • 0 kudos

Hi @all,I solved the issue by signing up for a new Community Edition account using the same email.The only downside is I lost all my notebooks :(.

  • 0 kudos
4 More Replies
kishan_
by New Contributor II
  • 994 Views
  • 4 replies
  • 2 kudos

Resolved! Facing issues with passing memory checkpointer in lanngraph agents

Hi,I am trying to create a simple langgraph agent in Databricks, the agent also uses lanngraph memory checkpoint which enables to store the state of the graph. This is working fine when I am trying it in Databricks notebook, but when I tried to log t...

Machine Learning
langgraph
mlflow
  • 994 Views
  • 4 replies
  • 2 kudos
Latest Reply
sebascardonal
New Contributor II
  • 2 kudos

Hi all. I have the same issue, could you deploy the graph with the MemorySaver?

  • 2 kudos
3 More Replies
rtreves
by Contributor
  • 85 Views
  • 0 replies
  • 0 kudos

Proper mlflow run logging with SparkTrials and Hyperopt

Hello!I'm attempting to run a hyperparameter search using hyperopt and SparkTrials(), and log the resulting runs to an existing experiment (experiment A). I can see on this page that databricks suggests wrapping the `fmin()` call within a `mlflow.sta...

  • 85 Views
  • 0 replies
  • 0 kudos
drjb1010
by New Contributor
  • 101 Views
  • 1 replies
  • 0 kudos

Error when creating model env using 'virtualenv' with DBR 14.3

We were trying to inference from a logged model but had the following errorPreviously, we had been using `conda` as the environment manager, but that is no longer supported. I tried to update pyenv as some suggested but didn't get anywhere. Any insig...

Screen Shot 2025-02-05 at 10.05.12 AM.png
  • 101 Views
  • 1 replies
  • 0 kudos
Latest Reply
alonisser
Contributor
  • 0 kudos

Happened to me too, and pyenv update command is missing , any workarounds here? 

  • 0 kudos
kbmv
by New Contributor III
  • 1040 Views
  • 2 replies
  • 2 kudos

Resolved! Understanding compute requirements for Deploying Deepseek-R1-Distilled-Llama Models on databricks

Hi I have read the blog Deploying Deepseek-R1-Distilled-Llama Models on Databricks at https://www.databricks.com/blog/deepseek-r1-databricksI am new to using custom models that are not available as part of foundation models.According to the blog, I n...

kbmv_0-1738846938736.png
  • 1040 Views
  • 2 replies
  • 2 kudos
Latest Reply
kbmv
New Contributor III
  • 2 kudos

Thanks @Isi, For in-detail explanation. Things are clear now.

  • 2 kudos
1 More Replies
yhyhy3
by New Contributor III
  • 1236 Views
  • 2 replies
  • 0 kudos

Foundation Model APIs HIPAA compliance

I saw that Foundation Model API  is not HIPAA compliant. Is there a timeline in which we could expect it to be HIPAA compliant? I work for a healthcare company with a BAA with Databricks.

  • 1236 Views
  • 2 replies
  • 0 kudos
Latest Reply
User16776430979
New Contributor III
  • 0 kudos

It is now HIPAA compliant: Provisioned throughput endpoints are available with compliance certifications like HIPAA, Model Serving is HIPAA compliant in all regions

  • 0 kudos
1 More Replies
SDN
by New Contributor II
  • 159 Views
  • 2 replies
  • 1 kudos

Resolved! Feature store and medallion data location

Hello Folks,If we have 3 environments (dev/preprod/prod) and would like to have medallion data shared among them - I guess delta share is a good way to go. Now if we want to use "Feature Store (FS)" then I am a bit confused and seeking some clarity. ...

Machine Learning
azure
Feature Store
Medallion
  • 159 Views
  • 2 replies
  • 1 kudos
Latest Reply
SDN
New Contributor II
  • 1 kudos

Thank you so much for the detailed answer!

  • 1 kudos
1 More Replies
Anonymous
by Not applicable
  • 191379 Views
  • 69 replies
  • 15 kudos

Community Edition Login Issues Below is a list of troubleshooting steps for failing to login with email/password at community.cloud.databricks.com:   ...

Community Edition Login Issues   Below  is a list of troubleshooting steps for failing to login with email/password at community.cloud.databricks.com:       Troubleshooting Tips If this is your first time logging in, ensure that you did indeed sign u...

Image Image Image
  • 191379 Views
  • 69 replies
  • 15 kudos
Latest Reply
saital
New Contributor II
  • 15 kudos

same problem I have, would you please help to solution ?

  • 15 kudos
68 More Replies
rahuja
by Contributor
  • 1201 Views
  • 4 replies
  • 2 kudos

Accessing Unity Catalog's MLFlow model registry from outside Databricks

Hello EveryoneWe are integrating Unity Catalog in our Organisation's Databricks. In our case we are planning to move our inference from Databricks to Kubernetes. In order to make the inference code use the latest registered model we need to query the...

  • 1201 Views
  • 4 replies
  • 2 kudos
Latest Reply
bajdwobaht
New Contributor II
  • 2 kudos

You can use the MLflow client (in various language specific SDKs) to download model artifacts. For example, see here: https://docs.databricks.com/en/mlflow/models.html#download-model-artifactsWe leverage this pattern to serve models in our K8s stack ...

  • 2 kudos
3 More Replies
NDK_1
by New Contributor II
  • 5673 Views
  • 6 replies
  • 3 kudos

Salesforce connection with Databricks

How can we connect with salesforce from databricks without using any third party jar files?

  • 5673 Views
  • 6 replies
  • 3 kudos
Latest Reply
emillion25
New Contributor II
  • 3 kudos

You can connect to Salesforce from Databricks without using third-party JAR files by leveraging Python and the Salesforce REST API using the simple-salesforce library. Since simple-salesforce is a Python package, you can install it within your Databr...

  • 3 kudos
5 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels