- 1785 Views
- 1 replies
- 1 kudos
Unable to call logged ML model from a different notebook when using Spark ML
Hi, I am a R user and I am experimenting to build an ml model with R and with spark flavoured algorithms in Databricks. However, I am struggling to call a model that is logged as part of the experiment from a different notebook when I use spark flavo...
- 1785 Views
- 1 replies
- 1 kudos
- 1 kudos
@Dip Kundu​ :It seems like the error you are facing is related to sparklyr, which is used to interact with Apache Spark from R, and not directly related to mlflow. The error message suggests that an object could not be found, but it's not clear which...
- 1 kudos
- 2812 Views
- 3 replies
- 1 kudos
Can I run a custom function that contains a trained ML model or access an API endpoint from within a SQL query in the SQL workspace?
I have a dashboard and I'd like the ability to take the data from a query and then predict a result from a trained ML model within the dashboard. I was thinking I could possibly embed the trained model within a library that I then import to the SQL w...
- 2812 Views
- 3 replies
- 1 kudos
- 1 kudos
@Erik Shilts​ :Yes, it is possible to use a trained ML model in a dashboard in Databricks. Here are a few approaches you could consider:Embed the model in a Python library and call it from SQL: You can train your ML model in Python and then save it a...
- 1 kudos
- 4489 Views
- 5 replies
- 7 kudos
Parallelization in training machine learning models using MLFlow
I'm training a ML model (e.g., XGboost) and I have a large combination of 5 hyperparameters, say each parameter has 5 candidates, it will be 5^5 = 3,125 combos.Now I want to do parallelization for the grid search on all the hyperparameter combos for ...
- 4489 Views
- 5 replies
- 7 kudos
- 7 kudos
Hi @Chen Mu​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 7 kudos
- 2305 Views
- 3 replies
- 1 kudos
ML Model serving cluster tags?
Is there a way to add tags automatically to ML Model serving clusters? I see we can add tags to the model itself which persist but any tags I add to the cluster serving it do not after the endpoint is stopped. This would be important to track billing...
- 2305 Views
- 3 replies
- 1 kudos
- 1 kudos
Hey there @Deep Kalra​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
- 1 kudos