cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Science & Machine Learning

Forum Posts

confusedIntern
by New Contributor III
  • 528 Views
  • 0 replies
  • 0 kudos

MLFlow Project tutorial roadblock in viewing successful job run and run details. Resulted in failed status.

Hi! Any help will be greatly appreciated!! So I'm following this tutorial: https://docs.databricks.com/applications/mlflow/projects.html.I decided to use a folder in DBFS that contains my MLflow Project details. And so, in my project I have: MLprojec...

Screen Shot 2022-07-11 at 3.38.09 PM
  • 528 Views
  • 0 replies
  • 0 kudos
confusedIntern
by New Contributor III
  • 1835 Views
  • 4 replies
  • 0 kudos

Resolved! Spark Version Json code for LTS ML cluster

Hi! Any help will be greatly appreciated! Thank you so much! So I'm currently following this tutorial: https://docs.databricks.com/applications/mlflow/projects.htmlIn the tutorial, for the cluster specification, it has "spark_version": "7.3.x-scala2....

  • 1835 Views
  • 4 replies
  • 0 kudos
Latest Reply
tomasz
New Contributor III
  • 0 kudos

Also for 9.1 LTS ML it should be: "9.1.x-cpu-ml-scala2.12"

  • 0 kudos
3 More Replies
orion216
by New Contributor II
  • 10021 Views
  • 6 replies
  • 2 kudos

Resolved! Keep long-running notebook alive when closing browser

I am working with Azure Databricks jupyter notebooks and have time-consuming jobs (complex queries, model training, loops over many items, etc.).Every time I close the browser (or step away for a long time) of some running notebook, even before the c...

  • 10021 Views
  • 6 replies
  • 2 kudos
Latest Reply
Anonymous
Not applicable
  • 2 kudos

Hey @Eric P​ Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best? If not, please tell us so we can help you.Thanks!

  • 2 kudos
5 More Replies
gar
by New Contributor II
  • 31233 Views
  • 9 replies
  • 6 kudos

Resolved! MLFlow error

I am running into an error within the Databricks notebook (on Databricks website) environment where MLFlow will not load: MLflow autologging encountered a warning: "/databricks/python/lib/python3.8/site-packages/mlflow/utils/autologging_utils/safet...

  • 31233 Views
  • 9 replies
  • 6 kudos
Latest Reply
Will1
New Contributor III
  • 6 kudos

Install the Databricks SQL Connector for Python library on your development machine by running pip install databricks-sql-connector .Query data. Insert data. Query metadata. Cursor and connection management. Configure logging.Regards,Willjoe

  • 6 kudos
8 More Replies
User16830818524
by New Contributor II
  • 6334 Views
  • 2 replies
  • 1 kudos

Resolved! Host R Shiny App

Can I host a R Shiny App on a Databricks cluster?

  • 6334 Views
  • 2 replies
  • 1 kudos
Latest Reply
mgiglia
Contributor
  • 1 kudos

I’ll be asking my rep about the hosted RShiny server in private preview— our team didn’t know about that so we’ve struggled through putting our shiny app (developed on Databricks using RStudio, that part was fantastic) into a container and hosting it...

  • 1 kudos
1 More Replies
Somi
by New Contributor III
  • 1292 Views
  • 2 replies
  • 1 kudos

UnimplementedError; Operation not supported

I am trying to fit a model with callbacks including Tensorboard, history and checkpoint.Then I am loading the model and when trying to fit it again on more epochs, I am receiving this error:UnimplementedError: /dbfs/<path_to_history dir>/history.csv;...

  • 1292 Views
  • 2 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @Somayeh Abniki​, Please recheck the path again and let us know if that works.

  • 1 kudos
1 More Replies
Sarang2610
by New Contributor II
  • 1377 Views
  • 2 replies
  • 4 kudos

Resolved! MLflow

What kind of features I can use with MLflow?

  • 1377 Views
  • 2 replies
  • 4 kudos
Latest Reply
Anonymous
Not applicable
  • 4 kudos

https://docs.databricks.com/applications/mlflow/index.htmlwww.MyAARPMedicare.com

  • 4 kudos
1 More Replies
JD2
by Contributor
  • 608 Views
  • 0 replies
  • 0 kudos

Hubs make key management easier (natural keys from hubs can be converted to surrogate keys via Identity columns).

In this blog https://databricks.com/blog/2022/06/24/prescriptive-guidance-for-implementing-a-data-vault-model-on-the-databricks-lakehouse-platform.htmlIt is mention that "Data Vault modeling recommends using a hash of business keys as the primary key...

  • 608 Views
  • 0 replies
  • 0 kudos
Vpax
by New Contributor
  • 1051 Views
  • 2 replies
  • 0 kudos

Resolved! How does ML Flow work with Databricks monitoring product recently released ?

Does the monitoring tool interact with MLFlow and Feature Store too ?

  • 1051 Views
  • 2 replies
  • 0 kudos
Latest Reply
BilalAslamDbrx
Honored Contributor III
  • 0 kudos

@VirooPax Mirji​ what "monitoring tool" are you referring to?

  • 0 kudos
1 More Replies
Jeremy_E
by New Contributor
  • 741 Views
  • 2 replies
  • 1 kudos

Accessing served models from Excel

Anyone know of an Excel plug-in (or code example) that would connect to a databricks serverd model for scoring and present results back in Excel?

  • 741 Views
  • 2 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @Jeremy Eade​ )​, We haven’t heard from you on the last response from @Akshay Nagpal​, and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to othe...

  • 1 kudos
1 More Replies
JBOCACHICA
by New Contributor III
  • 800 Views
  • 2 replies
  • 1 kudos

Resolved! Databricks high availability

Hi all, i’m are trying to define a HA model within databricks, cuz the lastest failure on Azure, I would like to know if there is a way to have an HA model multicloud, or what do you recommend about this?Regards

  • 800 Views
  • 2 replies
  • 1 kudos
Latest Reply
Rheiman
Contributor II
  • 1 kudos

Agree, there are added costs to multicloud. Don't forget to peer your vnets to keep latency low.

  • 1 kudos
1 More Replies
vives
by New Contributor II
  • 2338 Views
  • 3 replies
  • 0 kudos

How to add signature to model logged through feature store?

It seems that the current method log_model from the FeatureStoreClient class lacks a way to pass in the model signature (as opposed as doing it through mlflow directly). Is there a workaround to append this information? Thanks!

  • 2338 Views
  • 3 replies
  • 0 kudos
Latest Reply
AmirLyall
New Contributor II
  • 0 kudos

Hello!You can log a model with a signature by passing a signature object as an argument with your log_model call. Please see here.Here's an example of this in action in a databricks notebook.Hope that helps!-Amir

  • 0 kudos
2 More Replies
YDB1
by New Contributor
  • 551 Views
  • 0 replies
  • 0 kudos

jupytemplate in databricks

Hi, Most of my notebooks follow the same structure (i.e. load data, preprocessing, learn ML model, evaluate, etc.). I came across the jupytemplate package which allows to define a template for your notebooks. However, I can't seem to make it work in ...

  • 551 Views
  • 0 replies
  • 0 kudos
sbo
by New Contributor III
  • 630 Views
  • 1 replies
  • 0 kudos

Resolved! Does MLFLOW support the storage of Spark Pipeline API

Does the pipeline api allow for saving an entire transformation pipeline and render the artifacts in MLFLOW.

  • 630 Views
  • 1 replies
  • 0 kudos
Latest Reply
BradC26
New Contributor III
  • 0 kudos

Yes the pipeline API allows pickling of a pipeline which can in fact be stored as an artifact. This allows for easy reproducibility of production pipelines!

  • 0 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels