cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Science & Machine Learning

Forum Posts

amits
by New Contributor III
  • 3526 Views
  • 8 replies
  • 5 kudos

Tableau extract creation frozen

Heya,I'm having an issue with extract creation from a Delta lake table. Tableau is frozen on "Rows retrieved: X" for too long.I actually succeeded in creating the first extract but saw I was missing a column. I went ahead and did a full rewrite -even...

  • 3526 Views
  • 8 replies
  • 5 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 5 kudos

Hi @Amit Steiner​ â€‹, We haven’t heard from you on the last response from @Prabakar Ammeappin​ , and I was checking back to see if you have a resolution yet. If you have any solution, please share it with the community as it can be helpful to others. ...

  • 5 kudos
7 More Replies
Giorgi
by Contributor
  • 2809 Views
  • 2 replies
  • 1 kudos

Resolved! How to read artifact file (CSV) programmatically?

Hello, can I programmatically access artifact file (csv), via artifact_uri and read it?Tried the following, but didn't work, says no such file or directory:mlflow.pyfunc.pandas.read_csv(artifact_uri+'/xgb-classifier-test-8/dataset_statistics.csv')pan...

  • 2809 Views
  • 2 replies
  • 1 kudos
Latest Reply
Giorgi
Contributor
  • 1 kudos

Maybe there are better solutions, here is what I've found:from mlflow.tracking import MlflowClient   client = MlflowClient() pd.read_csv(client.download_artifacts(run_id, "xgb-classifier-test-8/dataset_statistics.csv"))

  • 1 kudos
1 More Replies
jhonw901227
by New Contributor II
  • 855 Views
  • 0 replies
  • 0 kudos

MLflow Model Serving on Azure Databricks

I know that in the documentation about model serving says.The cluster is maintained as long as serving is enabled, even if no active model version exists. To terminate the serving cluster, disable model serving for the registered model.The cluster is...

  • 855 Views
  • 0 replies
  • 0 kudos
sanikamal
by New Contributor III
  • 3032 Views
  • 5 replies
  • 5 kudos

Resolved! Unable to Reset my Community Edition Password

I have forgotten my Databricks Community Edition Password and I am trying to Reset the same using the Forgot Password link. It is saying that an Email will be sent with the link to reset the password but the Email is not coming.

  • 3032 Views
  • 5 replies
  • 5 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 5 kudos

Hi @Sani Kamal​ , Thank you for reaching out!Please share your relevant details with community@databricks.com.

  • 5 kudos
4 More Replies
108387
by New Contributor II
  • 12551 Views
  • 2 replies
  • 2 kudos

Intermittent "Unexpected failure while waiting for the cluster to be ready" Error

We are encountering an occasional issue where jobs may fail with a message like the following:Run result unavailable: job failed with error message Unexpected failure while waiting for the cluster (ID) to be ready.Cause Unexpected state for cluster (...

  • 12551 Views
  • 2 replies
  • 2 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

Hi @Benjamin Niedzielski​ , This article describes several scenarios in which a cluster fails to launch, and provides troubleshooting steps for each scenario based on error messages found in logs.

  • 2 kudos
1 More Replies
MattM
by New Contributor III
  • 1523 Views
  • 2 replies
  • 3 kudos

Resolved! Mapping Control data - Maintained by Business User

We are ingesting our data from ADLS into databricks as delta table. After raw layer we need to refer to a control\mapping layer which defines certain logic\measure definition. This would be incorporated in the subsequent silver or gold layer. This co...

  • 1523 Views
  • 2 replies
  • 3 kudos
Latest Reply
MattM
New Contributor III
  • 3 kudos

Thanks for your response. Can business user without the help of any script modify any rows in the table after loading it onetime from CSV fiels?

  • 3 kudos
1 More Replies
vaibhavsingal11
by New Contributor
  • 3328 Views
  • 3 replies
  • 4 kudos

Error executing mlflow's mlflow.register_model() in applyInPandas to register Model to another workspace.

Hi Team,I am getting the following error (mlflow.utils.databricks_utils._NoDbutilsError) while trying to register model using applyInPandas to another databricks workspace. I have already set the secret scope and prefix to authenticate against the 2n...

  • 3328 Views
  • 3 replies
  • 4 kudos
Latest Reply
Amardeep
New Contributor II
  • 4 kudos

@vaibhavsingal11​ , Hey, any progress on this? I'm facing the same issue, and It looks like dbutils is inaccessible from worker nodes: LINK

  • 4 kudos
2 More Replies
Maverick1
by Valued Contributor II
  • 4059 Views
  • 8 replies
  • 11 kudos

Resolved! Migration from self-managed MLflow to Databricks managed MLflow.

Would it be possible to somehow save the data, metrics of all experiments captured by self-managed mlflow using A/mazon RDS, S3 as backend and then load it to databricks managed mlflow and make it available in the UI? This is required as a part of mi...

  • 4059 Views
  • 8 replies
  • 11 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 11 kudos

Hi @Saurabh Verma​  , Just a friendly follow-up. Do you still need help or the above responses help you to find the solution? Please let us know.

  • 11 kudos
7 More Replies
Marco98
by New Contributor II
  • 1560 Views
  • 1 replies
  • 2 kudos

Pytorch DDP on Databricks

Hello!I am currently trying to use Pytorch Lightning inside Databricks and I am currently using a cluster with 2 gpus. Whenever I try to train my Transformer model with 1 gpu in DP strategy everything works fine, but when I try to use both the 2 gpus...

  • 1560 Views
  • 1 replies
  • 2 kudos
Latest Reply
Chakra03
New Contributor II
  • 2 kudos

Hi @Marco Capusso​ , I am facing the similar issue could you find some fix. It would be great if you share some details around it.

  • 2 kudos
Direo
by Contributor
  • 1372 Views
  • 2 replies
  • 2 kudos

Feature store errors

HiWhen I open feature store, I get an error saying that "Failed to load some job schedules". When I open one of the feature store tables, I get several additional errors:"Failed to laod lates run for some job producers","Failed to laod some job produ...

image
  • 1372 Views
  • 2 replies
  • 2 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

Hi @Direo Direo​ , Just a friendly follow-up. Do you still need help, or @Hubert Dudek (Customer)​ 's response help you to find the solution? Please let us know.

  • 2 kudos
1 More Replies
venkat09
by New Contributor III
  • 1536 Views
  • 1 replies
  • 1 kudos

Resolved! Running into an issue while setting up dbx locally?

Followed the documentation and facing issue while running dbx execute on all-purpose/interactive cluster, which is up and running already. Ran this command  dbx execute --cluster-id=XXXXXX --job=dbx-demo-job --no-rebuild --debug. If anyone faced it ...

image
  • 1536 Views
  • 1 replies
  • 1 kudos
Latest Reply
venkat09
New Contributor III
  • 1 kudos

before running package it as wheel before running `dbx execute` fix the issue

  • 1 kudos
Nithin
by New Contributor II
  • 10612 Views
  • 14 replies
  • 4 kudos

Resolved! How to access databricks feature store outside databricks?

We are building the feature store using databricks API. Few of the machine learning engineers are using Jupyter notebooks. Is it possible to use feature store outside databricks?

  • 10612 Views
  • 14 replies
  • 4 kudos
Latest Reply
datariel
New Contributor II
  • 4 kudos

Hi @Kaniz Fatma​  and @Jose Gonzalez​ ,turning back to the original question, and considering that one of the main benefits of the Feature Store is the removal of the online/offline skew, how could I access to the features from a client application l...

  • 4 kudos
13 More Replies
naveen_marthala
by Contributor
  • 3282 Views
  • 4 replies
  • 2 kudos

Resolved! why does the client need to have git installed for auto-logging to an mlflow server running in "--serve-artifacts" mode?

I have an mlflow server with `--serve-artifacts` and with postgres as `--backend-store-uri`. The machine(container with base image python:3.9-bullseye) running the server has git installed which is available on path. I am logging from jupyter-noteboo...

  • 3282 Views
  • 4 replies
  • 2 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

Hi @Naveen Marthala​ â€‹ , Just a friendly follow-up. Do you still need help or the above responses help you to find the solution? Please let us know.

  • 2 kudos
3 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels