cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

choi_2
by New Contributor III
  • 9426 Views
  • 0 replies
  • 1 kudos

Runtime issue

Hello,I am working on a machine learning project. The dataset I am using has more than 5000000 rows. I am using PySpark, and the attached screenshot is the block I used RandomForestRegressor to train the model.It worked even though it took a pretty l...

  • 9426 Views
  • 0 replies
  • 1 kudos
tjkentSI
by New Contributor
  • 2679 Views
  • 1 replies
  • 0 kudos

Bootstrap timeout on instance creation

I am getting the following error...{ "reason": { "code": "BOOTSTRAP_TIMEOUT", "parameters": { "databricks_error_message": "[id: InstanceId(i-0e552e85c37c9da2d), status: INSTANCE_INITIALIZING, workerEnvId:WorkerEnvId(workerenv-12661843...

  • 2679 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16539034020
Databricks Employee
  • 0 kudos

Hello,  Thanks for contacting Databricks Support.  From the error message: [Bootstrap Event] Can reach databricks-prod-artifacts-us-east-1.s3.amazonaws.com: [FAILED]. It suggests an issue with reaching a Databricks-related AWS S3 bucket from your env...

  • 0 kudos
Robbie
by New Contributor III
  • 14200 Views
  • 3 replies
  • 5 kudos

Why are my MLflow results not showing up in the Experiment UI view?

The issue:None of my MLflow experiment results show up in the Experiment UI. Context:I encountered this issue recently, despite having successfully used the MLFlow UI for the past few weeks.Note: I can still access the experiment runs in a notebook, ...

MLflow Experiment UI view (no results showing up) Accessing via `mlflow.get_runs(...)`
  • 14200 Views
  • 3 replies
  • 5 kudos
Latest Reply
Kumaran
Databricks Employee
  • 5 kudos

Hi @Robbie, Thank you for posting your question in the Databricks community. Ensure that you are logging runs correctly using mlflow.start_run(), and that all relevant metrics and artifacts are being logged with the correct parameters. Please check.

  • 5 kudos
2 More Replies
camazg
by New Contributor
  • 1603 Views
  • 0 replies
  • 0 kudos

Copying Models Between Metastores

Hello,We need to promote models to different environments in different regions, they exist in Unity Catalog.We are setting up DataBricks metastores across different regions.We wanted to follow this approach to copy models via UC https://docs.gcp.data...

  • 1603 Views
  • 0 replies
  • 0 kudos
VincentP
by New Contributor III
  • 6438 Views
  • 1 replies
  • 0 kudos

Resolved! FeatureEngineeringClient loses timestamp_keys after write_table

I am trying to use the FeatureEngineeringClient to setup a feature store table with a time series component. However, after initiating the table with a time series column, the key exists, but the key is removed after adding data to the table. Therefo...

  • 6438 Views
  • 1 replies
  • 0 kudos
Latest Reply
VincentP
New Contributor III
  • 0 kudos

Needed to update to runtime 13.3 ...

  • 0 kudos
mykola14
by New Contributor
  • 1141 Views
  • 0 replies
  • 0 kudos

Buy monzo account

Buy monzo accountDo you want to buy monzo account? Our store is the best place where you can buy monzo accounts. Only fully verified monzo accounts on our store.Buy monzo account 

monzo.jpg
  • 1141 Views
  • 0 replies
  • 0 kudos
mykola12
by New Contributor
  • 1869 Views
  • 0 replies
  • 0 kudos

Buy Advcash account

Buy Advcash accountDo you want to buy advcash account? Our store is the best place where you can buy advcash accounts. Only fully verified advcash accounts on our store.Buy Advcash account

Advcash.jpg
  • 1869 Views
  • 0 replies
  • 0 kudos
thibault
by Contributor III
  • 2123 Views
  • 0 replies
  • 0 kudos

Registered models - edit creator

Hi!I'm using MLFlow API to log and load models in Databricks. When we created a dedicated workspace for models registry, one person created multiple models, and for some reason now all models are logged with this person as the creator.This person no ...

  • 2123 Views
  • 0 replies
  • 0 kudos
Maverick1
by Valued Contributor II
  • 7600 Views
  • 2 replies
  • 4 kudos

Dynamic variable and multi-instance tasks.

1. How to pass dynamic variable values like "sysdate" to a job parameters, so that it will automatically take the updated values on the fly.2. How to run multiple instance of set of tasksin a job (for different parameters). For e.g the same pipeline ...

  • 7600 Views
  • 2 replies
  • 4 kudos
Latest Reply
gyapar
New Contributor II
  • 4 kudos

Hey Maverick1,Did you find a solution for your second question?I have also same approach. In databricks, it has workflows, job clusters, tasks etc.I'm trying to do creating one job cluster with one configuration or specification which has a workflow ...

  • 4 kudos
1 More Replies
SOlivero
by New Contributor III
  • 7109 Views
  • 7 replies
  • 2 kudos

ModuleNotFoundError: No module named 'databricks.feature_store.mlflow_model'

I'm using runtime DBR 12.2 LTS MLGetting this error when running.  import mlflow logged_model = 'runs:/.../model' #my run id # Load model as a PyFuncModel. loaded_model = mlflow.pyfunc.load_model(logged_model) # Predict on a Pandas DataFrame. impor...

  • 7109 Views
  • 7 replies
  • 2 kudos
Latest Reply
Kumaran
Databricks Employee
  • 2 kudos

Hi @SOlivero and @hollybaker354,Can you check by setting the maxDepth to the default value and see how it works?

  • 2 kudos
6 More Replies
StephanieAlba
by Databricks Employee
  • 14982 Views
  • 3 replies
  • 3 kudos

Resolved! Issues importing mediapipe TypeError: 'numpy._DTypeMeta' object is not subscriptable

TypeError: 'numpy._DTypeMeta' object is not subscriptableI have tried upgrading pip and installing newer and older versions of NumPy.

Screenshot 2023-08-16 at 8.10.59 AM.png Screenshot 2023-08-16 at 7.38.45 AM.png Screenshot 2023-08-16 at 7.39.06 AM.png
  • 14982 Views
  • 3 replies
  • 3 kudos
Latest Reply
madengr00
New Contributor II
  • 3 kudos

I ran into the same issue.  Before installing OpenCV I was on Numpy 1.21.5 in my notebook.  After upgrading to 1.23, the error went away for me.  

  • 3 kudos
2 More Replies
HAKO411
by New Contributor
  • 5083 Views
  • 2 replies
  • 3 kudos

Can't select cluster when create AutoML experiment

I'm trying to create my experiment using AutoML. I have a running cluster using 12.2 LTS. However, â€ƒit isn't available as an option for me. How could I solve it? Thank you

Screenshot 2023-10-11 at 11.43.14 AM.png
  • 5083 Views
  • 2 replies
  • 3 kudos
Latest Reply
Annapurna_Hiriy
Databricks Employee
  • 3 kudos

@HAKO411 AutoML needs Databricks Runtime 9.1 ML or above. For time series forecasting, you will need Databricks Runtime 10.0 ML or above. Looks like you are using 12.2 LTS, a non-ML version. Using 12.2 ML LTS should resolve your issue.

  • 3 kudos
1 More Replies
Anonymous
by Not applicable
  • 12961 Views
  • 4 replies
  • 1 kudos

Spark connector to mongodb - mongo-spark-connector_2.12:10.1.1

Hello, I´ve added a library to the cluster and it appears in SPARK UI as Added By Userspark://10.139.64.4:43001/jars/addedFile307892533757162075org_mongodb_spark_mongo_spark_connector_2_12_10_1_1-98946.jarAdded By UserI'm trying to connect using the ...

  • 12961 Views
  • 4 replies
  • 1 kudos
Latest Reply
FurqanAmin
New Contributor II
  • 1 kudos

@DmytroSokhach  I think it works if you change mongo to mongodb in the options. and use spark.mongodb.read.connection.uri instead of spark.mongodb.input.uri as @silvadev suggested.

  • 1 kudos
3 More Replies
somnus
by New Contributor II
  • 3778 Views
  • 1 replies
  • 0 kudos

Use on-premise MinIO as an artifact store in experiment

Hi. I'm trying to use managed MLflow with our own MinIO as an artifact storage. I can see that there is a description about storage options at landing page and there is an input for artifact store URI when creating empty experiment in databicks works...

  • 3778 Views
  • 1 replies
  • 0 kudos
Latest Reply
somnus
New Contributor II
  • 0 kudos

Thanks. I will post there if the feature I asked is doesn't exist.Anyway, the feature I asked about is clearly described on the landing page. I'm looking for documentation for that feature.

  • 0 kudos
Labels