Databricks Community

ianchenmu · 02-13-2025

Hi, I have a workflow job that is connected to a default cluster (see blow)I know I can swap the cluster. However, sometimes the cluster is not active but when I start the workflow job, I will wait for the cluster to beome activated. It will take som...

ianchenmu · 10-13-2022

I'm training a ML model (e.g., XGboost) and I have a large combination of 5 hyperparameters, say each parameter has 5 candidates, it will be 5^5 = 3,125 combos.Now I want to do parallelization for the grid search on all the hyperparameter combos for ...

ianchenmu · 02-17-2025

I'm using a Databricks App, and the workflow jobs are inside running the app.Do you still recommend using job clusters for app?

ianchenmu · 10-13-2022

Thanks @Joseph Kambourakis ! It seems we could do the distributed XGBoost training using the num_workers regards to how many workers in the cluster. But can we also speed up by setting a parameter utilizing the number of cores in the cluster?

Databricks Community

User Stats

User Activity

Is there a way to switch default cluster associated with a workflow job

Parallelization in training machine learning models using MLFlow

Re: Is there a way to switch default cluster associated with a workflow job

Re: Parallelization in training machine learning models using MLFlow