- 1181 Views
- 1 replies
- 7 kudos
Train machine learning models: How can I take my ML lifecycle from experimentation to production?
Note: the following guide is primarily for Python users. For other languages, please view the following links: • Table batch reads and writes • Create a table in SQL • Visualizing data with DBSQLThis step-by-step guide will get your data...
- 1181 Views
- 1 replies
- 7 kudos
- 7 kudos
I got good knowledge by your post . It is very clear . Thank you . Keep sharing like this posts .It will be helpful
- 7 kudos
- 6635 Views
- 1 replies
- 0 kudos
Failed to add 1 container to the cluster. will attempt retry: false. reason: bootstrap timeout
Hi Team,When creating a new cluster in a workspace within a VNET receiving this error:Failed to add 1 container to the cluster. will attempt retry: false. reason: bootstrap timeoutCluster terminated. Reason: Bootstrap TimeoutCheers.Gil
- 6635 Views
- 1 replies
- 0 kudos
- 0 kudos
@Gil Gonong​ :The error message you are receiving suggests that the creation of the new cluster has failed due to a bootstrap timeout. The bootstrap process is responsible for setting up the initial configuration of the cluster, and if it takes too l...
- 0 kudos
- 3748 Views
- 6 replies
- 7 kudos
How are dashboards served and what would happen to them if the cluster attached to the notebook terminates?
I have two dashboards in presentation mode both from notebooks being run on the same compute cluster. Last night the cluster terminated due to idle time and in the morning one of my dashboards was fine but the other one was set to the default stab di...
- 3748 Views
- 6 replies
- 7 kudos
- 7 kudos
​If your query were scheduled, it's automatically started the cluster at the scheduled time Or might be possible that the portion that is still visible doesn't need to be generated so it looks like it's working but it is just left over from the prior...
- 7 kudos
- 4273 Views
- 4 replies
- 1 kudos
Permission denied: Lightning Logs
I'm doing parameter tuning for a NeuralProphet model (you can see in the image the parameters and code for training)When I try to parallelize the training, it gives me Permission Error.Why can't I access the folder '/databricks/spark/work/*'? Do I ne...
- 4273 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi, Could you please check on cluster-level permissions and let us know if it helps? Please refer: https://docs.databricks.com/security/access-control/cluster-acl.html#cluster-level-permissions
- 1 kudos
- 2751 Views
- 4 replies
- 2 kudos
How to solve cluster break down due to GC when training a pyspark.ml Random Forest
I am trying to train and optimize a random forest. At first the cluster handles the garbage collection fine, but after a couple of hours the cluster breaks down as Garbage Collection has gone up significantly.The train_df has a size of 6,365,018 reco...
- 2751 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Liselotte van Unen​(Customer)​ , We haven’t heard from you since the last response from @Hubert Dudek​, and I was checking back to see if his suggestions helped you.Or else, If you have any solution, please do share that with the community as it ...
- 2 kudos
- 1198 Views
- 3 replies
- 0 kudos
No saved model after stopping the cluster.
I have saved a keras model in some directories in dbfs to load and retrain that with more data, etc. The problem is that when cluster stops and restarts, seems those directories and model are no longer available there and it starts training a new mod...
- 1198 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Vidula Khanna​ I figured it out by replacing OS library module with dbutils utilities. It looks like mre compatible with DBFS.
- 0 kudos
- 3499 Views
- 4 replies
- 2 kudos
Resolved! Cluster setup for ML work for Pandas in Spark, and vanilla Python.
My setup:Worker type: Standard_D32d_v4, 128 GB Memory, 32 Cores, Min Workers: 2, Max Workers: 8Driver type: Standard_D32ds_v4, 128 GB Memory, 32 CoresDatabricks Runtime Version: 10.2 ML (includes Apache Spark 3.2.0, Scala 2.12)I ran a snowflake quer...
- 3499 Views
- 4 replies
- 2 kudos
- 2 kudos
Hey there @Vivek Ranjan​ Checking in. If Joseph's answer helped, would you let us know and mark the answer as best? It would be really helpful for the other members to find the solution more quickly.Thanks!
- 2 kudos
- 26664 Views
- 2 replies
- 2 kudos
Resolved! Problem with spinning up a cluster on a new workspace
Error: Please check network connectivity from the data plane to the control plane.{ "reason": { "code": "BOOTSTRAP_TIMEOUT", "parameters": { "databricks_error_message": "[id: InstanceId(i-0457092c), status: INSTANCE_INITIALIZING, workerEnvId:...
- 26664 Views
- 2 replies
- 2 kudos
- 2 kudos
Can you please get the system logs from AWS EC2 console as soon the cluster fails - System Logs for the failed instance will be accessible from the AWS console up to an hour after the shutdown.AWS console clears the references of terminated clusters ...
- 2 kudos
- 1244 Views
- 1 replies
- 0 kudos
Rollback cluster changes
Is it possible to rollback changes made to a cluster? The problem I'm trying to solve is to recover from an accidental change made by a user on a cluster that affects interactive and job runs. Cluster policies help, but the policy still provides the ...
- 1244 Views
- 1 replies
- 0 kudos
- 0 kudos
You could look at automating cluster creation steps and implementing this with an infra-as-code solution like the databricks terraform provider which allows rollback
- 0 kudos
- 2246 Views
- 4 replies
- 0 kudos
How do you control the cost of provisioning a cluster?
How do you govern the cost of running clusters in Databricks so you're not sticker shocked?
- 2246 Views
- 4 replies
- 0 kudos
- 0 kudos
Less use of Interactive cluster and more use of job cluster can one of the way above others
- 0 kudos