- 2481 Views
- 3 replies
- 2 kudos
How to speed up `dbx launch --from-assets`
Hiya,I'm trying to follow the testing workflow of```$ dbx deploy test --assets-only$ dbx launch test --from-assets --trace --include-output stdout```But I find the turnaround time is quite long, even with an instance pool.The `deployment.yaml` looks ...
- 2481 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi, I have no solution, actually I've just registered to open a very similar ticket, when saw yours.According to my experiments getting an already running VM from the pool (times between events: CREATING - INIT_SCRIPTS_STARTED) can take anything betw...
- 2 kudos
- 4406 Views
- 3 replies
- 1 kudos
Resolved! Run databricks job instantly without waiting job cluster get active
when we run databricks job it take some time to get job cluster active . I created pool also and attached with job cluster but still it take time to attached the cluster and job cluster get active to start the job run. is there any way - we can run d...
- 4406 Views
- 3 replies
- 1 kudos
- 1 kudos
If you want instant processing, you will have to have a cluster running all the time.As mentioned above, Databricks is testing serverless compute for data engineering workloads (comparable to serverless SQL). This fires up a cluster in a few seconds...
- 1 kudos