Databricks workflow jobs run is taking Double time in EU Region
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-08-2024 01:43 AM
We have a scheduled job in Databricks workflow, This Job run is taking aroud 5 hours Previously before 1 month it was tasking on 2.5 hours. Can any one tell what may be the reason behind this. Note: There is no change has been made in this period of time
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-08-2024 01:53 AM
You can check if you are using spot instances on your Job Cluster.
btw. if you are using Azure West Europe is on very high demand and sometimes it takes time to provision compute.
But it should be matter of minutes, not hours.
Check maybe if your data volume has grown ? Maybe you are doing something not incrementally ?

