- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-17-2025 09:38 AM - edited 11-17-2025 09:39 AM
Hi @Nidhig ,
1. Regarding pipeline cost - here you're mostly paying for compute usage. So the exact price depends on which plan you are at and which cloud provider you are using. For instance, for Azure premium plan and US East region you have following cost of DBU:
Here you can use pricing calculator if you want to have more detailed cost estimation because there are other factors like i.e Photon enable
Pricing Calculator Page | Databricks
2. Regarding job reuse - within one job you can have multiple task and those task will reuse your compute. But for example, if you define for_each task and inside an interation you will run job then each job will spawn it's own job compute.
3. This is a limitation of file-based event triggers as of now. But of course there are plenty of workaround. For example, you can subscribe to Azure Event Grid System Topic and if new file arrives then azure function will start processing passing file_path as an argument to a job.