cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Phani1
by Valued Contributor
  • 998 Views
  • 3 replies
  • 4 kudos

Efficiently orchestrate data bricks jobs

Hi Team,How efficiently can orchestrate data bricks jobs which involve a lot of transformations, dependencies, and complexity?At source have a lot of SSIS packages that have complex dependencies and more transformation.     We have the following opti...

  • 998 Views
  • 3 replies
  • 4 kudos
Latest Reply
Phani1
Valued Contributor
  • 4 kudos

My question is, how do we reliably orchestrate multiple Databricks Jobs/Workflows that are running in a mixed latency and can write to the same silver and gold delta tables? Could you please suggest the best approach and practices for the same?

  • 4 kudos
2 More Replies
User16826994223
by Honored Contributor III
  • 654 Views
  • 1 replies
  • 0 kudos

multitask in Databricks

Hi Team is there any way we can utilize same cluster to run multiple dependent jobs in multi-task, starting cluster for every jobs take time

  • 654 Views
  • 1 replies
  • 0 kudos
Latest Reply
User16830818524
New Contributor II
  • 0 kudos

At this time it is not possible

  • 0 kudos
Labels