Databricks pipeline script is not creating schema before creation of table
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-26-2025 10:17 AM
Hello
We are facing some issue while executing the databricks pipeline i.e it takes all scripts in random sequence, and if no schema was created before it scheduled a job to create table it'll fail
As a alternative we are executing schema pipeline first then table creation ...actually it should create those in through none notebo
Would appreciate if anyone could help me.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-26-2025 03:27 PM
Hi @suk
This is a common issue with Databricks pipelines where dependencies aren't properly managed, causing scripts to execute in random order.
Use Databricks Workflows with Task Dependencies
Configure explicit task dependencies: