Maintaining Order Consistency: Table Creation in Databricks SQL vs. DLT Pipeline
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-17-2024 04:50 AM
I have a CTE table with the below names as values. My objective is to create another table by concatenating all the rows from the CTE table in ascending order, resulting in the final output sequence: "Abi, Rahul, ram, Siva". When executing the query in DataBricks SQL, the expected outcome is achieved. However, when creating the table through the DLT pipeline, the order is altered, resulting in the following sequence: "Abi, Siva, ram, Rahul". Is there a solution to maintain the original order consistently, regardless of whether the table is created manually or through the DLT pipeline?