- 1202 Views
- 1 replies
- 1 kudos
performance issue with SIMBA ODBC using SSIS
i was trying to upload data into a table in hive_metastore using SSIS using SIMBA ODBC driver. The data set is huge (1.2 million records and 20 columns) , it is taking more than 40 mins to complete. is there an config change to improve the load time.
- 1202 Views
- 1 replies
- 1 kudos
- 1 kudos
Looks like a slow data upload into a table in hive_metastore using SSIS and the SIMBA ODBC driver. This could be due to a variety of factors, including the size of your dataset and the configuration of your system. One potential solution could be to ...
- 1 kudos
- 1745 Views
- 2 replies
- 3 kudos
Efficiently orchestrate data bricks jobs
Hi Team,How efficiently can orchestrate data bricks jobs which involve a lot of transformations, dependencies, and complexity?At source have a lot of SSIS packages that have complex dependencies and more transformation. We have the following opti...
- 1745 Views
- 2 replies
- 3 kudos
- 3 kudos
My question is, how do we reliably orchestrate multiple Databricks Jobs/Workflows that are running in a mixed latency and can write to the same silver and gold delta tables? Could you please suggest the best approach and practices for the same?
- 3 kudos