Running large volume of SQL queries in Python notebooks. How to minimise overheads/maintenance.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-13-2023 05:39 AM
I have around 200 SQL queries id like to run in databricks python notebooks. Id like to avoid creating an ETL process for each of the 200 SQL processes.
Any suggestions on how to run the queries in a way that it loops through them so i have minimum amount of components to maintain.
Labels:
- Labels:
-
Databricks Notebooks
-
Large Volume
-
Python
-
Python3
-
SQL