As a suggestion, you can also think of creating your own API to query directly your tables via JDBC/ODBC connections over a SQL Warehouse. This case, limitations would be only those associated to SQL Warehouses and your API but not the Databricks API. So, if running your queries over Databricks API is fine, ok, go with that. Otherwise, you could consider this second option. Details on how to connect with a large variety of clients: