Using Databricks Sql Statement Execution api

[BipinDatabricks]

Team

We have internal chatbot service that will send query to data bricks SQL execution API.

Number of queries vary from 50 per minute to 100 per minutes. and we are trying to limit response size by applying limit 10. Basically trying hard to use all optimization techniques.

Do you see any challenge in that...? apparently i did not find any official document that tells about request limit in this api..............

 Also if you see any challenge in this implementation , pls do let me know

[Coffee77]

Take a look here https://docs.databricks.com/aws/en/dev-tools/sql-execution-tutorial#step-1-execute-a-sql-statement-a... There are some limitations related data results sizes, timeouts and/or the way data is returned depending on these properties.

[BipinDatabricks]

Thanks @Coffee77

yes saw this before. I am primarily looking for maximum number of request in a minute , which is no where mentioned.

and secondly if anyone experience any challenge in using API in chatbot. like request failure etc....

[Coffee77]

As a suggestion, you can also think of creating your own API to query directly your tables via JDBC/ODBC connections over a SQL Warehouse. This case, limitations would be only those associated to SQL Warehouses and your API but not the Databricks API. So, if running your queries over Databricks API is fine, ok, go with that. Otherwise, you could consider this second option. Details on how to connect with a large variety of clients: