topic Re: Control query caching using SQL statement execution API in Data Engineering

Control query caching using SQL statement execution API

pranathisg97 — Tue, 06 Jun 2023 07:56:47 GMT

I want to execute this statement using databricks SQL Statement Execution API.

curl -X POST 
    -H 'Authorization: Bearer <access-token>' 
    -H 'Content-Type: application/json' 
    -d '{"warehouse_id": "<warehouse_id>", 
     "statement": "set use_cached_result = false;select * from <schema_name>.<table_name> limit 100", 
     "catalog": "dspf_test", 
     "wait_timeout": "50s", 
     "on_wait_timeout": "CANCEL", 
     "disposition": "EXTERNAL_LINKS"
     }' 
https://<databricks-host>/api/2.0/sql/statements/

but getting this error:

How to use this "set use_cached_result = false" along with main query in single query statement using SQL Statement Execution API

SQL Statement Execution API Reference doc:

https://docs.databricks.com/api/workspace/statementexecution/executestatement

Re: Control query caching using SQL statement execution API

Anonymous — Tue, 20 Jun 2023 06:11:42 GMT

Hi @Pranathi Girish

We haven't heard from you since the last response from @Kaniz Fatma , and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Re: Control query caching using SQL statement execution API

TimFrazer — Tue, 19 Mar 2024 05:51:51 GMT

Did you ever find a solution to this problem?

Re: Control query caching using SQL statement execution API

SumitAgrawal454 — Wed, 04 Sep 2024 10:12:01 GMT

Looking for solution as I am facing the exact same problem