How to call Cloud Fetch APIs?

[edwardh]

About Cloud Fetch mentioned in this article:

https://databricks.com/blog/2021/08/11/how-we-achieved-high-bandwidth-connectivity-with-bi-tools.htm...

Are there any public APIs that can be called directly without ODBC or JDBC drivers?

Thanks.

[Kaniz_Fatma]

Hi @ edwardh@kasoftware.cn! My name is Kaniz, and I'm the technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question first. Or else I will get back to you soon. Thanks.

[Atanu]

Actually we need connector for ani BI tools or for similar connectivity. @edwardh@kasoftware.cn​ 

[edwardh]

Thank you for the explanation.

[edwardh]

Hi @Kaniz Fatma​, can you please give some help on this question? Thanks 😁

[Kaniz_Fatma · Accepted solution]

Hi @edwardh@kasoftware.cn​ ,

The ODBC driver version 2.6.17 and above supports Cloud Fetch, a capability that fetches query results through the cloud storage set up in your Azure Databricks deployment.

To extract query results using this format, you need Databricks Runtime 8.3 or above.

Query results are uploaded to an internal DBFS storage location as arrow-serialized files of up to 20 MB. Azure Databricks generates and returns shared access signatures to the uploaded files when the driver sends fetch requests after query completion. The ODBC driver then uses the URLs to download the results directly from DBFS.

Cloud Fetch is only used for query results more significant than 1 MB. More minor effects are retrieved directly from Azure Databricks.

Azure Databricks automatically collects the accumulated files marked for deletion after 24 hours. These marked files are wholly deleted after an additional 24 hours.

To learn more about the Cloud Fetch architecture, see How We Achieved High-bandwidth Connectivity With BI Tools.

Here are some similar threads with some fantastic conversations on Cloud Fetch:-

• https://community.databricks.com/s/question/0D53f00001YmO6iCAF/how-do-you-use-cloud-fetch
• https://community.databricks.com/s/question/0D53f00001f8ksHCAQ/how-to-enableverify-cloud-fetch-from-...

[edwardh]

It's very detailed, thank you for the explanation!

[Kaniz_Fatma]

Hi @edwardh@kasoftware.cn​ , Thank you for the update. Would you mind marking the answer as the best in that case, please?

[edwardh]

Sure.​

[Kaniz_Fatma]

Thank you @edwardh@kasoftware.cn​ !