topic Re: Cosmos db spark patch api in Data Engineering

Cosmos db spark patch api

Soma — Thu, 06 Apr 2023 01:17:47 GMT

Hi all we are trying to do cosmos patch api to a array field but the problem I see is we need to collect the data to get the index can you please let us know if we have an alternative as this causes bottleneck on driver

Re: Cosmos db spark patch api

Soma — Thu, 06 Apr 2023 05:09:07 GMT

We are using SQL api and will try to patch for a array element at a particular index which is also part of the column value so we have to do a collect and get the index of array and set the array index property and then do the patch @Debayan Mukherjee

Re: Cosmos db spark patch api

Anonymous — Sat, 08 Apr 2023 06:42:43 GMT

Hi @somanath Sankaran

Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.

Please help us select the best solution by clicking on "Select As Best" if it does.

Your feedback will help us ensure that we are providing the best possible service to you. Thank you!

Re: Cosmos db spark patch api

Soma — Sun, 09 Apr 2023 11:31:09 GMT

No still waiting for response thanks

Re: Cosmos db spark patch api

Debayan — Thu, 06 Apr 2023 04:56:01 GMT

Hi, Could you please clarify on the API as only below API SDKs are available for Azure cosmos DB.

https://learn.microsoft.com/en-us/azure/databricks/external-data/cosmosdb-connector

SQL API
MongoDB API
Cassandra API
Graph (Gremlin) API
Table API

Also, please tag @Debayan with your next response which will notify me. Thank you!

Re: Cosmos db spark patch api

Debayan — Mon, 10 Apr 2023 04:50:56 GMT

Hi @somanath Sankaran , Azure Cosmos DB APIs are supported by Microsoft Azure, could you also please engage Azure team on this?