cosmosdb metadata integration with unity catalog

[Phani1]

Hi Team,

How can we integrate Cosmos DB Meta data with Unity Catalog, can you please provide some insights on this?

Regards,

Phani

[szymon_dybczak]

Hi @Phani1 ,

There is Cosmos DB Spark Connector you can use. For inspiration how to use it, you can check following blog post:

Mastering Azure Cosmos DB and Databricks Integration: Advanced Patterns for low latency data analyti...

Azure Cosmos DB Workshop - Load Data Into Cosmos DB with Azure Databricks

Tutorial: Connect by Using Spark - Azure Cosmos DB for NoSQL | Microsoft Learn

And here's a documentation of connector itself:

GitHub - Azure/azure-cosmosdb-spark: Apache Spark Connector for Azure Cosmos DB

[Khaja_Zaffer]

Hello @Phani1 
Good day:

I have found a whole document on your requirements

https://community.databricks.com/t5/technical-blog/optimising-data-integration-and-serving-patterns-... 

It has a project with it as well.