Azure CosmosDB change feed ingestion via DLT

[Ogi]

Is there a way to ingest Azure CosmosDB data via Delta Live Tables? If I use regular workflows it works well, but with DLT I'm not able to set CosmosDB Connector on a cluster.

[Hubert-Dudek · Accepted solution]

In DLT, you can install libraries only through pip. The problem is that the CosmosDB driver is installed through Maven / JAR. I don't think it is preinstalled.

Maybe you can send the change data feed to Event Hub and read Event Hub in DLT as Kafka.

https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/changefeed-ecommerce-solution

[Jfoxyyc]

I would likely do the same, but instead send the change data feed to Event Hub and materialize in abfss as json or parquet or some format and consume via DLT using autoloader.

[Ogi]

Thanks a lot! Just wanted to doublecheck whether this natively exists.