topic Re: Expose low latency APIs from Deltalake for mobile apps and microservices in Machine Learning

Expose low latency APIs from Deltalake for mobile apps and microservices

jcapplefields88 — Fri, 10 Jun 2022 14:37:11 GMT

My company is using Deltalake to extract customer insights and run batch scoring with ML models. I need to expose this data to some microservices thru gRPC and REST APIs. How to do this? I'm thinking to build Spark pipelines to extract teh data, store it in a fast cache like Redis and create some APIs in front. Is there a faster solution?

Re: Expose low latency APIs from Deltalake for mobile apps and microservices

Atanu — Tue, 13 Sep 2022 18:20:32 GMT

I think your mentioned plan work with your use case for low latency . but you may go through this book if that helps. https://www.databricks.com/p/ebook/the-wisdom-of-transitioning-to-a-data-lakehouse-strategy?utm_medium=paid+search&utm_source=google&utm_campaign=17115062609&utm_adgroup=142991766184&utm_content=ebook&utm_offer=the-wisdom-of-transitioning-to-a-data-lakehouse-strategy&utm_ad=595658407872&utm_term=databricks%20data%20lake&gclid=CjwKCAjw1ICZBhAzEiwAFfvFhFIvvjkCe-tRY872Sf4LHVoKSkCxYxnHQRPFOGA3stDEfNPDsy4t1RoCpqsQAvD_BwE

Not super familiar but should give more insight.

Re: Expose low latency APIs from Deltalake for mobile apps and microservices

jose_gonzalez — Mon, 19 Sep 2022 20:52:44 GMT

Hi @John Capplefield,

Just a friendly follow-up. Did you have time to check Atanu's docs? do you still need help? please let us know.

Re: Expose low latency APIs from Deltalake for mobile apps and microservices

Noopur_Nigam — Mon, 03 Oct 2022 06:53:30 GMT

Hi @John Capplefield Gentle follow-up, please let us know if you need further help on this.