cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Connect Delta Lake to OData API?

Joseph_B
New Contributor III
New Contributor III

I'd like to expose Delta Lake data to external customers via OData v4 APIs. What's the best way to do that?

4 REPLIES 4

Joseph_B
New Contributor III
New Contributor III

The Open Data Protocol (OData) is a data access protocol built on core protocols like HTTP and commonly accepted methodologies like REST for the web. Think of OData as a HTTP/REST version of JDBC/ODBC. Pretty thorough/complex.

This can be implemented by creating an intermediate service which handles requests and can query the Delta Lake. That service will need to have a REST API for servicing OData. For reading Delta, the service could use 2 options:

  • Either use the native Delta reader via a Databricks SQL Endpoint, in which case the request pipeline would look like: client -> HTTP -> JDBC/ODBC -> Spark/Databricks,
  • Or use the Rust/Python/Ruby/Golang APIs from delta-rs: https://github.com/delta-io/delta-rs

Golden_Snitch_4
New Contributor II

@Joseph Bradley​ ,

Is the best answer to this still to implement the the OData intermediate service yourself? Or is there a better way now?

john1
New Contributor II

Is the best answer to this still to implement the the OData intermediate service yourself? Or is there a better way now?

Joseph_B
New Contributor III
New Contributor III

I believe it's still the best option. That said, it would be good to know what the OData API is needed for. When I added the original answer, Databricks SQL was nowhere near where it is today, and it's now easy to connect DB SQL directly to PowerBI or other tools which might otherwise "need" OData APIs. For PowerBI, see https://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!