topic Re: Can I access Delta tables outside of Databricks Runtime? in Machine Learning

Can I access Delta tables outside of Databricks Runtime?

User16826994223 — Tue, 15 Jun 2021 16:06:09 GMT

Is it possible to write same table with Databricks and from OSS too, Also what if I want to read the data from Map redeuce or hive

Re: Can I access Delta tables outside of Databricks Runtime?

User16826994223 — Tue, 15 Jun 2021 16:06:23 GMT

There are two cases to consider: external writes and external reads.

External writes: Delta Lake maintains additional metadata in the form of a transaction log to enable ACID transactions and snapshot isolation for readers. In order to ensure the transaction log is updated correctly and the proper validations are performed, writes must go through Databricks Runtime.
External reads: Delta tables store data encoded in an open format (Parquet), allowing other tools that understand this format to read the data. For information on how to read Delta tables, see Integrations.

Re: Can I access Delta tables outside of Databricks Runtime?

sean_owen — Thu, 17 Jun 2021 18:11:45 GMT

Yes. The Delta client is open source, and lets you read/write Delta tables if you add it to your external application. See https://docs.delta.io/latest/index.html