Databricks

Databricks recently also updated the Security Addendum that is incorporated into our typical contracts. It's now written in plain language, and provides detailed content around security controls and practices. https://databricks.com/security-addendum...

Yes I believe that is in pipeline

You could use delta sharing without unity catalog. It is an open protocol for secure real-time exchange of large datasets. There repo at https://github.com/delta-io/delta-sharing also has a reference implementation of the delta sharing server which c...

Yes, you'll have an option to use the existing metastore, an external metastore, and Unity at the same time.

Unity Catalog is planned to support multi-cloud architectures from one catalog instance.

Yes, UC will have a suite of REST APIs allowing external tools to query it.UC Data Dictionary tables will be available via SQL as well. It is possible to query the UC Data Dictionary via JDBC/ODBC connection, but this requires a running endpoint or c...

Yes, this is the vision. The first phase of Unity Catalog is focused on the operational aspects of accessing data i.e. data access controls (Table ACL model, data sharing etc) and auditing. Lineage will be introduced in future phases.

Initially UC will support Delta and Parquet formats only. We plan to support more formats with time