topic Re: Enable Unity Catalog and pre-requisite for Delta Sharing in Data Governance

Enable Unity Catalog and pre-requisite for Delta Sharing

RantoB — Fri, 26 Nov 2021 17:39:20 GMT

Hi,

I would like to use Delta Sharing but I have not understood how to configure the Delta Sharing Server.

Is that fully managed by Databricks ? If so I tried to share a table :

%sql
create share first_share

and I got the following error message with the runtime 9.1 LTS (includes Apache Spark 3.1.2, Scala 2.12) :

Error in SQL statement: DatabricksServiceHttpClientException: FEATURE_DISABLED: Unity Catalog is not enabled for this Databricks Account

and this one with the runtime 10.1 (includes Apache Spark 3.2.0, Scala 2.12) :

Error in SQL statement: AnalysisException: Unity catalog is not enabled on this cluster.

So, what are the pre-requisits to use Delta Sharing and how is can we enable Unity Catalog ?

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

Hubert-Dudek — Fri, 26 Nov 2021 17:49:11 GMT

On databricks page there is still SIGN UP FOR WAIT LIST

https://databricks.com/product/delta-sharing

I see also that server is still on development version (most recent 0.2)

https://github.com/delta-io/delta-sharing/releases

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

-werners- — Mon, 29 Nov 2021 07:42:00 GMT

Can confirm. I think we are all very curious about this.

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

Hubert-Dudek — Mon, 29 Nov 2021 11:40:13 GMT

On 9th December there will be update about product roadmap so probably we will know more https://databricks.com/p/webinar/productroadmapwebinar

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

jose_gonzalez — Mon, 29 Nov 2021 18:58:23 GMT

Hi @Bertrand BURCKER ,

This feature is not available yet. If you would like to test it or explore it, then you will need to sign up to get more details once the feature is available. In addition, you could reach out to your account team (in case you have one) and ask directly to your CSE if this feature can be enable on your workspace.

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

study_community — Fri, 14 Jan 2022 04:33:52 GMT

Any Idea when it will be available for the public preview?

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

Hubert-Dudek — Fri, 14 Jan 2022 13:22:52 GMT

I see that versioning is still far away to 1.0. 0.4 was released today:

https://github.com/delta-io/delta-sharing

If you want to experiment you can install beta by yourself (but for sure it can work not stable and there will be no any UI)

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

study_community — Mon, 17 Jan 2022 10:41:47 GMT

Can we install it in databricks cluster? If yes could you please help me with the steps?

Re: Enable Unity Catalog and pre-requisite for Delta Sharing

Hubert-Dudek — Mon, 17 Jan 2022 11:20:30 GMT

I haven't try maybe better as wait for it to be at least in private preview so you will be able to ask for access.