Enable Unity Catalog and pre-requisite for Delta Sharing

[RantoB]

Hi,

I would like to use Delta Sharing but I have not understood how to configure the Delta Sharing Server.

Is that fully managed by Databricks ? If so I tried to share a table :

%sql
create share first_share

and I got the following error message with the runtime 9.1 LTS (includes Apache Spark 3.1.2, Scala 2.12) :

Error in SQL statement: DatabricksServiceHttpClientException: FEATURE_DISABLED: Unity Catalog is not enabled for this Databricks Account

and this one with the runtime 10.1 (includes Apache Spark 3.2.0, Scala 2.12) :

Error in SQL statement: AnalysisException: Unity catalog is not enabled on this cluster.

So, what are the pre-requisits to use Delta Sharing and how is can we enable Unity Catalog ?

[Hubert-Dudek]

On databricks page there is still SIGN UP FOR WAIT LIST

https://databricks.com/product/delta-sharing

I see also that server is still on development version (most recent 0.2)

https://github.com/delta-io/delta-sharing/releases

[-werners-]

Can confirm. I think we are all very curious about this.

[Hubert-Dudek]

On 9th December there will be update about product roadmap so probably we will know more https://databricks.com/p/webinar/productroadmapwebinar

[jose_gonzalez · Accepted solution]

Hi @Bertrand BURCKER​ ,

This feature is not available yet. If you would like to test it or explore it, then you will need to sign up to get more details once the feature is available. In addition, you could reach out to your account team (in case you have one) and ask directly to your CSE if this feature can be enable on your workspace.

[study_community]

Any Idea when it will be available for the public preview?

[Hubert-Dudek]

I see that versioning is still far away to 1.0. 0.4 was released today:

https://github.com/delta-io/delta-sharing

If you want to experiment you can install beta by yourself (but for sure it can work not stable and there will be no any UI)

[study_community]

Can we install it in databricks cluster? If yes could you please help me with the steps?

[Hubert-Dudek]

I haven't try maybe better as wait for it to be at least in private preview so you will be able to ask for access.