Is it possible to use Iceberg instead of DeltaLake?

[WojtekJ]

Hi.

Do you know if it is possible to use Iceberg table format instead DeltaLake?

Ideally, I would like to see the tables in Databricks stored as Iceberg and use them as usual in the notebooks.

I read that there is also an option to link external metastore to Databricks that could do the trick but prefer to ask first. 🙂

Thanks for any help.

[Kaniz]

Hi @Wojtek J​ , Here's a thorough comparison of Delta Lake, Iceberg and Hudi.

This talk shares the research that we did for the comparison of the key features and designs these table format holds, the maturity of features, such as APIs expose to end user, how to work with compute engines and finally, a comprehensive benchmark about transaction, upsert, and mass partitions shared as references to audiences.

[jose_gonzalez]

Hi @Wojtek J​ ,

You can convert your Iceberg tables to Delta tables very easily. For more details an example please check the docs https://docs.microsoft.com/en-us/azure/databricks/delta/delta-utility#--convert-an-iceberg-table-to-...