cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Create external table using iceberg not working

new_user_ptl
Visitor

I'm trying to create a external iceberg table on top of files I have in s3 created using a spark job that runs outside of databricks using Hadoop catalog.

Create External table table_name using iceberg location 's3://myicebergbucket/iceberg_table_path'

But I'm getting this error

Managed iceberg tables do not support replace on external tables.

Is there a solution to this?

1 REPLY 1

juan_maedo
New Contributor III

Hey! So you're thinking about creating an Iceberg table as an external table on Unity Catalog? Yeah, there are definitely some limitations to keep in mindโ€”especially around writes and creation, since it's still in preview.

he main thing is: you can read Iceberg tables from other engines through UC external tables, but you can't write to them that way. Write access is only available for managed tables right now. Check out the https://docs.databricks.com/aws/en/external-access/iceberg#requirements

So you can read Iceberg table from other engines, but can't write vรญa UC using external tables, only available for managed tables.

That said, if you're already creating Iceberg tables in another engine, you can still access them through UC using LHF (Lakehouse Federation). That way you can read them without hitting those external table write limitations. https://docs.databricks.com/aws/en/iceberg/#read-iceberg-tables-managed-by-other-catalogs

Hope that helps!