How to Create Iceberg Tables in Databricks Using Parquet Files from S3?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-03-2025 10:51 PM
Hi Databricks Community,
I’m trying to create Apache Iceberg tables in Databricks using Parquet files stored in an S3 bucket. I found a guide from Dremio, but I’m unable to create Iceberg tables using that method.
Here’s what I need:
- Read Parquet files from S3.
- Write them as Iceberg tables in Databricks.
Questions:
- What cluster configurations (Spark configs, dependencies, etc.) are needed for Iceberg support?
- Is there a native way to use Iceberg in Databricks, or do I need to upload JAR files?
Any step-by-step guidance or sample code would be helpful!
Thanks in advance!