Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-24-2025 10:32 PM
To use Apache Iceberg via the Hadoop Catalog on Databricks, it was found to work with the following settings:
- Use a Databricks Runtime version of 12.2LTS or earlier.
- Set the access mode to "No isolation shared" (the mode where Unity Catalog cannot be used).
- Use a library compatible with Java 8 (i.e., an Iceberg library earlier than version 1.6.1).
- Apply the necessary Iceberg-related settings in the Spark configuration.
There is also an article (in Japanese) that explains how to resolve the errors:
- https://qiita.com/manabian/items/4c2c78c7db77f704e5ab