How to use Iceberg SQL Extensions in a notebook?

samanthacr
New Contributor II

‎03-05-2025 01:34 PM

I'm trying to use Iceberg's SQL extensions in my Databricks Notebook, but I get a syntax error. Specifically, I'm trying to run 'ALTER TABLE my_iceberg_table WRITE LOCALLY ORDERED BY timestamp;'. This command is listed as part of Iceberg's SQL extensions. How do I configure my Databricks notebook so I can run these commands?

My current set up is:

  • Databricks 13.3 cluster
  • Iceberg jar 'org.apache.iceberg:iceberg-spark-runtime-3.4_2.12:1.6.0'
    installed as a library
  • Spark conf contains
    • spark.sql.extensions org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
    • spark.sql.catalog.local org.apache.iceberg.spark.SparkCatalog
    • spark.sql.catalog.local.type hadoop
    • spark.sql.catalog.local.warehouse my_s3_path
0 Kudos