Re: I've data in s3/Iceberg tables. How to read it...

Nalapriya · ‎02-11-2025

I tried this method:

df = spark.read.format("iceberg").load("s3-bucket-path")

But got an error: Multiple sources found for iceberg (com.databricks.sql.transaction.tahoe.uniform.sources.IcebergBrowseOnlyDataSource, org.apache.iceberg.spark.source.IcebergSource), please specify the fully qualified class name.

Then updated the code like this:

df = spark.read.format("org.apache.iceberg.spark.source.IcebergSource").load("s3-bucket-path")

Error: The table or view `default_iceberg`.`s3://my-bucket-path`.`` cannot be found. Verify the spelling and correctness of the schema and catalog. If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and

How to resolve this issue and read data using databricks SparkSQL?

Note: I've installed the spark runtime jar library, configured the cluster with spark requirements and catalog setup as well.

Alberto_Umana · ‎02-11-2025

Hi @Nalapriya,

What is the DBR version? and library jar version?

Could you try with below code test?

# Set the catalog and schema
spark.sql("USE CATALOG my_catalog")
spark.sql("USE SCHEMA my_schema")

# Read the Iceberg table
df = spark.read.format("org.apache.iceberg.spark.source.IcebergSource").load("s3://my-bucket-path")

Ohad-upriver · ‎03-09-2025

Hi,

When using Unity catalog, I'm unable to create a new catalog that I can use for querying an Iceberg table.

How can I resolve this issue?

The Iceberg table is stored in S3.

Nalapriya · ‎02-20-2025

Hi @Alberto_Umana,

I tried the steps you've provided but still I'm not able to read data which is in iceberg format. It would be useful if I get any other suggestions.

I've data in s3/Iceberg tables. How to read it using databricks SparkSQL ?