cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to read Databricks UniForm format tables present in ADLS

Demudu
New Contributor II

We have Databricks UniForm format (iceberg) tables are present in azure data lake storage (ADLS) which has already integrated with Databricks unity catalog. How to read Uniform format tables using Databricks as a query engine?

1 ACCEPTED SOLUTION

Accepted Solutions

fmadeiro
Contributor II
  1. Query Using Unity Catalog:

    • SQL:
      sql
      Copiar código
      SELECT * FROM catalog_name.schema_name.table_name;
    • PySpark:
      python
      Copiar código
      df = spark.sql("SELECT * FROM catalog_name.schema_name.table_name") df.display()
  2. Direct Access by Path: If not using Unity Catalog:

    python
    Copiar código
    iceberg_table_path = "abfss://<container>@<storage_account>.dfs.core.windows.net/<path_to_table>" df = spark.read.format("iceberg").load(iceberg_table_path) df.display()
  3. Optimize Performance:

    • Query by partitions:
      sql
      Copiar código
      SELECT * FROM catalog_name.schema_name.table_name WHERE partition_column = 'value';
    • Cache data:
      python
      Copiar código
      df.cache()
  4. Optional Features:

    • Time Travel:
      sql
      Copiar código
      SELECT * FROM catalog_name.schema_name.table_name VERSION AS OF 123456;

View solution in original post

3 REPLIES 3

Alberto_Umana
Databricks Employee
Databricks Employee

fmadeiro
Contributor II
  1. Query Using Unity Catalog:

    • SQL:
      sql
      Copiar código
      SELECT * FROM catalog_name.schema_name.table_name;
    • PySpark:
      python
      Copiar código
      df = spark.sql("SELECT * FROM catalog_name.schema_name.table_name") df.display()
  2. Direct Access by Path: If not using Unity Catalog:

    python
    Copiar código
    iceberg_table_path = "abfss://<container>@<storage_account>.dfs.core.windows.net/<path_to_table>" df = spark.read.format("iceberg").load(iceberg_table_path) df.display()
  3. Optimize Performance:

    • Query by partitions:
      sql
      Copiar código
      SELECT * FROM catalog_name.schema_name.table_name WHERE partition_column = 'value';
    • Cache data:
      python
      Copiar código
      df.cache()
  4. Optional Features:

    • Time Travel:
      sql
      Copiar código
      SELECT * FROM catalog_name.schema_name.table_name VERSION AS OF 123456;

Demudu
New Contributor II

Thank you very much!