cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to read Databricks UniForm format tables present in ADLS

Demudu
New Contributor II

We have Databricks UniForm format (iceberg) tables are present in azure data lake storage (ADLS) which has already integrated with Databricks unity catalog. How to read Uniform format tables using Databricks as a query engine?

1 ACCEPTED SOLUTION

Accepted Solutions

fmadeiro
Contributor II
  1. Query Using Unity Catalog:

    • SQL:
      sql
      Copiar cรณdigo
      SELECT * FROM catalog_name.schema_name.table_name;
    • PySpark:
      python
      Copiar cรณdigo
      df = spark.sql("SELECT * FROM catalog_name.schema_name.table_name") df.display()
  2. Direct Access by Path: If not using Unity Catalog:

    python
    Copiar cรณdigo
    iceberg_table_path = "abfss://<container>@<storage_account>.dfs.core.windows.net/<path_to_table>" df = spark.read.format("iceberg").load(iceberg_table_path) df.display()
  3. Optimize Performance:

    • Query by partitions:
      sql
      Copiar cรณdigo
      SELECT * FROM catalog_name.schema_name.table_name WHERE partition_column = 'value';
    • Cache data:
      python
      Copiar cรณdigo
      df.cache()
  4. Optional Features:

    • Time Travel:
      sql
      Copiar cรณdigo
      SELECT * FROM catalog_name.schema_name.table_name VERSION AS OF 123456;

View solution in original post

3 REPLIES 3

Alberto_Umana
Databricks Employee
Databricks Employee

fmadeiro
Contributor II
  1. Query Using Unity Catalog:

    • SQL:
      sql
      Copiar cรณdigo
      SELECT * FROM catalog_name.schema_name.table_name;
    • PySpark:
      python
      Copiar cรณdigo
      df = spark.sql("SELECT * FROM catalog_name.schema_name.table_name") df.display()
  2. Direct Access by Path: If not using Unity Catalog:

    python
    Copiar cรณdigo
    iceberg_table_path = "abfss://<container>@<storage_account>.dfs.core.windows.net/<path_to_table>" df = spark.read.format("iceberg").load(iceberg_table_path) df.display()
  3. Optimize Performance:

    • Query by partitions:
      sql
      Copiar cรณdigo
      SELECT * FROM catalog_name.schema_name.table_name WHERE partition_column = 'value';
    • Cache data:
      python
      Copiar cรณdigo
      df.cache()
  4. Optional Features:

    • Time Travel:
      sql
      Copiar cรณdigo
      SELECT * FROM catalog_name.schema_name.table_name VERSION AS OF 123456;

Demudu
New Contributor II

Thank you very much!

 

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now