topic Re: How to read Databricks UniForm format tables present in ADLS in Get Started Discussions

How to read Databricks UniForm format tables present in ADLS

Demudu — Wed, 25 Dec 2024 13:06:26 GMT

We have Databricks UniForm format (iceberg) tables are present in azure data lake storage (ADLS) which has already integrated with Databricks unity catalog. How to read Uniform format tables using Databricks as a query engine?

Re: How to read Databricks UniForm format tables present in ADLS

Alberto_Umana — Wed, 25 Dec 2024 13:17:33 GMT

Hi @Demudu,

You can refer to: https://learn.microsoft.com/en-us/azure/databricks/delta/uniform

Re: How to read Databricks UniForm format tables present in ADLS

fmadeiro — Thu, 26 Dec 2024 02:45:24 GMT

Query Using Unity Catalog:
- SQL:
  sql
  Copiar código
  SELECT * FROM catalog_name.schema_name.table_name;
- PySpark:
  python
  Copiar código
  df = spark.sql("SELECT * FROM catalog_name.schema_name.table_name") df.display()
Direct Access by Path: If not using Unity Catalog:
python
Copiar código
iceberg_table_path = "abfss://<container>@<storage_account>.dfs.core.windows.net/<path_to_table>" df = spark.read.format("iceberg").load(iceberg_table_path) df.display()
Optimize Performance:
- Query by partitions:
  sql
  Copiar código
  SELECT * FROM catalog_name.schema_name.table_name WHERE partition_column = 'value';
- Cache data:
  python
  Copiar código
  df.cache()
Optional Features:
- Time Travel:
  sql
  Copiar código
  SELECT * FROM catalog_name.schema_name.table_name VERSION AS OF 123456;

Re: How to read Databricks UniForm format tables present in ADLS

Demudu — Tue, 31 Dec 2024 15:35:09 GMT

Thank you very much!