Tie Parquet files in Azure ADLS to Databricks table
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-15-2023 01:03 PM
Hello All,
I have databricks delta table with files residing in Azure Data Lake. I understand, when I load create table and load data from databricks, it creates respective folder and files for table in ADLS.
I am wondering if there is reverse way to do it, by copying the parquet files directly for underlying table in ADLS and query it from delta table in databricks.
When I copy files, it doesn't get recognized by databricks when query the table, which is obvious.
Any thoughts or workarounds are highly appreciated.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-27-2023 12:37 PM
Thanks @Retired_mod this is helpful