02-20-2024 01:21 PM
Hello,
I have a parquet file test.parquet in the volume volume_ext_test. Tried to create an external table as below, it failed and says it "is not a valid URI".
02-20-2024 02:03 PM
Hi @PaulineX
As per the documentation, you cannot use volume for storing table data. It's for loading, storing and accessing files.
You cannot use volumes as a location for tables. Volumes are intended for path-based data access only. Use tables for storing tabular data with Unity Catalog.
It's bit ironic here, as delta table data is stored in files as well.
Anyway, as per the documentation, answer to your question is no.
02-20-2024 02:30 PM
@AmanSehgal Thank you for the reply. This is exactly what I want to confirm!
Too bad, I hoped to avoid full path in notebooks.
02-20-2024 01:29 PM
sorry pasted the wrong statement. the external table statement is :
02-20-2024 02:03 PM
Hi @PaulineX
As per the documentation, you cannot use volume for storing table data. It's for loading, storing and accessing files.
You cannot use volumes as a location for tables. Volumes are intended for path-based data access only. Use tables for storing tabular data with Unity Catalog.
It's bit ironic here, as delta table data is stored in files as well.
Anyway, as per the documentation, answer to your question is no.
02-20-2024 02:30 PM
@AmanSehgal Thank you for the reply. This is exactly what I want to confirm!
Too bad, I hoped to avoid full path in notebooks.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group