01-04-2022 07:30 AM
Hi, there!
I'm trying to read a data (simple SELECT * FROM schema.tabl_a) from the "Queries" Tab inside the Databricks SQL platform, but always getting "org.apache.spark.sql.AnalysisException: dbfs:/.../.. doesn't exist" DescribeRelation true, [col_name#121543, data_type#121544, comment#12154 error.
What I've done:
-- Mount ADLS folder to DBFS one from the Databrikcs Engineering module
-- Created external table via simple DDL statement:
%sql
CREATE TABLE IF NOT EXISTS schema.table_a
USING DELTA
LOCATION '/mnt/some_path/delta';
--Then I go to the Databrikcs SQL extension and try to get the data from the same table.
-- I've tried to get the data from the Databricks Engineering tool and it works well, instead of Databricks SQL one.
Any suggestions about that?
01-04-2022 07:55 AM
Yes. It's a Delta table for sure.
Update: I've created a new endpoint and now it works well.
It seems like the restart of the existing SQL endpoint will also fix this issue.
01-04-2022 07:34 AM
this dbfs:/.../.. doesn't exist" is which path? (delta location)? when you ls that path are there delta files?
01-04-2022 07:55 AM
Yes. It's a Delta table for sure.
Update: I've created a new endpoint and now it works well.
It seems like the restart of the existing SQL endpoint will also fix this issue.
01-04-2022 12:42 PM
Because it's a delta table, you don't need to provide the schema.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group