cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Delta Table is not available in the Databricks SQL

dimsh
Contributor

Hi, there!

I'm trying to read a data (simple SELECT * FROM schema.tabl_a) from the "Queries" Tab inside the Databricks SQL platform, but always getting "org.apache.spark.sql.AnalysisException: dbfs:/.../.. doesn't exist" DescribeRelation true, [col_name#121543, data_type#121544, comment#12154 error.

What I've done:

-- Mount ADLS folder to DBFS one from the Databrikcs Engineering module

-- Created external table via simple DDL statement:

%sql
CREATE TABLE IF NOT EXISTS schema.table_a
USING DELTA 
LOCATION '/mnt/some_path/delta';

--Then I go to the Databrikcs SQL extension and try to get the data from the same table.

-- I've tried to get the data from the Databricks Engineering tool and it works well, instead of Databricks SQL one.

Any suggestions about that?

1 ACCEPTED SOLUTION

Accepted Solutions

dimsh
Contributor

Yes. It's a Delta table for sure.

Update: I've created a new endpoint and now it works well.

It seems like the restart of the existing SQL endpoint will also fix this issue.

View solution in original post

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

this dbfs:/.../.. doesn't exist" is which path? (delta location)? when you ls that path are there delta files?

dimsh
Contributor

Yes. It's a Delta table for sure.

Update: I've created a new endpoint and now it works well.

It seems like the restart of the existing SQL endpoint will also fix this issue.

Anonymous
Not applicable

Because it's a delta table, you don't need to provide the schema.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group