topic Re: Delta Table is not available in the Databricks SQL in Data Engineering

Delta Table is not available in the Databricks SQL

dimsh — Tue, 04 Jan 2022 15:30:57 GMT

Hi, there!

I'm trying to read a data (simple SELECT * FROM schema.tabl_a) from the "Queries" Tab inside the Databricks SQL platform, but always getting "org.apache.spark.sql.AnalysisException: dbfs:/.../.. doesn't exist" DescribeRelation true, [col_name#121543, data_type#121544, comment#12154 error.

What I've done:

-- Mount ADLS folder to DBFS one from the Databrikcs Engineering module

-- Created external table via simple DDL statement:

%sql
CREATE TABLE IF NOT EXISTS schema.table_a
USING DELTA 
LOCATION '/mnt/some_path/delta';

--Then I go to the Databrikcs SQL extension and try to get the data from the same table.

-- I've tried to get the data from the Databricks Engineering tool and it works well, instead of Databricks SQL one.

Any suggestions about that?

Re: Delta Table is not available in the Databricks SQL

Hubert-Dudek — Tue, 04 Jan 2022 15:34:28 GMT

this dbfs:/.../.. doesn't exist" is which path? (delta location)? when you ls that path are there delta files?

Re: Delta Table is not available in the Databricks SQL

dimsh — Tue, 04 Jan 2022 15:55:58 GMT

Yes. It's a Delta table for sure.

Update: I've created a new endpoint and now it works well.

It seems like the restart of the existing SQL endpoint will also fix this issue.

Re: Delta Table is not available in the Databricks SQL

Anonymous — Tue, 04 Jan 2022 20:42:14 GMT

Because it's a delta table, you don't need to provide the schema.