topic Re: read_files to create streaming table using Databricks SQL in Data Engineering

read_files to create streaming table using Databricks SQL

DB3 — Tue, 22 Oct 2024 06:30:40 GMT

I follow the same syntax from documentation for create streaming table and it was last week and not working now

Ex query:CREATE OR REFRESH STREAMING TABLE
`ax`.`db`.`healthex`
AS SELECT * FROM STREAM
read_files(
"/Volumes/ax/db/dlt-test/", -- The file path
format=>'csv',header=>true,delimiter=>'|')

Whats wrong here

Re: read_files to create streaming table using Databricks SQL

mary598chess — Tue, 22 Oct 2024 06:45:39 GMT

@DB3 wrote:
I follow the same syntax from documentation for create streaming table and it was last week and not working now
Ex query:CREATE OR REFRESH STREAMING TABLE
`ax`.`db`.`healthex`
AS SELECT * FROM STREAM
read_files(
"/Volumes/ax/db/dlt-test/", -- The file path
format=>'csv',header=>true,delimiter=>'|')

Whats wrong here

Hello,
It looks like there's a syntax issue in your CREATE OR REFRESH STREAMING TABLE statement. The correct syntax should be:
CREATE OR REFRESH STREAMING TABLE `ax`.`db`.`healthex`
AS SELECT * FROM read_files("/Volumes/ax/db/dlt-test/", -- The file path
format=>'csv',header=>true,delimiter=>'|')

Make sure there's no space between CREATE OR REFRESH and STREAMING TABLE. Does this help?

Best Regards,
Mary Chess

Re: read_files to create streaming table using Databricks SQL

DB3 — Tue, 22 Oct 2024 08:53:09 GMT

I followed the syntax in this documentation link https://docs.databricks.com/en/tables/streaming.html

I get this error if the STREAM keyword is excluded

Please add the STREAM keyword to your FROM clause to turn this relation into a streaming query. SQLSTATE: 42000