topic Error when trying to Create a STREAMING TABLE using Databricks SQL in Get Started Discussions

Error when trying to Create a STREAMING TABLE using Databricks SQL

giuseppe_esq — Sun, 17 Aug 2025 22:13:28 GMT

Hi all,

I am currently using the Databricks Free Edition, and trying to create a streaming table, using the following SQL script:

%sql

CREATE OR REFRESH STREAMING TABLE sql_csv_autoloader

SCHEDULE EVERY 1 WEEK

SELECT *

FROM STREAM read_files(

'/Volumes/workspace/sql_using_auto_loader/autoloader_source',

format => 'CSV',

sep => ',',

header => true

);

However, when I execute the script, I get the following error message:

UnsupportedOperationException: Public DBFS root is disabled. Access is denied on path: /local_disk0/tmp/autoloader_schemas_DLTAnalysisID-5771

Does anyone have any workarounds for this please?

Thanks

Giuseppe

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

WayneRevenite — Mon, 18 Aug 2025 03:03:43 GMT

Hi Giuseppe, I've tried to recreate this and am unable to. Was your volume created as managed or external?

My successful steps:

Created a new Volume in workspace.default called "example_volume"
Created a new folder in that volume called "example_folder" and uploaded a CSV to the folder
Ran the following in a query window, using the Serverless Starter Warehouse:

CREATE OR REFRESH STREAMING TABLE sql_csv_autoloader SCHEDULE EVERY 1 WEEK AS SELECT * FROM STREAM read_files( '/Volumes/workspace/default/example_volume/example_folder/', format => 'CSV', sep => ',', header => true );

That successed with sql_csv_autoloaded table created under workspace.default ("The operation was successfully executed.") with the data loaded.

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

giuseppe_esq — Mon, 18 Aug 2025 12:14:13 GMT

Hi,

Thanks for your response. To confirm, I created my volumes as Managed.

If I need to used External volumes to execute this script, will I need to create an external storage location (for S3 storage) in Amazon? If so, is this free?

Kinds regards

Giuseppe

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

giuseppe_esq — Mon, 18 Aug 2025 15:10:55 GMT

Sorry, did you also manage to run this script using the Databricks Free Edition?

Thanks again

Giuseppe

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

WayneRevenite — Tue, 19 Aug 2025 00:55:59 GMT

Yes - I was able to do it no problem on Free, with the exact steps above, using the default supplied compute.

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

giuseppe_esq — Tue, 19 Aug 2025 12:32:13 GMT

Hi again,

Thanks for your response.

I was trying to execute the %SQL script (hence the error), in a workspace notebook, however, you were able to execute the script in SQL Editor, that worked.

Kind regards

Giuseppe

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

AdrianK — Thu, 04 Sep 2025 14:04:56 GMT

I have exactly same behavior: it doesn't work in notebook (no error message, the success message instead), it does work in sql editor.

Apparently streaming tables work only with serverless warehouses.

Re: Error when trying to Create a STREAMING TABLE using Databricks SQL

giuseppe_esq — Sat, 06 Sep 2025 13:34:36 GMT

From my understanding you can create and populate streaming tables in a Databricks Workspace Notebook, using SQL or Python. However, it will not allow this in the Databricks Free Edition.