How to make streaming files?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-16-2025 02:37 PM
Thanks for reviewing my threads.
I am trying to test streaming table /files in databricks FREE edition.
-- Create test streaming table
CREATE OR REFRESH STREAMING TABLE user.demo.test_bronze_st AS
SELECT * FROM STREAM read_files('/Volumes/xxx_ws/demo/raw_files/test');
I created test file via note upload (data upload in catalog). It created the file, but not treating this as stream file.
The above create table failing
but
CREATE OR REFRESH TABLE user.demo.test_bronze_st AS
SELECT * FROM read_files('/Volumes/xxx_ws/demo/raw_files/test');
is working. The output window shows 0 rows created, but when I checked the catalog, it shows a different story. I see the data there in user.demo.test_bronze_st table.
Is this a right behavior?
How do I make a streaming file with input data files sitting on my local window folder?
Thanks .
- Labels:
-
Spark