create streaming table using variable file path
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-09-2025 10:32 AM
is it possible to use a variable for the file path based on dates?
files are stores in folders in this format yyyy/mm
CREATE OR REFRESH STREAMING TABLE test
AS SELECT * FROM STREAM read_files(
"/Volumes/.....",
format => "parquet"
);
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-09-2025 11:19 AM - edited 06-09-2025 11:20 AM
@dataminion01 Yes, it is possible to use a variable or dynamic file path based on dates in some data processing frameworks , but not directly in static SQL DDL statements like CREATE OR REFRESH STREAMING TABLE unless the environment you're working enabled parameter substitution or dynamic SQL execution.
Rishabh Pandey