Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-22-2024 10:28 AM
I have files with file names like "HT00114_DXLS_PROD_20240102_00001.txt" where the 2024xxxx is the date the file was created. I want to load the file from my hard drive to a table on my sandbox-type space on our DataBricks data lake as a SQL DB table. I have a "Data Ingestion" option available, but no choices within that (that I can see) to add the file name as a column (field value). I'm wondering how I can accomplish adding other details. In an SSIS package, I'd be able to specify other formulas and values for additional fields to accompany my dataset on the upload. I'm hoping I can accomplish the same thing here.
“Everybody is a genius. But if you judge a fish by its ability to climb a tree, it will live its whole life believing that it is stupid.” — Albert Einstein