Can you use autoloader with a fixed width file?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-17-2023 08:57 AM
I have a collection fixed width files that I would like to ingest monthly with autoloader but I can't seem to find an example.
I can read the files into Dataframes using a python function to map the index and length of each field with no issues but I am not sure if these DF's can then be used directly within a readstream() call.
Would it be better to convert to a parquet file before reading these in?
Labels:
- Labels:
-
Autoloader
-
Python Function