Do we really need Autoloader for batch processing.?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-24-2023 07:41 AM
Hi All,
It seem AutoLoader is good option for even driven data ingestion but if my job runs only once , do I still need autoloader ? I dont want to spend money to spin a cluster whole day.
I know we have RunOnce option available while running a job but apart from this is there any profit of using Autoloader in batch processing ?
Thanks,
Labels:
- Labels:
-
Autoloader
-
Batch Processing
-
Data Ingestion