Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-11-2025 10:10 AM
I forgot to mention an important thing. The S3 is currently as a catalog, so my current script has as route:
file_path = f"/Volumes/bronze_external_apis/sap/data_sap/holding/{company_name_lower}/jdt1/"
And after "jdt1" it comes the same logic of year/month/day/file.json.
What I need is to read only the last 90 days of that, because data could be added to those files, so my script after getting the data of those 90 days, makes a merge so it only appends new data. Or in the case of another case I have, gets the most recent one using an "update_date" field