I have created a job that contains a notebook that reads a file from Azure Storage.
The file-name contains the date of when the file was transferred to the storage. A new file arrives every Monday, and the read-job is scheduled to run every Monday.
In my notebook, I want to use the schedule-date of the job to read the file from Azure Storage with the same date in the filename, something like this:
file_location = ("file_name+"_"+job_date+_+country_id+.csv")
I have tried to pass a date as a parameter and I am able to access that from the notebook, but if the job fails and I want to re-run the job the next day, I'd have to manually enter yesterdays date as the input parameter. I want to avoid this and just use the real scheduling date for the job.
How do I access the job scheduling date from within the notebook?
Thanks in advance
Karolin