topic How to add a current date as suffix while using copy? in Data Engineering

How to add a current date as suffix while using copy?

databicky — Sat, 07 Jan 2023 15:04:08 GMT

how to add a current date after filename suffix while copy from the dbutils like report20221223.xlsx

dbutils.fs.cp('dbfs://temp/balancing/report.xlsx','abfss://con@adls/provsn/result/report.xlsx',True)

i need to add the current date in the file like report20220123.xlsx while copying from source to target location

how can we add a current date after the suffix in filename while using dbutils.

Re: How to add a current date as suffix while using copy?

Aviral-Bhardwaj — Sat, 07 Jan 2023 15:40:37 GMT

This will give you a little bit more idea

import time
 
timestr = time.strftime("%Y%m%d-%H%M%S")
 
print(timestr)

Now you can use formator and implement this solution

Thanks

Aviral

Re: How to add a current date as suffix while using copy?

Chaitanya_Raju — Sat, 07 Jan 2023 17:03:44 GMT

@Mohammed sadamusean hope the below code might help you,

from datetime import datetime
date_value = datetime.now().strftime("%Y%m%d")
 
src = 'dbfs:/FileStore/Test/File.csv'
trgt = f'dbfs:/FileStore/Test/File_{date_value}.csv' 
 
dbutils.fs.cp(src,trgt)

Happy Learning!!

Re: How to add a current date as suffix while using copy?

databicky — Tue, 10 Jan 2023 12:34:57 GMT

how can we get the data without hyphen

Re: How to add a current date as suffix while using copy?

Chaitanya_Raju — Tue, 10 Jan 2023 13:44:21 GMT

You can try like below

from datetime import datetime
datevalue = datetime.now().strftime("%Y%m%d")
 
src = 'dbfs:/FileStore/Test/File.csv'
trgt = f'dbfs:/FileStore/Test/File{datevalue}.csv' 
 
dbutils.fs.cp(src,trgt)

Happy Learning!!