- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2023 03:34 AM
Use Python commands to display creation date and modification date
The ls command is an easy way to display basic information. If you want more detailed timestamps, you should use Python API calls.
For example, this sample code uses datetime functions to display the creation date and modified date of all listed files and directories in the /dbfs/ folder. Replace /dbfs/ with the full path to the files you want to display.
%python
%python
import os
from datetime import datetime
path = '/dbfs/'
fdpaths = [path+"/"+fd for fd in os.listdir(path)]
print(" file_path " + " create_date " + " modified_date ")
for fdpath in fdpaths:
statinfo = os.stat(fdpath)
create_date = datetime.fromtimestamp(statinfo.st_ctime)
modified_date = datetime.fromtimestamp(statinfo.st_mtime)
print(fdpath, create_date, modified_date)Output:
file_path create_date modified_date
/dbfs//FileStore 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
/dbfs//databricks 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
/dbfs//databricks-datasets 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
/dbfs//databricks-results 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
/dbfs//dbfs 2020-06-09 21:11:24 2020-06-09 21:11:24
/dbfs//local_disk0 2020-05-20 22:32:05 2020-05-20 22:32:05
/dbfs//ml 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
/dbfs//tmp 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
/dbfs//user 2021-07-01 12:49:45.264730 2021-07-01 12:49:45.264730
Reference:
https://kb.databricks.com/en_US/python/display-file-timestamp-details