extract latest files from ADLS Gen2 mount point in databricks using pyspark

[pankaj92]

Hi Team,

I am trying to get the latest files from an ADLS mount point directory. I am not sure how to extract latest files ,Last modified Date using Pyspark from ADLS Gen2 storage account. Please let me know asap. Thanks!

I am looking forward your response.

[pankaj92]

Hi Team,

can you please respond here. Thanks!

[pankaj92]

Hi Team,

Can someone please respond here. If someone has already implemented. Thanks!

[Sha_1890]

I am looking for the same too. Appreciate the speedy response.

[Sha_1890]

Hi @pankaj92​ ,

I wrote a Python code to pick a latest file from mnt location ,

import os

path = "/dbfs/mnt/xxxx"

filelist=[]

for file_item in os.listdir(path):

  filelist.append(file_item)

file=len(filelist)

print(filelist[file-1])

Thanks