Hello everyone!

I was wondering if there is any way to get the subdirectories in which the file resides while loading while loading using Autoloader with DLT. For example:

def customer():

 return (

  spark.readStream.format('cloudfiles')

    .option('cloudFiles.format', 'json')

.load(f'/Users/customer/dynamic_dlt/raw/customer/customer_*.json')

.withColumn('input_file', input_file_name())

But instead of input_file_name() something like input_file_path()