Databricks Autoloader streamReader does not include the partition column as part of output.

tech2cloud
New Contributor II

I have folder structure at source such as

/transaction/date_=2023-01-20/hr_=02/tras01.csv

/transaction/date_=2023-01-20/hr_=03/tras02.csv

Where 'date_' and 'hr_' are my partitions and present in the dataset as well. But the streamReader does not read these columns as output. Whereas the same file if I read as CSV the column shows. Am I missing something here?

imagePlease help!