topic reading XML file of mutiple row Tags in Data Engineering

reading XML file of mutiple row Tags

shubham7 — Mon, 30 Jun 2025 13:42:36 GMT

I have multiple xml files in a folder. i am reading into dataframe in a databricks cell. It has one rootTag and multiple rowTags. can i read into single spark dataframe (pyspark) for all the rowTags. Any reference for this or approach would greatly appreciated.

thanks

Re: reading XML file of mutiple row Tags

szymon_dybczak — Mon, 30 Jun 2025 14:17:09 GMT

Hi @shubham7 ,

I don't know if I understood your requirements correctly, but maybe something like this could work for you.
I have 2 xml files in my volume, each with following structure:

To load those file into single dataframe I've used following code:

df = ( spark.read.format("xml") .option("rootTag", "root") .option("rowTag", "row") .load("/Volumes/workspace/default/my_volume/*.xml") )

Re: reading XML file of mutiple row Tags

shubham7 — Mon, 30 Jun 2025 16:51:35 GMT

you are correct, but i have N number of different rowTags. how to read in a dataframe.