topic How do we pass the row tags dynamically while reading a XML file into a dataframe? in Data Engineering

How do we pass the row tags dynamically while reading a XML file into a dataframe?

Stita — Thu, 06 Oct 2022 11:34:37 GMT

I have a set of xml files where the row tags change dynamically. How can we achieve this scenario in databricks.

df1=spark.read.format('xml').option('rootTag','XRoot').option('rowTag','PL1PLLL').load("dbfs:/FileStore/tables/ins/")

We need to pass a value dynamically in place of PL1PLLL option('rowTag','PL1PLLL')

Hubert-Dudek — Fri, 14 Oct 2022 11:42:33 GMT

If it is dynamically for the whole file, you can just use variable

tag = 'PL1PLLL'
df1=spark.read.format('xml').option('rootTag','XRoot').option('rowTag' ,tag).load("dbfs:/FileStore/tables/ins/file.xml")