by
Stita
• New Contributor II
- 3405 Views
- 1 replies
- 2 kudos
I have a set of xml files where the row tags change dynamically. How can we achieve this scenario in databricks.df1=spark.read.format('xml').option('rootTag','XRoot').option('rowTag','PL1PLLL').load("dbfs:/FileStore/tables/ins/")We need to pass a val...
- 3405 Views
- 1 replies
- 2 kudos
Latest Reply
If it is dynamically for the whole file, you can just use variabletag = 'PL1PLLL'
df1=spark.read.format('xml').option('rootTag','XRoot').option('rowTag' ,tag).load("dbfs:/FileStore/tables/ins/file.xml")
- 3936 Views
- 1 replies
- 2 kudos
e.g.dataframe is having firstname,lastname,middlename,id,salaryI need to convert dataframe in xml file but in nested format.output as nested xml<Name> <firatname> <middlename> <lastname> </Name><id></id><salary></salary>Anyone has ides ho...
- 3936 Views
- 1 replies
- 2 kudos
Latest Reply
databricks has a xml connector:https://docs.databricks.com/data/data-sources/xml.htmlBasically you just define a df with the correct structure and write it to xml.To create a nested df, here you can find some info.
by
wyzer
• Contributor II
- 5371 Views
- 8 replies
- 4 kudos
Hello,We have a large XML file (9 GB) that we can't read.We have this error : VM size limitBut how can we change the VM size limit ?We have tested many clusters, but no one can read this file.Thank you for your help.
- 5371 Views
- 8 replies
- 4 kudos
Latest Reply
Hi @Salah K.,Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
7 More Replies
- 7595 Views
- 4 replies
- 2 kudos
I'm trying to use Spark-XML API and I'm facing issue with the XSD validation option.Actually when I parser an XML file using the "rowValidationXSDPath" option the parser can't recognize the Prefixes/Namespaces declared at the root level. For this to...
- 7595 Views
- 4 replies
- 2 kudos
Latest Reply
Hi sorry for the late response got busy looking for a permanent solution to this problem .At the end we are giving up on the XSDpath parser. This option does not work when Prefixes namespaces are declared at the ancestor level .Thank you anyway for ...
3 More Replies
