XML Unmarshalling using JAXB from JavaRDD

ShankarReddy — Sat, 27 Jan 2024 17:04:15 GMT

I have a JavRDD with complex nested xml content that I want to unmarshall using JAXB and get the data in to java objects. Can anyone please help with how can I achieve?

Thanks

Re: XML Unmarshalling using JAXB from JavaRDD

ShankarReddy — Sat, 27 Jan 2024 18:08:52 GMT

I hope this should work

JavaPairRDD<String, PortableDataStream> jrdd = javaSparkContext.binaryFiles("<path_to_file>");
Map<String, PortableDataStream> mp = jrdd.collectAsMap();
OutputStream os = new FileOutputStream(f);
mp.values().forEach(pd -> {
    try {
        os.write(pd.toArray());
    } catch (IOException e) {
        throw new RuntimeException(e);
    }
});
os.flush();

And then supplying file to jaxb unmarshaller. Not sure if there is a better way.

topic Re: XML Unmarshalling using JAXB from JavaRDD in Data Engineering

XML Unmarshalling using JAXB from JavaRDD

Re: XML Unmarshalling using JAXB from JavaRDD