How would i retrieve data JSON data with namespaces using spark SQL?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-21-2022 10:17 PM
File.json from the below code contains huge JSON data with each key containing namespace prefix(This JSON file converted from the XML file).
I could able to retrieve if JSON does not contain namespaces but what could be the approach to retrieve records/values if each key is with a namespace prefix?
jsondf = spark.read.json("<path>/file.json")
#jsondf.printSchema()
jsondf.createOrReplaceTempView("ramp")
elements = spark.sql("SELECT * FROM ramp")
elements.show()
Here,I wanted to retrieve records of w: document/w.body/w:p. I tried different ways but nothing is working. Any suggestions really helpful
Labels:
- Labels:
-
Pyspark
-
Python
-
SQL
-
SQL Statements