- 6210 Views
- 17 replies
- 13 kudos
Resolved! Created nested struct schema SPARK - Schema Jira
Hello guys,I'm using Jira API to return "ISSUES". But to be able to use pyspark I need to create the Dataframe passing in the Schema. But I am not able to create the Schema based on the model below. Would you have any ideas?root |-- expand: string ...
- 6210 Views
- 17 replies
- 13 kudos
Latest Reply
- 13 kudos
if columns are missing, that particular data is not present in the json. I am not aware of spark skipping columns when reading json with inferschema. There is an option dropFieldIfAllNull but that is False by default.That makes me think: you might ...
- 13 kudos