Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-05-2023 10:14 PM
@Suteja Kanuri
let me know if I have to do this rdd.map on a column having json data, and then read it as a json string in pyspark!
how can I do that!!
Sample Syantx for what I'm trying to achieve on a shared cluster with the same error related to "spark.databricks.pyspark.enablePy4JSecurity"
Syntax: spark.read.json(df.rdd.map(lambda x:x[0]))
what will be the optimal alternative for the same!!