Parallel processing of json files in databricks pyspark
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-21-2021 11:34 PM
How we can read files from azure blob storage and process parallel in databricks using pyspark.
As of now we are reading all 10 files at a time into dataframe and flattening it.
Thanks & Regards,
Sujata
Labels:
