I have pyspark code running in my local mac, which has 6 cores and 16 GB. I run it in pycharm to do first test.spark = (
SparkSession.builder.appName("loc")
.master("local[2]")
.config("spark.driver.bindAddress","localhost")
.config("...
Here is my input fileEID,EffectiveTime,OrderHistory,dummy_col,Period_Start_Date11,2019-04-19T02:50:42.6918667Z,"[{'Codes': [{'CodeSystem': 'sys_1', 'Code': '1-2'}], 'EffectiveDateTime': '2019-04-18T23:48:00Z', 'ComponentResults': [{'Codes': [{'CodeSy...
