topic Re: How to extract JSON object from a pyspark data frame. I was able to extract data from another column which in array format using &quot;Explode&quot; function, but Explode is not working for Object type. Its returning with type mismatch error. in Data Engineering https://community.databricks.com/t5/data-engineering/how-to-extract-json-object-from-a-pyspark-data-frame-i-was-able/m-p/17306#M11333 <P>Did you try extracting that column data using from_json function ?</P> Tue, 13 Dec 2022 07:28:56 GMT UmaMahesh1 2022-12-13T07:28:56Z How to extract JSON object from a pyspark data frame. I was able to extract data from another column which in array format using "Explode" function, but Explode is not working for Object type. Its returning with type mismatch error. https://community.databricks.com/t5/data-engineering/how-to-extract-json-object-from-a-pyspark-data-frame-i-was-able/m-p/17305#M11332 <P>I have tried below code to extract data which in Array:</P><PRE><CODE>df2 = df_deidentifieddocuments_tst.select(F.explode('annotationId').alias('annotationId')).select('annotationId.$oid')</CODE></PRE><P>It was working fine.. but,its not working for JSON object type. Below is column:</P><P><span class="lia-inline-image-display-wrapper" image-alt="CreateaAT"><img src="https://community.databricks.com/t5/image/serverpage/image-id/1009iDB0CD5F2529D1F8B/image-size/large?v=v2&amp;px=999" role="button" title="CreateaAT" alt="CreateaAT" /></span>Any Ideas or suggestion would be great help. Thank you.</P> Mon, 12 Dec 2022 15:01:36 GMT https://community.databricks.com/t5/data-engineering/how-to-extract-json-object-from-a-pyspark-data-frame-i-was-able/m-p/17305#M11332 antonyj453 2022-12-12T15:01:36Z Re: How to extract JSON object from a pyspark data frame. I was able to extract data from another column which in array format using "Explode" function, but Explode is not working for Object type. Its returning with type mismatch error. https://community.databricks.com/t5/data-engineering/how-to-extract-json-object-from-a-pyspark-data-frame-i-was-able/m-p/17306#M11333 <P>Did you try extracting that column data using from_json function ?</P> Tue, 13 Dec 2022 07:28:56 GMT https://community.databricks.com/t5/data-engineering/how-to-extract-json-object-from-a-pyspark-data-frame-i-was-able/m-p/17306#M11333 UmaMahesh1 2022-12-13T07:28:56Z