https://community.databricks.com/t5/data-engineering/colon-sign-operator-for-json/m-p/63726#M32333 <P>Thanks Kaniz.</P><P>Yes, I did some testing. With some schema, I read the same data source and write the parsing results to diff tables. For 586K rows, the perf diff is 9sec vs. 37sec. For 2.3 million rows, 16sec vs. 133sec.</P><P>&nbsp;</P> Thu, 14 Mar 2024 18:10:33 GMT MikeGo 2024-03-14T18:10:33Z https://community.databricks.com/t5/data-engineering/colon-sign-operator-for-json/m-p/62282#M31940 <P>Hi,<BR />I have a streaming source loading data to a raw table, which has a string type col (whose value is JSON) to hold all data. I want to use colon sign operator to get fields from the JSON string. Is this going to have some perf issues vs. I use a schema+from_json function?</P><P>Thanks</P><P>Brad</P> Thu, 29 Feb 2024 00:36:17 GMT https://community.databricks.com/t5/data-engineering/colon-sign-operator-for-json/m-p/62282#M31940 MikeGo 2024-02-29T00:36:17Z https://community.databricks.com/t5/data-engineering/colon-sign-operator-for-json/m-p/63726#M32333 <P>Thanks Kaniz.</P><P>Yes, I did some testing. With some schema, I read the same data source and write the parsing results to diff tables. For 586K rows, the perf diff is 9sec vs. 37sec. For 2.3 million rows, 16sec vs. 133sec.</P><P>&nbsp;</P> Thu, 14 Mar 2024 18:10:33 GMT https://community.databricks.com/t5/data-engineering/colon-sign-operator-for-json/m-p/63726#M32333 MikeGo 2024-03-14T18:10:33Z