https://community.databricks.com/t5/get-started-discussions/ydata-profiling-on-spark-cluster-working-for-you/m-p/45118#M5825 <P>Thank you&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/9">@Retired_mod</a>&nbsp;</P> Sat, 16 Sep 2023 18:34:53 GMT manojvas 2023-09-16T18:34:53Z https://community.databricks.com/t5/get-started-discussions/ydata-profiling-on-spark-cluster-working-for-you/m-p/44614#M5823 <P>I am trying to profile my dataset using <A href="https://www.databricks.com/blog/2023/04/03/pandas-profiling-now-supports-apache-spark.html#:~:text=Profiling%20this%20dataset%20in%20Databricks%20Notebooks%20is%20as,3%20Configure%2C%20run%2C%20and%20display%20the%20profile%20report" target="_self">ydata-profiling</A>.</P><P>I constantly run into errors, even with simple datasets on my spark cluster.</P><P><A href="https://github.com/ydataai/ydata-profiling/issues/1350" target="_blank">Profiling in Spark cluster erroring out · Issue #1350 · ydataai/ydata-profiling (github.com)</A></P><P>Has anyone got ydata-profiling to work on their databricks cluster?</P> Wed, 13 Sep 2023 16:33:06 GMT https://community.databricks.com/t5/get-started-discussions/ydata-profiling-on-spark-cluster-working-for-you/m-p/44614#M5823 manojvas 2023-09-13T16:33:06Z https://community.databricks.com/t5/get-started-discussions/ydata-profiling-on-spark-cluster-working-for-you/m-p/45118#M5825 <P>Thank you&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/9">@Retired_mod</a>&nbsp;</P> Sat, 16 Sep 2023 18:34:53 GMT https://community.databricks.com/t5/get-started-discussions/ydata-profiling-on-spark-cluster-working-for-you/m-p/45118#M5825 manojvas 2023-09-16T18:34:53Z