I am trying to profile my dataset using ydata-profiling.
I constantly run into errors, even with simple datasets on my spark cluster.
Profiling in Spark cluster erroring out ยท Issue #1350 ยท ydataai/ydata-profiling (github.com)
Has anyone got ydata-profiling to work on their databricks cluster?