Writing Spark data frame to ADLS is taking Huge time when Data Frame is of Text data.

Santosh09
Databricks Partner

Spark data frame with text data when schema is in Struct type spark is taking too much time to write / save / push data to ADLS or SQL Db or download as csv.

image.png