https://community.databricks.com/t5/data-engineering/spark-read-not-working-in-parallel/m-p/2803#M89 <P>Hi @Saloni Bhatia​&nbsp;</P><P></P><P>Great to meet you, and thanks for your question! </P><P></P><P>Let's see if your peers in the community have an answer to your question. Thanks.</P><P></P> Wed, 21 Jun 2023 04:04:06 GMT Anonymous 2023-06-21T04:04:06Z https://community.databricks.com/t5/data-engineering/spark-read-not-working-in-parallel/m-p/2802#M88 <P>Hi All,</P><P></P><P>Am trying to run a spark jdbc query and the read is running on only 1 worker and is taking a lot of time. Usually, it takes 4 minutes in aws lambda but now it is taking approx 10 minutes while using databricks. There are only 4m records (write is not taking long but read is consuming the max time)</P> Tue, 20 Jun 2023 19:29:56 GMT https://community.databricks.com/t5/data-engineering/spark-read-not-working-in-parallel/m-p/2802#M88 ssaloni_bhatia 2023-06-20T19:29:56Z https://community.databricks.com/t5/data-engineering/spark-read-not-working-in-parallel/m-p/2803#M89 <P>Hi @Saloni Bhatia​&nbsp;</P><P></P><P>Great to meet you, and thanks for your question! </P><P></P><P>Let's see if your peers in the community have an answer to your question. Thanks.</P><P></P> Wed, 21 Jun 2023 04:04:06 GMT https://community.databricks.com/t5/data-engineering/spark-read-not-working-in-parallel/m-p/2803#M89 Anonymous 2023-06-21T04:04:06Z