- 1176 Views
- 1 replies
- 0 kudos
Spark read not working in parallel
Hi All,Am trying to run a spark jdbc query and the read is running on only 1 worker and is taking a lot of time. Usually, it takes 4 minutes in aws lambda but now it is taking approx 10 minutes while using databricks. There are only 4m records (write...
- 1176 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Saloni Bhatia​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos
- 1606 Views
- 1 replies
- 0 kudos
Spark JDBC query isn't working for Oracle Databases
I am trying to read with the following syntaxval df = spark.read .format("jdbc") .option("url", "<url>") .option("query", "SELECT * FROM oracle_test_table)") .option("user", "<user>") .option("password", "<password>") .option("driver", "oracle...
- 1606 Views
- 1 replies
- 0 kudos
- 0 kudos
https://kb.databricks.com/data-sources/query-option-not-work-oracle.html#problem-apache-spark-jdbc-datasource-query-option-doesnt-work-for-oracle-database
- 0 kudos