- 4556 Views
- 2 replies
- 4 kudos
Error while writing Data Frame from Azure Databricks to Azure synapse Dedicated Pool
I am reading delta tables from my Databricks workspace as DF and then I am trying to write this DF into Azure Synapse Dedicated SQL Pool, but I am getting error like:-Py4JJavaError: An error occurred while calling o1509.save. : com.databricks.spark.s...
- 4556 Views
- 2 replies
- 4 kudos
- 4 kudos
The issue was getting created because I was passing SAS Token for setting the configuration for Storage Account instead of Storage Access Key. It's working now without any issue..spark.conf.set("fs.azure.account.key.datalakestorage.dfs.core.windows.n...
- 4 kudos
- 2037 Views
- 0 replies
- 2 kudos
Databricks to Azure Synapse SQL Server: error converting between Spark and Parquet column types
When writing data from Pyspark to Azure SQL Server (official databricks tutorial here) I am getting an error in the conversion between Spark and Parquet types.I believe this is caused in the temporary storage location mandatory when writing data from...
- 2037 Views
- 0 replies
- 2 kudos