cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
rahul08yadav
by • New Contributor III
  • 2955 Views
  • 2 replies
  • 4 kudos

Error while writing Data Frame from Azure Databricks to Azure synapse Dedicated Pool

I am reading delta tables from my Databricks workspace as DF and then I am trying to write this DF into Azure Synapse Dedicated SQL Pool, but I am getting error like:-Py4JJavaError: An error occurred while calling o1509.save. : com.databricks.spark.s...

Data Engineering
Reply
  • 2955 Views
  • 2 replies
  • 4 kudos
View Replies
Latest Reply
rahul08yadav
New Contributor III
  • 4 kudos

The issue was getting created because I was passing SAS Token for setting the configuration for Storage Account instead of Storage Access Key. It's working now without any issue..spark.conf.set("fs.azure.account.key.datalakestorage.dfs.core.windows.n...

  • 4 kudos
1 More Replies
TMNGB
by • New Contributor II
  • 996 Views
  • 0 replies
  • 2 kudos

Databricks to Azure Synapse SQL Server: error converting between Spark and Parquet column types

When writing data from Pyspark to Azure SQL Server (official databricks tutorial here) I am getting an error in the conversion between Spark and Parquet types.I believe this is caused in the temporary storage location mandatory when writing data from...

Data Engineering
Reply
  • 996 Views
  • 0 replies
  • 2 kudos
Labels