Databricks Community

FarBo · 01-05-2023

Hi,I have encountered a problem using spark, when creating a dataframe from a raw json source.I have defined an schema for my data and the problem is that when there is a mismatch between one of the column values and its defined schema, spark not onl...

FarBo · 03-22-2024

@felix_counter I think I have your answer.To create a databricks provider to manage your workspace using an SPN, you need to create the provider like this:provider "databricks" { alias = "workspace" host = <your workspace URL> azure_...

FarBo · 04-20-2023

Hi @Suteja Kanuri Thank you for your reply and suggestion. We have solved the issue in another way but your suggestion also seems a good way.I mainly wanted to report the bug, but it seems it is a known issue. 

Databricks Community

User Stats

User Activity

Spark issue handling data from json when the schema DataType mismatch occurs

Re: How to authenticate databricks provider in terraform using a system-managed identity?

Re: Spark issue handling data from json when the schema DataType mismatch occurs