Avro file format generation
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2024 07:32 AM
Hi All,
We are using cluster with 9.1 run time version, I'm getting "incompatible schema exception" error while writing the data into avro file. Fields in Avro schema are more compared to dataframe output Fields.
I tried the same in community edition with cluster 12.2 run time, in community edition same code is working . If I change the run time to 9.1 getting Incompatible schema error.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2024 08:48 AM - edited 02-27-2024 08:48 AM
@Jagan_etl - Kindly provide more context if the issue is happening only in Databricks community edition.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2024 10:12 AM
@shan_chandra Issue is happening in both community edition (cluster with 9.1 run time) and in our org databricks workspace.
In our organization we are using cluster with 9.1 run time.
Please let me know if need any other details.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-04-2024 05:28 AM
Hi All,
Any suggestions on this.
