Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-23-2021 12:19 AM
AFAIK Databricks handles unicode well. It seems your ETL tool is not configured for UTF8?
We had the same issue copying data into a database. The cause was a non-unicode collation on the database.
Your ETL tool should recognize the string columns of the databricks tables as UTF8.
Maybe you can try to bypass the JDBC driver and use the parquet files directly instead of over the table interface?