How to use multi character encodings in Delta Tables?

[ShuImamura]

Can we mix different encodings in Delta tables? Downstream needs different character encodings like UTF-8 and Shift JIS.

[-werners- · Accepted solution]

I don't think that it is possible.

Using an alternative encoding might be possible (you can for csv files, but for delta lake I did not find an option to do that).

But even with that hypothetical alternative encoding, I realyl doulbt mixing will work as the encoding is typically set for the whole file, not just a part of it.

[Kaniz_Fatma]

Hi @Shu Imamura​, We haven’t heard from you on the last response from @Werner Stinckens​, and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to others.

[ShuImamura]

@Werner Stinckens​ thanks for answering!