How to use multi character encodings in Delta Tables?

[ShuImamura]

Can we mix different encodings in Delta tables? Downstream needs different character encodings like UTF-8 and Shift JIS.

[-werners- · Accepted solution]

I don't think that it is possible.

Using an alternative encoding might be possible (you can for csv files, but for delta lake I did not find an option to do that).

But even with that hypothetical alternative encoding, I realyl doulbt mixing will work as the encoding is typically set for the whole file, not just a part of it.

[ShuImamura]

@Werner Stinckens​ thanks for answering!