How to use multi character encodings in Delta Tables?

ShuImamura
New Contributor II

Can we mix different encodings in Delta tables? Downstream needs different character encodings like UTF-8 and Shift JIS.

-werners-
Esteemed Contributor III

I don't think that it is possible.

Using an alternative encoding might be possible (you can for csv files, but for delta lake I did not find an option to do that).

But even with that hypothetical alternative encoding, I realyl doulbt mixing will work as the encoding is typically set for the whole file, not just a part of it.

View solution in original post

ShuImamura
New Contributor II

@Werner Stinckens​ thanks for answering!