Hello. Could anyone please confirm the maximum number of characters for sql string data type? Thank you in advance
I have followed the basic guide on using OneHotEncoder, matching the syntax exactly with my own data tables. The tables have enumerated string values. I first run a StringIndexer (both with and without handleInvalid set):indexer = StringIndexer( ...
Nice catch ! Indeed, the error is misleading. In my case, it was a specific column that had a string with just whitespaces.
Is there a way to change the limit to the length of strings that can be shown using the display() function in notebooks? If I'm noticing truncation, what can I do?
There is a 500 character limit to strings in columns which is non-configurable. To see the full contents of the column, you can either use the tooltip to expand the cell or download the full results.
