topic Re: Data prefixed by ' > ' in Data Engineering

Data prefixed by ' > '

dpc — Mon, 17 Jun 2024 15:38:08 GMT

I have a databricks table that has a column with a string datatype

When loading data, certain rows are prefixed by ' > '

Does anybody know what would cause this?

It seems to be when the string is above a certain number of characters (around 200)

Thanks

Re: Data prefixed by ' > '

jacovangelder — Mon, 17 Jun 2024 18:27:06 GMT

Pretty sure it is just some automated shortener when a column contains multiline strings, to show you there are extra new line characters in the column.

Re: Data prefixed by ' > '

Jag — Mon, 17 Jun 2024 19:21:03 GMT

It looks like default string data length exceeded and due to that its showing this kind of symbol and extra new line in the column.