cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

MounicaVemulapa
by New Contributor III
  • 6485 Views
  • 4 replies
  • 0 kudos

How to handle multilines coming from CSV file in a quoted string

How to handle multilines coming from CSV file in a quoted string

  • 6485 Views
  • 4 replies
  • 0 kudos
Latest Reply
mathan_pillai
Databricks Employee
  • 0 kudos

Hi, Can you try escape parameter & quote parameter to indicate which characters need to be ignored. The escape character within the quotes will be ignored. you can specify the newline character, that it needs to be ignored. please refer to below doc...

  • 0 kudos
3 More Replies
espenol
by New Contributor III
  • 5756 Views
  • 4 replies
  • 3 kudos

Resolved! Can't read large multiline json,

Hey! So I'm struggling to read a multiline json. Some details:It's gzipped from the API I get it fromjust a single file in the folder currrentlystored in ADLS Gen2 storage. 95 MB zipped, approximately 1.2 GB unzippedI can read it just fine using the...

Can be read as text, multiline json Corrupted string relative path in absolute uri
  • 5756 Views
  • 4 replies
  • 3 kudos
Latest Reply
espenol
New Contributor III
  • 3 kudos

Thanks a lot for the help! Removing colon fixed it. Now I need to fix the Data Factory instance that writes to my storage container. Hope it's easy, Data Factory is such a hassle.

  • 3 kudos
3 More Replies
Labels