Can't read large multiline json,

espenol
Databricks Partner

Hey! So I'm struggling to read a multiline json. Some details:

  • It's gzipped from the API I get it from
  • just a single file in the folder currrently
  • stored in ADLS Gen2 storage.
  • 95 MB zipped, approximately 1.2 GB unzipped

I can read it just fine using the text read:

Can be read as text, multiline json 

But, if I try to read it normally as json without multiline option, I get corrupted string after some time reading(perhaps as expected)

Corrupted stringBut, if I instead use multiline option then I immediately get an error:

relative path in absolute uri 

Can anyone give me some pointers towards what is wrong? If I uncomment the last line I get the same error:

IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: enheter_full_2022-12-22T13:07:10.4988008Z_b744d2f4-5eb5-41a0-a546-e0514c7db325.json.gz

Does anyone know how to fix this? All the googling I've done suggests this is a problem with my path starting with "/", but my path starts with abfss:...