- 874 Views
- 0 replies
- 0 kudos
Hi there, I am trying to build a delta live tables pipeline that ingests gzip compressed archives as they're uploaded to S3. The archives contain 2 files in a proprietary format, and one is needed to determine how to parse the other. Once the file co...
- 874 Views
- 0 replies
- 0 kudos
by
Kash
• Contributor III
- 9198 Views
- 18 replies
- 13 kudos
Hi there,I was wondering if I could get your advise.We would like to create a bronze delta table using GZ JSON data stored in S3 but each time we attempt to read and write it our clusters CPU spikes to 100%. We are not doing any transformations but s...
- 9198 Views
- 18 replies
- 13 kudos
Latest Reply
Hi Kaniz,Thanks for the note and thank you everyone for the suggestions and help. @Joseph Kambourakis​ I aded your suggestion to our load but I did not see any change in how our data loads or the time it takes to load data. I've done some additional ...
17 More Replies