cancel
Showing results for 
Search instead for 
Did you mean: 
KiranKondamadug
New Contributor II
since ‎05-31-2023
‎11-13-2023

User Stats

  • 2 Posts
  • 0 Solutions
  • 0 Kudos given
  • 1 Kudos received

User Activity

Pyspark Configuration: pyspark --packages io.delta:delta-core_2.12:2.4.0,org.apache.hadoop:hadoop-aws:3.3.4,io.delta:delta-storage-s3-dynamodb:2.4.0 --conf "spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension" --conf "spark.sql.catalog.spark...
My use-case is to process a dataset worth 100s of partitions in concurrency. The data is partitioned, and they are disjointed. I was facing ConcurrentAppendException due to S3 not supporting the “put-if-absent” consistency guarantee. From Delta Lake ...
Kudos from