- 574 Views
- 2 replies
- 1 kudos
Getting FileNotFoundException while using cloudFiles
Hi,Following is the code i am using the ingest the data incrementally (weekly).val ssdf = spark.readStream.schema(schema) .format("cloudFiles").option("cloudFiles.format", "parquet").load(sourceUrl).filter(criteriaFilter)val transformedDf = ssdf.tran...
- 574 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Danny is another process mutating / deleting the incoming files?
- 1 kudos