- 12458 Views
- 10 replies
- 1 kudos
Error when reading delta lake files with Auto Loader
Hi,When reading Delta Lake file (created by Auto Loader) with this code: df = ( spark.readStream .format('cloudFiles') .option("cloudFiles.format", "delta") .option("cloudFiles.schemaLocation", f"{silver_path}/_checkpoint") .load(bronz...
- 12458 Views
- 10 replies
- 1 kudos
- 1 kudos
The key point is using the correct format for Delta tables rather than treating them like raw files. The same idea of using the right tool for the job applies in other technical workflows too, such as a delta executor apk when handling Android relate...
- 1 kudos
- 4850 Views
- 1 replies
- 0 kudos
Where are delta lake files stored by given path?
I have below code which works for the path below but fails for path = azure storage account path. i have enough access to write and update the storage account. I would like to know what wrong am I doing and the path below which works , how can i phys...
- 4850 Views
- 1 replies
- 0 kudos
- 0 kudos
@Ankit Kumar​ :The error message you received indicates that the user does not have sufficient permission to access the Azure Blob Storage account. You mentioned that you have enough access to write and update the storage account, but it's possible t...
- 0 kudos