saveAsTable sometimes works sometimes dont
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-07-2024 07:25 AM - edited 11-07-2024 07:27 AM
I have the following Spark (Save As Table) example. sometimes it works fine, sometimes it fails
Code below with file listed in "/temp" directory.
This has worked fine as it is, but when I have to create a new Cluster, as I am using the community edition.
It fails, is there a transaction log I have to Vacuum or any other areas I need to clean up first?
Any help would be appreciated
Thank you all