Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-27-2021 09:21 AM
- please mount cheaper storage (LRS) to custom mount and set there checkpoints,
- please clear data regularly,
- if you are using forEac/forEatchBatchh in stream it will save every dataframe on dbfs,
- please remember not to use display() in production,
- if on that storage you don't pay much per GB it is better to use "premium" class storage as it has higher ratio per GB but lower for all other operations
My blog: https://databrickster.medium.com/
