- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-01-2022 07:00 AM
Is there a difference between cluster modes in this case? Can it be that Graphx would work better on single than on standart cluster or high concurrency cluster (for multiple users)? Does less concurrent cluster wourld be more efficient for graph modelling?
- Labels:
-
Cluster Modes
-
Graph
-
Graphx
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-01-2022 11:34 AM
Single - for development purposes,
high concurrency - when multiple users run notebooks at the same time in parallel,
so usually standard is the best option.
Regarding VM I bet compute optimized.
I recommend also to read ebook "Spark GraphX in action" https://livebook.manning.com/book/spark-graphx-in-action/table-of-contents/
My blog: https://databrickster.medium.com/
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-02-2022 12:19 AM
I´d say start as cheap as possible and check the runtime.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-06-2022 04:16 PM
@Direo Direo - What do you think of these answers? If either of them stands out as best, would you please mark it that way? If you have more questions, please, bring them on!
