RStudio on Databricks user experience
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-21-2022 06:49 AM
Is anybody actually using the RStudio app integration on Databricks? I'm surprised to find so little discussion in this forum.
My team has been using it for about 3 months and it seems under-developed.
1) No automated backup, you have to do it yourself Rstudio-automated-backup - Databricks
2) Spark connection gets dropped on a regular basis
3) Can't access repos in the `/Workspaces/Repos/` path though I can see it there on the web terminal.
Is everyone basically using notebooks?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-23-2022 09:53 AM
I tried it but I too felt it was clunky for the above reasons (3 being the fatal one). In addition:
- can't use it on a cluster that autoterminates/actually had to have a dedicated cluster for each user I believe
- the login process for the open source version is bad (allowing one user and having to share the credentials)
- persisting the workspace at all is a pain
All of this work is to avoid using a notebook that is tightly integrated with databricks. The reward isn't worth the effort.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-03-2023 05:17 AM
@Jonathan Dufault Thanks for the response, and glad I'm not alone. My problem (and this is probably just a preference thing) is that the 'reward' of using a full-fledged IDE is huge, compared to bouncing between notebooks in multiple tabs. The integrations are all (mostly?) Databricks specific and my team hasn't fully committed yet to try and keep some platform independence so we're not getting much benefit there.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-03-2023 06:23 AM
There's a submitted idea on the azure databricks feedback page https://feedback.azure.com/d365community/idea/4a538c5f-f124-ec11-b6e6-000d3a4f0da0 if you wanted to upvote.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-03-2023 06:38 AM
wow ... the idea was submitted 4 years ago 😞 i guess i won't get my hopes up for a quick change