Can the default cluster Serverless of Databricks install Scala packages
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-04-2025 01:15 AM
Can the default cluster Serverless of Databricks install Scala packages
I need to use the spark-sftp package, but it seems that serverless is different from purpose compute, and I can only install python packages?
There is another question. I can use purpose compute to put sftp files into dbfs through the paramiko package. Why do I get an error saying the folder cannot be found when using serverless to put sftp files into External Data(s3)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-05-2025 05:28 AM
no scala, you can't even run scala notebooks.
about the sftp: the serverless compute is way more limited than general purpose clusters.
what folder can't be found? dbfs or s3?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-10-2025 07:41 PM
@-werners-
Thank you for your reply
dbfs and s3 both
Although I found a new method to fulfill my needs, unfortunately, there are still some issues.
