Can you run non-spark jobs on Databricks?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-15-2021 07:21 PM
Is spark the only type of code that can run on a Databricks cluster?
- Labels:
-
Data Ingestion & connectivity
-
JOBS
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-15-2021 09:46 PM
You can also run straight python code on Databricks clusters, but it will not run in a distributed manner.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-18-2021 03:38 PM
Databricks has a Runtime for Machine Learning that comes with a lot of libraries/frameworks pre-installed. This allows you to run for example PyTorch / TensorFlow code without worrying about infrastructure setup, configuration and dependency management.
Databricks also supports single node clusters to run single-node machine learning workloads

