https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24238#M16843 <P>You can also run straight python code on Databricks clusters, but it will not run in a distributed manner. </P> Wed, 16 Jun 2021 04:46:34 GMT User16826992666 2021-06-16T04:46:34Z https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24237#M16842 <P>Is spark the only type of code that can run on a Databricks cluster?</P> Wed, 16 Jun 2021 02:21:04 GMT https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24237#M16842 User16826992666 2021-06-16T02:21:04Z https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24238#M16843 <P>You can also run straight python code on Databricks clusters, but it will not run in a distributed manner. </P> Wed, 16 Jun 2021 04:46:34 GMT https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24238#M16843 User16826992666 2021-06-16T04:46:34Z https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24239#M16844 <P>Databricks has a <A href="https://docs.databricks.com/runtime/mlruntime.html" alt="https://docs.databricks.com/runtime/mlruntime.html" target="_blank">Runtime for Machine Learning</A> that comes with a lot of libraries/frameworks pre-installed. This allows you to run for example PyTorch / TensorFlow code without worrying about infrastructure setup, configuration and dependency management. </P><P></P><P>Databricks also supports <A href="https://docs.databricks.com/clusters/single-node.html" alt="https://docs.databricks.com/clusters/single-node.html" target="_blank">single node clusters</A> to run single-node machine learning workloads</P><P></P><P></P> Fri, 18 Jun 2021 22:38:32 GMT https://community.databricks.com/t5/data-engineering/can-you-run-non-spark-jobs-on-databricks/m-p/24239#M16844 sajith_appukutt 2021-06-18T22:38:32Z