First notebook in ML course fails with wrong runtime

[IonFreeman_Pace]

Help! I'm trying to run this first notebook in the Scalable MachIne LEarning (SMILE) course.

https://github.com/databricks-academy/scalable-machine-learning-with-apache-spark-english/blob/publi...

It fails on the first cell with

AssertionError: The Databricks Runtime is expected to be one of ['11.3.x-cpu-ml-scala2.12'], found "11.3.x-scala2.12". Please see the "Troubleshooting | Spark Version" section of the "Version Info" notebook for more information.

There's no more information in the Version Info notebook. I set the version to 11.3 and turned off photon to try to get it to match, but I don't see how to get 'cpu-ml' in there.

I suppose I can just modify the 'supported_dbrs' list in Includes/_common, but that seems like it might cause trouble later.

[IonFreeman_Pace]

It definitely caused trouble later

[-werners- · Accepted solution]

it means your cluster type has to be a ML runtime.

When you create a cluster in databricks, you can choose between different runtimes.

These have different version (spark version), but also different types:

For your case you need to select the ML menu option.

[IonFreeman_Pace]

Ah, OK, Cool. Thanks for your help. I somehow didn't see that yesterday. I guess you have to know where to look.

[Gautamp]

was helpful for me too. Thank you for your help during my journey of learning databricks!