Hello @AGnewbie,
Firstly, regarding the Databricks runtime: your compute setup is currently running version 11.3 LTS, which will indeed be an issue as the specified version is not present in your current runtime. Hence, you need to update your runtime to the required 15.4 LTS version.
Secondly, regarding the warning for the worker type: to run Spark commands or import tables, you need at least one worker node. If your compute setup currently does not meet this requirement, you need to increase the number of worker nodes.
To increase the number of worker nodes:
- Go to your Databricks workspace.
- Click on
Clusters
in the sidebar.
- Select the cluster that you are using.
- Click
Edit
.
- In the
Workers
field, specify the number of workers you want.
- Click
Confirm
.