Your code is correct. Please execute it directly on databricks.

"Databricks recommends that you use DBX by Databricks Labs for local development instead of Databricks Connect." The main limitation is that code is executed directly on clusters and not databricks. + the fact that it is EOL.

Soon Spark Connect will be available, so our life will be easier.