Hi everyone!

I am an engineer working on Databricks Connect. This error appears because of the incompatibility between the Serverless Compute and Databricks Connect versions. The current Serverless Compute release roughly corresponds to Databricks Runtime 15.1, while you are using Databricks Connect 15.3. We guarantee forward compatibility in Databricks Connect Python, which means that Databricks Connect version should be lower than or equal to the Serverless Runtime version. You should switch to using DBConnect 15.1 for now, until Serverless Compute is upgraded.

Serverless Compute releases currently lag behind Classic DBR releases. We are working on reducing the delay for Serverless Compute releases.

You can find the Runtime version used by Serverless compute in these release notes https://docs.databricks.com/en/release-notes/serverless.html#version-202430
and on this page https://docs.databricks.com/en/dev-tools/databricks-connect/python/install.html