@chinmay0924 - You can change the serverless client image by selecting the environment panel in a Databricks Notebook (on the right pane) or in the "Environment and Libraries" section while configuring a Databricks Job Task.

The set of available serverless client images (officially called Serverless environment versions is here https://docs.databricks.com/aws/en/release-notes/serverless/environment-version/

In the case of Databricks Connect, upgrade to DB Connect 15.4.10 or later (on the 15.x line) or 16.4.1 (on the 16.x line). The reported issue has been fixed in these versions. The compatible Python version on 15.4.10 (or later) is Python 3.11, and on 16.4.1 (or later), it is Python 3.12. 

More details can be found here: https://docs.databricks.com/aws/en/dev-tools/databricks-connect/requirements#databricks-connect-vers...