topic Why it still complain REST API version is 2.0 even though set it to 2.1 ? in Data Engineering

Why it still complain REST API version is 2.0 even though set it to 2.1 ?

johnny1 — Sat, 24 Sep 2022 06:47:13 GMT

root@387ece6d15b2:/usr/workspace# databricks --version

Version 0.17.3

root@387ece6d15b2:/usr/workspace# databricks jobs configure --version=2.1

root@387ece6d15b2:/usr/workspace# databricks jobs get --job-id 123

WARN: Your CLI is configured to use Jobs API 2.0. In order to use the latest Jobs features please upgrade to 2.1: 'databricks jobs configure --version=2.1'. Future versions of this CLI will default to the new Jobs API. Learn more at https://docs.databricks.com/dev-tools/cli/jobs-cli.html

Error: b'{"error_code":"INVALID_PARAMETER_VALUE","message":"Job 123 does not exist."}'

root@387ece6d15b2:/usr/workspace#

Re: Why it still complain REST API version is 2.0 even though set it to 2.1 ?

johnny1 — Mon, 26 Sep 2022 00:47:11 GMT

Actually ,the document did not help.

I have set the version to 2.1 via command, but it did not take effort .

I am using Databricks client in my own container .

When use it in bare metal , the configuration can take effort , looks very strange?

Re: Why it still complain REST API version is 2.0 even though set it to 2.1 ?

johnny1 — Mon, 26 Sep 2022 02:05:38 GMT

Command "databricks jobs configure --version=2.1" not work.

workaround with adding option "--version=2.1" to each databricks jobs/runs command .

It is not very convenient.