topic 404 on GET Billing usage data (API) in Data Engineering

404 on GET Billing usage data (API)

vdeorios — Wed, 16 Aug 2023 18:04:50 GMT

I'm trying to get my billing usage data from Databricks API (documentation: https://docs.databricks.com/api/gcp/account/billableusage/download) but I keep getting an 404 error.

Code:

import requests
import json

token = dbutils.notebook.entry_point.getDbutils().notebook().getContext().apiToken().get()
api_url = f"{my_domain_url}/api/2.0/accounts/{my_account_id}/usage/download"

headers = {
    "Authorization": f"Bearer {token}",
    "Content-Type": "application/json"
}

params = {
    "start_month": "2023-06",
    "end_month": "2023-07"
}

response = requests.get(api_url, headers=headers, params=params)

if response.status_code == 200:
    cost_data_csv = response.content.decode('utf-8')
    print("Usage logs downloaded successfully.")
else:
    print("Error:", response.status_code, response.text)

Error: 404 {"error":"Bad Target: /api/2.0/accounts/<my_account_id>/usage/download"}

Note: I've already attempted modifying the URL prefix from /api/2.0 to /api/2.1 and have also thoroughly verified the accuracy of both my account ID and domain URL.

Re: 404 on GET Billing usage data (API)

cristianmolina — Tue, 12 Sep 2023 15:32:52 GMT

Since this is an endpoint under the account section and not under workspace, you have to use the Databricks account login URL (https://accounts.cloud.databricks.com) instead of your domain url. Also, you must use basic authentication with user and password, the bearer token is not allowed here. I had the same problem as you, hope this helps.

Re: 404 on GET Billing usage data (API)

jose_gonzalez — Tue, 12 Sep 2023 16:46:59 GMT

HIi @vdeorios ,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.

Re: 404 on GET Billing usage data (API)

vdeorios — Wed, 13 Sep 2023 16:53:02 GMT

Yes! That works, thank you 😀

Re: 404 on GET Billing usage data (API)

Anurag_Thakur — Sun, 10 Mar 2024 14:00:23 GMT

@vdeorios @cristianmolina can anyone of you please post the full code here

Re: 404 on GET Billing usage data (API)

Dave_Nithio — Thu, 26 Sep 2024 14:38:47 GMT

Bumping this to see if there is a solution. Per Databricks basic authentication is no longer allowed. I am unable to authenticate to get access to this endpoint (401 error). Does anyone have a solution to querying this endpoint?