topic Re: How to configure Databricks token inside Docker File? in Data Engineering

How to configure Databricks token inside Docker File?

User16790091296 — Thu, 24 Jun 2021 15:48:43 GMT

I have a docker file where I want to

Download the Databricks CLI
Configure the CLI by adding a host and token
And then running a python file that hits the Databricks token

I am able to install the CLI in the docker image, and I have a working python file that is able to submit the job to the Databricks API but Im unsure of how to configure my CLI within docker.

Re: How to configure Databricks token inside Docker File?

User16752239289 — Thu, 24 Jun 2021 18:08:28 GMT

The Databricks cli credential can be configured by editing file ~/.databrickscfg .

The file content will be like below:

[DEFAULT]
host = [workspace url]
username = [email id]
password = [password]
 
[profile 1]
host = [workspace url]
token = {personal access token}

After the Databricks Cli installed succeed, you can append your credential and workspace url to the file ~/.databrickscfg. Then the cli is ready to use.

Re: How to configure Databricks token inside Docker File?

sachingawade — Wed, 02 Nov 2022 16:16:42 GMT

Hi I was facing same issue and searching for the solution but didnt get it, and now after working on it i have the solution 🙂

if you want to access databricks models/download_artifacts using hostname and access token like how you do on databricks cli

databricks configure --token --profile <profile name>
 
>Databricks Host (should begin with https://): <hostname>
>Token : <token>

if you have created profile name and pushed models and just want to access the model/artifacts in docker using this profile

Add below code in the docker file.

RUN pip install databricks_cli
 
ARG HOST_URL
 
ARG TOKEN
 
RUN echo "[<profile name>]\nhost = ${HOST_URL}\ntoken = ${TOKEN}" >> ~/.databrickscfg

#this will created your .databrickscfg file with host and token after build the same way you do using databricks configure command

Add args HOST_URL and TOKEN in the docker build

e.g

your host name = https://adb-5443106279769864.19.azuredatabricks.net/

your access token = dapi********************63c1-2

sudo docker build -t test_tag --build-arg HOST_URL=<your host name> --build-arg TOKEN=<your access token> .

And now you can access your experiments using this profilename Databricks:<profile name> in the code.