unable to perform CD using github actions for MLops

jose_db_aws — Mon, 15 Jul 2024 11:33:26 GMT

Hi,

I am new to databricks and MLOPS as well. I am trying out the databricks asset bundles mlops tutorial at https://docs.databricks.com/en/dev-tools/bundles/mlops-stacks.html

my cloud account is using AWS. I had asked to setup FS and Model Registry in UC. I had also asked for CICD setup using github actions. Everything is setup nicely. I have a local repo. I also have a remote github repo. I also have databricks workspace.

My file structure looks like the following.

My DB workspace File structure is :

When I run "databricks bundle validate -t staging" from my local terminal it seems to output correctly as below.

However, this is also part of the CD workflow as shown in "mbs_db_mlops-bundle-cd-staging.yml" file in the earlier image above. I have setup github secrets for this DB workspace as well.

The CD workflow in github actions fails at "databricks bundle validate -t staging" when I push the "main" branch to remote.

It works locally but not from github actions. How do I fix this? I want this to pass.

Re: unable to perform CD using github actions for MLops

jose_db_aws — Mon, 15 Jul 2024 12:18:09 GMT

The problem was with the secrets at github actions were different from the Personal access token that I had set as my environment variable, DATABRICKS_TOKEN locally. After I copied this over the github's STAGING_WORKSPACE_TOKEN it is able to run the jobs.

topic unable to perform CD using github actions for MLops in Get Started Discussions

unable to perform CD using github actions for MLops

Re: unable to perform CD using github actions for MLops