topic databricks asset bundles - error demo project in Data Engineering

databricks asset bundles - error demo project

DavMes — Tue, 19 Sep 2023 07:38:08 GMT

Hi,

I am using the v0.205.0 version of the CLI. I wanted to test the demo project (databricks bundle init) of the Databricks Asset Bundles, however I am getting an error after databricks bundle deploy (validate is ok).

artifacts.whl.AutoDetect: Detecting Python wheel project... artifacts.whl.AutoDetect: Found Python wheel project at c:\projects\my_project Error: INFO: Could not find files for the given pattern(s).

I found out that without the 'python_wheel_task` in the `my_project_job.yml`, it works without any problem. I built the wheel from the setup.py too. Can you please help me?

Thank you

Re: databricks asset bundles - error demo project

FadyYass_34581 — Mon, 25 Sep 2023 12:56:59 GMT

Hi @DavMes, the default python template that Databricks provides has the job.yml file that you mentioned, which has a python_wheel_task that looks for "whl" libraries in this location "../dist/*.whl" which doesn't exist. When I removed this line pattern error disappeared.

Re: databricks asset bundles - error demo project

AndréSalvati — Wed, 06 Mar 2024 16:58:54 GMT

There you can see a complete template project with Databricks Asset Bundles and a python wheel task. Please, follow the instructions for deployment.

https://github.com/andre-salvati/databricks-template