Hello,
I've configured the DABs on our project successfully. Moreover, I could switch from setuptools to poetry almost successfully. In the project's databricks.yml I configured it as the documentation suggested, I've just changed the name of the artifact:
Spoiler
artifacts:
config:
type: whl
build: poetry build
path: .
The class that I want to 'compile' as a package/module is in the project's root/config folder:
Spoiler
project/
├── config/
│ ├── __init__.py
│ └── env_manager.py
├── pyproject.toml
├── poetry.lock
├── config/
│ ├── __init__.py
│ └── env_manager.py
├── pyproject.toml
├── poetry.lock
Also, in the codepipeline template (AWS), I needed to add the following commands (which were not mentioned in the documentation):
Spoiler
- sudo apt update
- sudo apt install -y pipx
- pipx install poetry
- pipx ensurepath
- export PATH="$PATH:/root/.local/bin"
- poetry --version
- sudo apt install -y pipx
- pipx install poetry
- pipx ensurepath
- export PATH="$PATH:/root/.local/bin"
- poetry --version
The deployment was done (shown in the Figure below).
However, when I tried to run the job I got ModuleNotFoundError: No module named 'config' error message.
The way I am calling it on the files is: import config.env_manager as workspace
Any help would be greatly appreciated.
