T0M
Contributor

Had the same Problem in my GitLab CI/CD Pipeline while trying to deploy:

 

$ databricks bundle deploy -t dev
Building package...
Error: build failed package, error: exit status 1, output: Traceback (most recent call last):
  [...]
  File "/builds/user/package/./src/package/main.py", line 2, in <module>
    from pyspark.dbutils import DBUtils
ModuleNotFoundError: No module named 'pyspark.dbutils'

 

 

Solved it by completing the requirements.txt with

  • ipykernel>=6.29.4
  • nbformat>=5.10.4
  • databricks-connect>=13.1.0

as seen here: https://github.com/databricks/dais-cow-bff/blob/dais24-main/requirements.txt