cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Exhausted Server when deploying a Databricks Assets Bundle (DAB)

PabloCSD
Contributor III

Hello, I'm currently with a colleague inspecting the code and when trying to deploy the DAB it gets stuck:

 

(.venv) my_user@my_pc my-dab-project % databricks bundle deploy -t=dev -p=my-dab-project-prod      
Building wheel...
Uploading my-dab-project-1.0.1-py3-none-any.whl...
Uploading bundle files to /Users/my_databricks_user/.bundle/my-dab-project/dev/files...

 

When doing it in debug mode it shows that it tries to erase some files, it doesn't find it and then the server got exhausted: RESOURCE_EXHAUSTED.

 

databricks bundle deploy -t=dev -p=my-dab-project-prod --debug

17:17:40 DEBUG POST /api/2.0/workspace/delete
> {
>   "path": "/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib/pytho... (55 more bytes)"
> }
< HTTP/2.0 404 Not Found
< {
<   "error_code": "RESOURCE_DOES_NOT_EXIST",
<   "message": "Path (/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib... (77 more bytes)"
< } pid=83938 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
17:17:40 DEBUG non-retriable error: Path (/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib/python3.10/site-packages/pip/_vendor/platformdirs/windows.py) doesn't exist. pid=83938 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
17:17:40 DEBUG POST /api/2.0/workspace/delete
> {
>   "path": "/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib/pytho... (58 more bytes)"
> }
< HTTP/2.0 404 Not Found
< {
<   "error_code": "RESOURCE_DOES_NOT_EXIST",
<   "message": "Path (/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib... (80 more bytes)"
< } pid=83938 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
17:17:40 DEBUG non-retriable error: Path (/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib/python3.10/site-packages/setuptools/_distutils/command/bdist.py) doesn't exist. pid=83938 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
17:17:40 DEBUG POST /api/2.0/workspace/delete
> {
>   "path": "/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib/pytho... (63 more bytes)"
> }
< HTTP/2.0 429 Too Many Requests
< {
<   "error_code": "RESOURCE_EXHAUSTED",
<   "message": "Too many requests. Please wait a moment and try again. If the issue persists, consider adjusting... (66 more bytes)"
< } pid=83938 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
17:17:40 DEBUG POST /api/2.0/workspace/delete
> {
>   "path": "/Users/my_databricks_user/.bundle/my-dab-project/dev/files/venv/lib/pytho... (51 more bytes)"
> }
< HTTP/2.0 429 Too Many Requests
< {
<   "error_code": "RESOURCE_EXHAUSTED",
<   "message": "Too many requests. Please wait a moment and try again. If the issue persists, consider adjusting... (66 more bytes)"
< } pid=83938 mutator=seq mutator=deploy mutator=seq mutator=seq mutator=deferred mutator=seq mutator=files.Upload sdk=true
^C

 

How can I fix it without renaming the project (this way helps but is not the most adequate)? Is there a way to deploy it erasing some sort of cache that tries to erase a non existing element?

Thanks in advance

 

1 ACCEPTED SOLUTION

Accepted Solutions

TinSlim
New Contributor II

You are using a venv, the venv has too many files and is not needed to be included, try adding this on your databricks.yml

sync:
  exclude:
  - "venv"

 Hope it helps

View solution in original post

2 REPLIES 2

Walter_C
Databricks Employee
Databricks Employee

Can you provide the code you are running on this DAB to understand the reason why this is calling this directory?

TinSlim
New Contributor II

You are using a venv, the venv has too many files and is not needed to be included, try adding this on your databricks.yml

sync:
  exclude:
  - "venv"

 Hope it helps

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group