Maximum wait time Databricks Model Serving
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2024 11:18 AM
hi, hope you are fine
I deployed a model 3 or 2 months ago using Databricks Serving and MLFlow. The model worked good using GPU from model serving.
I stopped using it for some months and when I tried again deploying it, it has some errors.
1. [FIXED] A dependency error because it was changed since that time, I added this dependency and fixed it:
huggingface_hub==0.23.2
2. When i'm deploying it i get this error and it stops the deploy and update:
An error occurred while loading the model: Exceeded maximum wait time of 300 seconds to load the model
I ask, is there an environment variable to change the timeout of 300 seconds?, I tried adding these variables:
Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2024 04:37 PM
Hi @TinSlim,
There looks to be an issue introducing the timeout of the model. What is the name of the model and the cloud region where it was deployed to validate our backend logs?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-09-2024 06:24 PM
Hi @Alberto_Umana, thanks,
I sent you the information via message
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-10-2024 11:44 AM
Thanks, I will review it and get back. I'll DIM you.