topic Re: Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct in Machine Learning

Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

enkefalos-commu — Sat, 27 Apr 2024 07:11:48 GMT

#20 69.92 ERROR: Could not find a version that satisfies the requirement transformers==4.41.0.dev0 (from versions: 0.1, 2.0.0, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.9.1, 2.10.0, 2.11.0, 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.2.0, 3.3.0, 3.3.1, 3.4.0, 3.5.0, 3.5.1, 4.0.0rc1, 4.0.0, 4.0.1, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0rc1, 4.3.0, 4.3.1, 4.3.2, 4.3.3, 4.4.0, 4.4.1, 4.4.2, 4.5.0, 4.5.1, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.9.1, 4.9.2, 4.10.0, 4.10.1, 4.10.2, 4.10.3, 4.11.0, 4.11.1, 4.11.2, 4.11.3, 4.12.0, 4.12.1, 4.12.2, 4.12.3, 4.12.4, 4.12.5, 4.13.0, 4.14.0, 4.14.1, 4.15.0, 4.16.0, 4.16.1, 4.16.2, 4.17.0, 4.18.0, 4.19.0, 4.19.1, 4.19.2, 4.19.3, 4.19.4, 4.20.0, 4.20.1, 4.21.0, 4.21.1, 4.21.2, 4.21.3, 4.22.0, 4.22.1, 4.22.2, 4.23.0, 4.23.1, 4.24.0, 4.25.0, 4.25.1, 4.26.0, 4.26.1, 4.27.0, 4.27.1, 4.27.2, 4.27.3, 4.27.4, 4.28.0, 4.28.1, 4.29.0, 4.29.1, 4.29.2, 4.30.0, 4.30.1, 4.30.2, 4.31.0, 4.32.0, 4.32.1, 4.33.0, 4.33.1, 4.33.2, 4.33.3, 4.34.0, 4.34.1, 4.35.0, 4.35.1, 4.35.2, 4.36.0, 4.36.1, 4.36.2, 4.37.0, 4.37.1, 4.37.2, 4.38.0, 4.38.1, 4.38.2, 4.39.0, 4.39.1, 4.39.2, 4.39.3, 4.40.0, 4.40.1)
#20 69.92 ERROR: No matching distribution found for transformers==4.41.0.dev0

Re: Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

enkefalos-commu — Tue, 30 Apr 2024 05:39:18 GMT

Hi @Retired_mod ,

We already tried following things:

1. I am using python version 3.10.12

2. When I download transformers using below link, it downloading `transformers==4.41.0.dev0`

pip install git+https://github.com/huggingface/transformers

3. When I use the lower (other than 4.41.0.dev0) versions of transformers it is giving below error, while registering the model using MLflow:

`AttributeError: module transformers has no attribute Phi3ForCausalLM`

Re: Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

Kumaran — Tue, 30 Apr 2024 19:01:11 GMT

Hi @enkefalos-commu

Thank you for contacting Databricks community support!

Can you let me know what mlflow version are you installing?

Re: Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

enkefalos-commu — Sat, 04 May 2024 05:07:05 GMT

@Kumaran I used latest one 2.12.1