Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

[enkefalos-commu]

#20 69.92 ERROR: Could not find a version that satisfies the requirement transformers==4.41.0.dev0 (from versions: 0.1, 2.0.0, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.9.1, 2.10.0, 2.11.0, 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.2.0, 3.3.0, 3.3.1, 3.4.0, 3.5.0, 3.5.1, 4.0.0rc1, 4.0.0, 4.0.1, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0rc1, 4.3.0, 4.3.1, 4.3.2, 4.3.3, 4.4.0, 4.4.1, 4.4.2, 4.5.0, 4.5.1, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.9.1, 4.9.2, 4.10.0, 4.10.1, 4.10.2, 4.10.3, 4.11.0, 4.11.1, 4.11.2, 4.11.3, 4.12.0, 4.12.1, 4.12.2, 4.12.3, 4.12.4, 4.12.5, 4.13.0, 4.14.0, 4.14.1, 4.15.0, 4.16.0, 4.16.1, 4.16.2, 4.17.0, 4.18.0, 4.19.0, 4.19.1, 4.19.2, 4.19.3, 4.19.4, 4.20.0, 4.20.1, 4.21.0, 4.21.1, 4.21.2, 4.21.3, 4.22.0, 4.22.1, 4.22.2, 4.23.0, 4.23.1, 4.24.0, 4.25.0, 4.25.1, 4.26.0, 4.26.1, 4.27.0, 4.27.1, 4.27.2, 4.27.3, 4.27.4, 4.28.0, 4.28.1, 4.29.0, 4.29.1, 4.29.2, 4.30.0, 4.30.1, 4.30.2, 4.31.0, 4.32.0, 4.32.1, 4.33.0, 4.33.1, 4.33.2, 4.33.3, 4.34.0, 4.34.1, 4.35.0, 4.35.1, 4.35.2, 4.36.0, 4.36.1, 4.36.2, 4.37.0, 4.37.1, 4.37.2, 4.38.0, 4.38.1, 4.38.2, 4.39.0, 4.39.1, 4.39.2, 4.39.3, 4.40.0, 4.40.1)
#20 69.92 ERROR: No matching distribution found for transformers==4.41.0.dev0

[Kaniz_Fatma]

Hi @enkefalos-commu , I apologize for the inconvenience you’re facing.

Let’s troubleshoot this issue together.

Here are some steps you can take:

1. Check Your Python Environment: Ensure that you are using a compatible Python environmentTransformers is tested on Python 3.6+¹. If you’re not using a virtual environment, consider creating one to isolate your dependencies.

2. Installation from Hugging Face GitHub: You can try installing the specific version of transformers directly from the Hugging Face GitHub repository using the following command:

   pip install git+https://github.com/huggingface/transformers
   

3. Reload the Module: If you’ve already installed a different version of transformers, you can attempt to reload the module using importlib.reload. Here’s an example:

   import importlib
   importlib.reload(transformers)
   print(sys.modules['transformers'].__version__)
   

4. Check Available Versions: If you’re specifically looking for version 4.41.0.dev0, it might not be directly available. When new releases happen (e.g., v4.40.1), all commits on the main branch are associated with the next stable minor version (e.g., 4.41.0). If you need a specific dev version, it could be from any commit between the previous stable release ...².

Feel free to try these steps, and let me know if you encounter any further issues! 😊

[enkefalos-commu]

Hi @Kaniz_Fatma ,

We already tried following things:

1. I am using python version 3.10.12

2. When I download transformers using below link, it downloading `transformers==4.41.0.dev0`

pip install git+https://github.com/huggingface/transformers 

3. When I use the lower (other than 4.41.0.dev0) versions of transformers it is giving below error, while registering the model using MLflow:

     `AttributeError: module transformers has no attribute Phi3ForCausalLM`

[Kumaran]

Hi @enkefalos-commu 

Thank you for contacting Databricks community support!

Can you let me know what mlflow version are you installing?

[enkefalos-commu]

@Kumaran I used latest one 2.12.1