cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Unable to create serving endpoint for the huggingface model phi-3-mini-128k-instruct

enkefalos-commu
New Contributor III

#20 69.92 ERROR: Could not find a version that satisfies the requirement transformers==4.41.0.dev0 (from versions: 0.1, 2.0.0, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.9.1, 2.10.0, 2.11.0, 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.2.0, 3.3.0, 3.3.1, 3.4.0, 3.5.0, 3.5.1, 4.0.0rc1, 4.0.0, 4.0.1, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0rc1, 4.3.0, 4.3.1, 4.3.2, 4.3.3, 4.4.0, 4.4.1, 4.4.2, 4.5.0, 4.5.1, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.9.1, 4.9.2, 4.10.0, 4.10.1, 4.10.2, 4.10.3, 4.11.0, 4.11.1, 4.11.2, 4.11.3, 4.12.0, 4.12.1, 4.12.2, 4.12.3, 4.12.4, 4.12.5, 4.13.0, 4.14.0, 4.14.1, 4.15.0, 4.16.0, 4.16.1, 4.16.2, 4.17.0, 4.18.0, 4.19.0, 4.19.1, 4.19.2, 4.19.3, 4.19.4, 4.20.0, 4.20.1, 4.21.0, 4.21.1, 4.21.2, 4.21.3, 4.22.0, 4.22.1, 4.22.2, 4.23.0, 4.23.1, 4.24.0, 4.25.0, 4.25.1, 4.26.0, 4.26.1, 4.27.0, 4.27.1, 4.27.2, 4.27.3, 4.27.4, 4.28.0, 4.28.1, 4.29.0, 4.29.1, 4.29.2, 4.30.0, 4.30.1, 4.30.2, 4.31.0, 4.32.0, 4.32.1, 4.33.0, 4.33.1, 4.33.2, 4.33.3, 4.34.0, 4.34.1, 4.35.0, 4.35.1, 4.35.2, 4.36.0, 4.36.1, 4.36.2, 4.37.0, 4.37.1, 4.37.2, 4.38.0, 4.38.1, 4.38.2, 4.39.0, 4.39.1, 4.39.2, 4.39.3, 4.40.0, 4.40.1)
#20 69.92 ERROR: No matching distribution found for transformers==4.41.0.dev0

4 REPLIES 4

Kaniz
Community Manager
Community Manager

Hi @enkefalos-commu , I apologize for the inconvenience you’re facing.

Let’s troubleshoot this issue together.

Here are some steps you can take:

  1. Check Your Python Environment: Ensure that you are using a compatible Python environmentTransformers is tested on Python 3.6+1. If you’re not using a virtual environment, consider creating one to isolate your dependencies.

  2. Installation from Hugging Face GitHub: You can try installing the specific version of transformers directly from the Hugging Face GitHub repository using the following command:

    pip install git+https://github.com/huggingface/transformers
    
  3. Reload the Module: If you’ve already installed a different version of transformers, you can attempt to reload the module using importlib.reload. Here’s an example:

    import importlib
    importlib.reload(transformers)
    print(sys.modules['transformers'].__version__)
    
  4. Check Available Versions: If you’re specifically looking for version 4.41.0.dev0, it might not be directly available. When new releases happen (e.g., v4.40.1), all commits on the main branch are associated with the next stable minor version (e.g., 4.41.0). If you need a specific dev version, it could be from any commit between the previous stable release ...2.

Feel free to try these steps, and let me know if you encounter any further issues! 😊

 

enkefalos-commu
New Contributor III

Hi @Kaniz ,

We already tried following things:

1. I am using python version 3.10.12

2. When I download transformers using below link, it downloading `transformers==4.41.0.dev0`

pip install git+https://github.com/huggingface/transformers 

3. When I use the lower (other than 4.41.0.dev0) versions of transformers it is giving below error, while registering the model using MLflow:

     `AttributeError: module transformers has no attribute Phi3ForCausalLM`

Kumaran
Valued Contributor III
Valued Contributor III

Hi @enkefalos-commu 

Thank you for contacting Databricks community support!

Can you let me know what mlflow version are you installing?

enkefalos-commu
New Contributor III

@Kumaran I used latest one 2.12.1

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!