https://community.databricks.com/t5/data-engineering/gateway-create-route-for-open-source-models/m-p/50659#M28856 <P>Am I able to use gateway.create_route in mlflow for open source LLM models?</P><P>I'm aware of the syntax for propietary models like for openAI:</P><P>&nbsp;</P><LI-CODE lang="markup">from mlflow import gateway gateway.create_route( name=OpenAI_embeddings_route_name, route_type="llm/v1/embeddings", model={ "name": "text-embedding-ada-002", "provider": "openai", "openai_config": { "openai_api_key": OpenAI_key, } } )</LI-CODE><P>&nbsp;</P><P>Can I use it for open source models without api keys?</P><P>Any examples?</P> Wed, 08 Nov 2023 14:54:20 GMT MichaelO 2023-11-08T14:54:20Z https://community.databricks.com/t5/data-engineering/gateway-create-route-for-open-source-models/m-p/50659#M28856 <P>Am I able to use gateway.create_route in mlflow for open source LLM models?</P><P>I'm aware of the syntax for propietary models like for openAI:</P><P>&nbsp;</P><LI-CODE lang="markup">from mlflow import gateway gateway.create_route( name=OpenAI_embeddings_route_name, route_type="llm/v1/embeddings", model={ "name": "text-embedding-ada-002", "provider": "openai", "openai_config": { "openai_api_key": OpenAI_key, } } )</LI-CODE><P>&nbsp;</P><P>Can I use it for open source models without api keys?</P><P>Any examples?</P> Wed, 08 Nov 2023 14:54:20 GMT https://community.databricks.com/t5/data-engineering/gateway-create-route-for-open-source-models/m-p/50659#M28856 MichaelO 2023-11-08T14:54:20Z