Re: how to use databricks foundation models outsid... - Databricks Community

Are you perhaps talking about Model Serving ?

https://docs.databricks.com/en/machine-learning/model-serving/index.html#requirements

This is how you configure it

https://docs.databricks.com/en/machine-learning/model-serving/create-manage-serving-endpoints.html

This is how you use it via REST API

https://docs.databricks.com/en/machine-learning/model-serving/score-model-serving-endpoints.html#cha...

NOTE - you will use cluster - Serverless for model serving - that will allow you to make online scoring