https://community.databricks.com/t5/machine-learning/databricks-openai-integration-issue/m-p/58029#M2889 <P>Facing challenges in leveraging Databricks for serving, logging, and monitoring OpenAI usage within an Azure environment. Specifically, encountering issues with Inference Tables not being enabled in the UI when creating serving endpoints with external providers. Implemented a workaround involving a custom PyFunc class and API calls for model registration and serving endpoint creation. Seeking insights or solutions to streamline the process and enable efficient logging and monitoring of OpenAI usage. Any guidance or expertise on this matter would be greatly appreciated</P> Sun, 21 Jan 2024 19:23:30 GMT leelee3000 2024-01-21T19:23:30Z https://community.databricks.com/t5/machine-learning/databricks-openai-integration-issue/m-p/58029#M2889 <P>Facing challenges in leveraging Databricks for serving, logging, and monitoring OpenAI usage within an Azure environment. Specifically, encountering issues with Inference Tables not being enabled in the UI when creating serving endpoints with external providers. Implemented a workaround involving a custom PyFunc class and API calls for model registration and serving endpoint creation. Seeking insights or solutions to streamline the process and enable efficient logging and monitoring of OpenAI usage. Any guidance or expertise on this matter would be greatly appreciated</P> Sun, 21 Jan 2024 19:23:30 GMT https://community.databricks.com/t5/machine-learning/databricks-openai-integration-issue/m-p/58029#M2889 leelee3000 2024-01-21T19:23:30Z https://community.databricks.com/t5/machine-learning/databricks-openai-integration-issue/m-p/58051#M2893 <P>Hi, In addition to the previous message, you can refer to&nbsp;<A href="https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-generate-text-example" target="_blank">https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-generate-text-example</A>.&nbsp;</P> Mon, 22 Jan 2024 06:56:09 GMT https://community.databricks.com/t5/machine-learning/databricks-openai-integration-issue/m-p/58051#M2893 Debayan 2024-01-22T06:56:09Z