Hi @Automation-path, you can automate data categorisation using the OpenAI API. Databricks provides a built-in SQL function ai_generate_text()that allows you to access large language models (LLMs) like OpenAI directly from SQL. This function can be used for various tasks, including data categorisation. To automate data categorisation, you need to:
1. Set up the ai_generate_text() function with the necessary authentication credentials.
2. Use the function in your SQL queries to generate text based on your data.
3. Analyze the generated text to categorize your data.
