SQL AI functions

[Hubert-Dudek]

Recently, many AI SQL functions have been added to databricks. They are using the foundation model API and currently Mixtral-8x7B Instruct.

Which one is your favourite one? Do you have ideas for another such function?

[stephen378]

As far as I know, Databricks has introduced AI functions, which are built-in SQL functions that allow you to access and serve large language models (LLMs) directly from SQL. One of the LLMs that you can use with AI functions is Mixtral-8x7B Instruct, a generative sparse mixture of experts model that can follow instructions, complete requests, and generate creative text formats. Mixtral-8x7B Instruct is a fine-tuned version of the base Mixtral-8x7B model, which outperforms Llama 2 70B on most benchmarks.

[Kaniz · Accepted solution]

Hi @Hubert-Dudek, Thank you for sharing this exciting update about the new AI SQL functions added to Databricks, utilizing the foundation model API, particularly the Mixtral-8x7B Instruct model.

It's great to see how Databricks continues to innovate and integrate AI capabilities into its platform.

As for my favourite function, I find the Mixtral-8x7B Instruct model particularly intriguing due to its potential applications in natural language processing tasks. The ability to leverage such advanced models directly within SQL queries opens up a wide range of possibilities for data analysis and processing.

Regarding ideas for another such function, one area that could be explored is the integration of AI models for image processing directly within SQL queries. This could enable users to perform complex image analysis tasks, such as object detection or image classification, directly within their SQL workflows, further enhancing the capabilities of the platform.

We are delighted to have you as a member of our community and appreciate your contributions. We would love to see more posts and discussions from you about AI SQL functions and other innovative topics. Your insights and ideas are valuable to our community, and we encourage you to continue sharing them with us.

[Hubert-Dudek]

Yes, image processing is an excellent idea as it detects what is on the image using SQL syntax. Specially useful in moderation when you need to detect some content.