cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Using generative AI to generate descriptions

monke64
New Contributor

Hi all, I would like to check if there is a function in databricks notebook that allows users to get AI generated descriptions of dataframes within the session similar to the AI generated descriptions for tables? This is because I am wondering it it would be possible to iteratively go through multiple dataframes to generate and store their descriptions. Any help would be much appreciated.

1 REPLY 1

vikasgautam
Databricks Employee
Databricks Employee

You can use ai_query function to achieve this in SQL. It takes an LLM endpoint and a prompt as input.

Here's an example with DBRX and a specific Indian manufacturing industry-related prompt.

create
or replace function ai_create_table_metadata (table_name STRING) returns string return ai_query(
'databricks-dbrx-instruct',
CONCAT(
'Generate a short business description for the below table name in the context of the Indian Manufacturing Industry:: ',
table_name ));

select
table_name,
ai_create_table_metadata(table_name) as table_desc
from
system.information_schema.tables
where
table_name = 'your_table_name';

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group