topic Re: Agent Bricks Information Extraction in Generative AI

Agent Bricks Information Extraction

Yash01Kumar12 — Fri, 10 Oct 2025 17:34:59 GMT

I am facing some problem in Information extraction using PDF. I have done all the necessary steps.

1) I loaded the data in Volume.
2) I ran the Use PDF's functionality to create a structure table of the PDFs

3) I now have the table with the column names:

path -> string
raw_parsed -> variant

text string ->

error_status -> string

I am experiencing a problem while directly creating a Vector Search Index from this:

Any reason why this is happening.

Second, facing problems in creating Information Extraction Agent, the error I am facing is

Requesting you to help me in understand what wrong I am doing throughout this process.

1) Databricks workspace region: East US 2 (Azure) it is also correct s per documentation

2) Able to use ai_query()

Re: Agent Bricks Information Extraction

NandiniN — Fri, 10 Oct 2025 22:21:02 GMT

Hi @Yash01Kumar12

1. For the Index creation failure: Invalid column type - variant is used for 'raw_parsed'.

The indexing mechanism, does not support the VARIANT data type for columns that need to be indexed. It only supports specific types like various numeric types, strings, timestamps, and arrays of numeric types (for vector embeddings).

While Variant data type is Public Preview, I see an internal feature request "DB-I-14338" to support Variant data type for Vector search. So, I suspect you would have to change the data type to proceed right now. I have added your usecase as well and a proxy vote.

In delta table, you would have to use the below code to support it. But I do not think this would still help as it has to be supported in Vector Search.

ALTER TABLE table_name SET TBLPROPERTIES('delta.feature.variantType-preview' = 'supported')

So, for now, can you use a different data type for the column which is supported today?

Thanks & Regards,

Nandini

Re: Agent Bricks Information Extraction

NandiniN — Fri, 10 Oct 2025 22:26:22 GMT

For the issue 2:

INVALID_PARAMETER_VALUE: Couldn't find enough valid rows in the selected table. Found 0 rows, minimum required is 1 for agent creation.

Since the previous step was failing due to a data type issue (VARIANT), it's highly likely that the entire table is being marked as invalid or unusable by the Agent framework's sampling mechanism.

Re: Agent Bricks Information Extraction

Yash01Kumar12 — Sun, 12 Oct 2025 16:04:54 GMT

Thank You @NandiniN for responding. For now, I have changed the type of "raw_parsed" to string and created a vector index after that.

But can you help me with one more thing. I am creating a Multi-Agent-Supervisor, can you explain me the need of OBO User Authentication please and where I can find this and enable, in the documentation I understood that it will use the resource like Vector Search and will authenticate using this, but why is the case when I am doing all the stuff in my Databricks UI?