cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Retrive inforrmation about table clustering from information_schema

Mike_Szklarczyk
Contributor

Hi guys,

I wonder if and when it will be possible to extract from information_schema how the table is clustered. I know that analogous information can be obtained when a table is partitioned using this query:

 

SELECT * FROM cdl_dev.information_schema.columns 
WHERE partition_index is not null

 

 Does anyone have information on whether this will be possible?

1 ACCEPTED SOLUTION

Accepted Solutions

NandiniN
Databricks Employee
Databricks Employee

Iit is not possible to extract clustering information of a table directly from the information_schema . The information_schema.columns table can provide details about partitioning, but similar information for clustering is not available through the information_schema.

If you need clustering information, you might need to use other methods or tools provided by Databricks, such as examining the table properties or using Databricks-specific APIs.

However, I hear your requirement and it just sounds fair and I would encourage you to add a feature request here https://docs.databricks.com/en/resources/ideas.html#ideas 

View solution in original post

1 REPLY 1

NandiniN
Databricks Employee
Databricks Employee

Iit is not possible to extract clustering information of a table directly from the information_schema . The information_schema.columns table can provide details about partitioning, but similar information for clustering is not available through the information_schema.

If you need clustering information, you might need to use other methods or tools provided by Databricks, such as examining the table properties or using Databricks-specific APIs.

However, I hear your requirement and it just sounds fair and I would encourage you to add a feature request here https://docs.databricks.com/en/resources/ideas.html#ideas 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group