cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columns

lizou
Contributor II

no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columns

table definition example

CREATE TABLE tyable_name (

 UniqueID bigint not null GENERATED ALWAYS AS IDENTITY , 

 ID varchar(256)

)

looks like the columns table only has basic info such as data type

-- query column info

select *

from system.information_schema.columns

where table_name ='<table>' and table_catalog ='<catalog>'

image

6 REPLIES 6

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi,

Could you please confirm on the issue here? Also, for reference: https://docs.databricks.com/data-governance/unity-catalog/migrate.html

, please let us know if this helps.

lizou
Contributor II

yes, I created a new managed table in the unity catalog, and the issues remain.

Hubert-Dudek
Esteemed Contributor III

I confirm I have the same issue with the unity catalog: schema tables are missing some information, or they are incorrect. @Prabakar Ammeappin​ @Kaniz Fatma​ @Sujitha Ramamoorthy​ maybe we can escalate to someone from Unity team

image.png

lizou
Contributor II

another issue is if a column is defined as varchar(50) as example

once a data is loaded, the full_data_type is changed to string. I tested multiple times, and looks like that's also an issue

before

imageafter data loaded with a insert statement

full_data_type is changed

imageselect column_name, full_data_type, data_type, character_maximum_length, ordinal_position, *

from system.information_schema.columns

Hubert-Dudek
Esteemed Contributor III

@Werner Stinckens​ @Christy Seto​ @Jose Gonzalez​ can you help with that issue? It is a really interesting bug and a nice feature once it will work correctly.

Adding @Kaniz Fatma​ and @Suteja Kanuri​ for visibility

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!