12-31-2022 11:13 AM
no information on character_maximum_length and is_identity in unity catalog table system.information_schema.columns
table definition example
CREATE TABLE tyable_name (
UniqueID bigint not null GENERATED ALWAYS AS IDENTITY ,
ID varchar(256)
)
looks like the columns table only has basic info such as data type
-- query column info
select *
from system.information_schema.columns
where table_name ='<table>' and table_catalog ='<catalog>'
01-02-2023 09:36 AM
Hi,
Could you please confirm on the issue here? Also, for reference: https://docs.databricks.com/data-governance/unity-catalog/migrate.html
, please let us know if this helps.
01-03-2023 05:30 AM
yes, I created a new managed table in the unity catalog, and the issues remain.
01-05-2023 05:07 AM
01-05-2023 09:52 PM
another issue is if a column is defined as varchar(50) as example
once a data is loaded, the full_data_type is changed to string. I tested multiple times, and looks like that's also an issue
before
after data loaded with a insert statement
full_data_type is changed
select column_name, full_data_type, data_type, character_maximum_length, ordinal_position, *
from system.information_schema.columns
01-06-2023 01:13 AM
@Werner Stinckens @Christy Seto @Jose Gonzalez can you help with that issue? It is a really interesting bug and a nice feature once it will work correctly.
04-06-2023 11:21 AM
Adding @Kaniz Fatma and @Suteja Kanuri for visibility
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.