cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Schema enforcement from External Location

Dp15
Contributor

Hi, 
This might be a silly question to ask but is it possible to enforce schema on a table created from external location, I am trying to create a table from a s3 location and my command looks like this


query = """CREATE TABLE IF NOT EXISTS {}
USING PARQUET
LOCATION '{}'""".format(raw_table,s3_bucket_location)

but I am not happy with the schema it infers from the parquet, Is there a way I can enforce schema on this table by changing some column types ? I tried by add the 
options ( schema = <schema_definition> ) to the create command, that didnt work.

1 ACCEPTED SOLUTION

Accepted Solutions
2 REPLIES 2

feiyun0112
Contributor

Kaniz
Community Manager
Community Manager

I want to express my gratitude for your effort in selecting the most suitable solution. It's great to hear that your query has been successfully resolved. Thank you for your contribution.




 

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.