cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Schema enforcement from External Location

Dp15
Contributor

Hi, 
This might be a silly question to ask but is it possible to enforce schema on a table created from external location, I am trying to create a table from a s3 location and my command looks like this


query = """CREATE TABLE IF NOT EXISTS {}
USING PARQUET
LOCATION '{}'""".format(raw_table,s3_bucket_location)

but I am not happy with the schema it infers from the parquet, Is there a way I can enforce schema on this table by changing some column types ? I tried by add the 
options ( schema = <schema_definition> ) to the create command, that didnt work.

1 ACCEPTED SOLUTION

Accepted Solutions

feiyun0112
Contributor III
2 REPLIES 2

feiyun0112
Contributor III

Kaniz_Fatma
Community Manager
Community Manager

I want to express my gratitude for your effort in selecting the most suitable solution. It's great to hear that your query has been successfully resolved. Thank you for your contribution.




 

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!