Schema enforcement from External Location

Dp15 — Fri, 02 Feb 2024 18:18:22 GMT

Hi,
This might be a silly question to ask but is it possible to enforce schema on a table created from external location, I am trying to create a table from a s3 location and my command looks like this

query = """CREATE TABLE IF NOT EXISTS {}
           USING PARQUET 
           LOCATION '{}'""".format(raw_table,s3_bucket_location)

but I am not happy with the schema it infers from the parquet, Is there a way I can enforce schema on this table by changing some column types ? I tried by add the
options ( schema = <schema_definition> ) to the create command, that didnt work.

Re: Schema enforcement from External Location

feiyun0112 — Sat, 03 Feb 2024 03:33:43 GMT

define columns when create table

https://community.databricks.com/t5/data-engineering/external-table-from-parquet-partition/td-p/24689

topic Re: Schema enforcement from External Location in Data Governance

Schema enforcement from External Location

Re: Schema enforcement from External Location