Identity column in DLT using Python

kskistad — Thu, 15 Dec 2022 01:31:27 GMT

How would I implement the Identity column in Delta Live Tables using Python syntax?

GENERATED { ALWAYS | BY DEFAULT } AS IDENTITY [ ( [ START WITH start ] [ INCREMENT BY step ] ) ]

Re: Identity column in DLT using Python

LaurentLeturgez — Thu, 15 Dec 2022 11:12:50 GMT

Hi @Kory Skistad

Please find below the table schema definition to use in a python dlt pipeline. You can see it mentions the identity column definition.

@dlt.table(

comment="Raw data on sales",

schema="""

customer_id STRING,

customer_name STRING,

number_of_line_items STRING,

order_datetime STRING,

order_number LONG,

order_day_of_week STRING GENERATED ALWAYS AS (dayofweek(order_datetime))

""",

partition_cols = ["order_day_of_week"])

def sales():

return ("...")

HTH

Laurent