Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-21-2024 02:52 AM - edited 06-21-2024 02:53 AM
Thank you Kaniz!
A few follow-up questions:
Could you give an example of each?
For 1. you said "define your schema with metadata", how do you this, what is the syntax for defining metadata with tags, like I said before, the following does not work:
StructField(
"columnName",
StringType(),
True,
metadata = {
'comment': "This is a comment",
'tags': {
'tag1': 'x',
'tag2': 'y',
}
}
)
For 2., again, what is the syntax? Could you provide an example? In the link you have shown, there doesn't seem to be a tags option as shown below.
@Dlt.table( name="<name>", comment="<comment>", spark_conf={"<key>" : "<value>", "<key>" : "<value>"}, table_properties={"<key>" : "<value>", "<key>" : "<value>"}, path="<storage-location-path>", partition_cols=["<partition-column>", "<partition-column>"], schema="schema-definition", temporary=False)
Also, is this available with @Dlt.append_flow too?
Thanks
