Column level and table level tagging in dlt pipeline

ashraf1395 — Fri, 29 Nov 2024 14:59:50 GMT

Can i set column level and table level tags programmatically in a dlt pipeline. I tried it the normal way using
spark.sql(f"alter table and set tags (key=value)") using this syntax I found it out in one of the databricks community post. But can we do it in dlt bcz when I tried I was getting not allowed dltpython API doesn't support this.

Re: Column level and table level tagging in dlt pipeline

julie598doyle — Sat, 30 Nov 2024 10:12:26 GMT

@ashraf1395 wrote:
Can i set column level and table level tags programmatically in a dlt pipeline. I tried it the normal way using
spark.sql(f"alter table and set tags (key=value)") using this syntax I found it out in one of the databricks community post. But can we do it in dlt bcz when I tried I was getting not allowed dltpython API doesn't support this.

Hello @ashraf1395,
Currently, setting column and table level tags programmatically in a DLT pipeline using the dltpython API isn't supported. You might need to use Databricks SQL commands outside of the DLT pipeline for this task.

Best Regards,
Julie Doyle

topic Column level and table level tagging in dlt pipeline in Data Engineering

Column level and table level tagging in dlt pipeline

Re: Column level and table level tagging in dlt pipeline