Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-05-2026 08:39 PM
The code :
import dlt
from pyspark.sql.functions import col
@dlt.table(
name="silver_customers",
comment="Cleaned customers data from bronze"
)
@dlt.expect("valid_email", "email IS NOT NULL")
@dlt.expect("valid_customer_id", "customer_id IS NOT NULL")
def silver_customers():
return (
spark.read.table("bronze.demo.customers")
.dropDuplicates(["customer_id"])
.select(
"customer_id",
"name",
"email"
)
) and the UI i have
this table run incrementally?
Can some one confirm this ?
Labels:
- Labels:
-
Delta Lake
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-05-2026 10:32 PM
@helius_205 I doubt, do check the execution mode ~ should be triggered. Also it's a normal read instead of readStream. Read Docs for better understanding.
