saurabh18cs
Honored Contributor III
In response to gkapri

‎02-09-2026 12:54 AM

Hi @gkapri  can you do this for DLT pipelines? for DLT we need a ccomplile time SQL literal not runtime literal 🙂

def filter_latest_records(df, timing_column="processing_date"):
    return df.filter(
        col(timing_column) >= expr("date_sub(current_date(), 1)")
    )

@gkapri

0 Kudos