cancel
Showing results for 
Search instead for 
Did you mean: 
surajitDE
New Contributor III
since ‎10-11-2024
3 weeks ago

User Stats

  • 12 Posts
  • 0 Solutions
  • 2 Kudos given
  • 0 Kudos received

User Activity

Hi folks,During the recent Data + AI Summit, there was a mention of a new real-time streaming mode in Delta Live Tables (DLT) that enables sub-300 millisecond latency. This sounds really promising!Could someone please guide me on:How do we enable thi...
Hi folks,How to change streaming table/column description in DLT during run time like we do for delta tables because ALTER STREAMING table isn't working.eg:COMMENT ON COLUMN ops_catalog_gld_dev.schema_silver.table_name.property_sid IS 'The key of the...
My DLT jobs are experiencing throttling due to the following error message:[GC (GCLocker Initiated GC) [PSYoungGen: 5431990K->102912K(5643264K)] 9035507K->3742053K(17431552K), 0.1463381 secs] [Times: user=0.29 sys=0.00, real=0.14 secs]I came across s...
@dlt.tabledef joined_table():    dim_df = spark.read.table("dim_table")  # Reloads every batch    fact_df = spark.readStream.table("fact_stream")    return fact_df.join(dim_df, "id", "left")
I have a use case where in there is a DLT pipeline in continuous mode, the requirement is to run this pipeline on scheduled basis i.e everyday it starts at 8am and stops at 8pm. I see a schedule option to start the job but don't see any option to sto...
Kudos given to