What’s your favorite announcement from Databricks summit 2024? ... View more

I have a general question regarding how the table in Databricks changes when we change the underlying data file in S3. For example, if I convert multiple folders that are defined by dates in a single folder into parquet by using the following code: CONVERT TO DELTA parquet.`s3://example_bucket/test_1/` PARTITIONED BY (report_date DATE) and then create a table on an external location using the code: CREATE TABLE test_catalog.test_schema.test_1 USING DELTA LOCATION 's3://example_bucket/test_1/' If I then add a new folder to that same location, how to do we make the table in Databricks update as well? ... View more

How to decide when to go for RAG vs CPT? If we go with CPT and if the training documents change, it is okay to take the CPT model and apply RAG on top of it? Will it unlearn previous information? ... View more

  Is there way to apply custom masking to assets shared via delta sharing?     ... View more