Databricks Community

saurabh18cs

Hi Databricks,our learners wants to know when are we disclosing the results of october badge challenge - learningsBr

saurabh18cs · 09-26-2025

Hello All,We have started to consume source messages/files via autoloader directory listing mode at the moment and want to convert this to file notification mode instead so consumption can be faster with no more entire directories/folder scanning. I ...

saurabh18cs

Hi @Suheb Summary Table:Method What’s Tuned Speed/Cost Flexibility Use CaseFull Fine-TuningAll model weightsSlow/HighMaximumCustom tasks, large dataLoRASmall adapter layersFast/LowHighEfficient adaptationp-tuningPrompt embeddingsFastest/LowLimitedPro...

saurabh18cs

Hi @new_user_ptl Databricks does NOT support directly registering or querying Iceberg tables that use the Hadoop catalog (where metadata is stored only as files in S3 and not registered in any metastore/catalog). when use databricks sql , registering...

saurabh18cs

Hi @a_user12 can you try with following :ALTER TABLE <table_name> SET TBLPROPERTIES ('delta.minReaderVersion' = '2', 'delta.minWriterVersion' = '5', 'delta.columnMapping.mode' = 'name', 'delta.schema.autoMerge.enabled' = 'false');

saurabh18cs

Hi @Coffee77 In my case, no sense to store directly semi-structured data directly in delta tables.?? even if someone is storing semi-structured data directly in delta table , how is he/she storing? parsing whole file into a single column cell?

saurabh18cs

Hi @DatabricksUser5 also look for eventhub retention policies for example if your eventhub retention is set to 7 days which means those events older than 7 days which you are trying to re-process are already doesn't exist in eventhub so no matter wha...

Databricks Community

User Stats

User Activity

Results of october badge challenge - Partner Learning

Autoloader - File Notification Mode

Re: What is the difference between full fine-tuning, LoRA, and p-tuning on Databricks?

Re: Create external table using iceberg not working

Re: Declarative Pipelines: set Merge Schema to False

Re: Archive of legacy system into Databricks with structure and semi-structured data

Re: Reset committed offset of spark streaming to capture missed data