Hi @bi_123 , before changing compute configurations, I would first try to narrow down where the memory pressure is coming from. With only ~593K rows, the issue is likely not the row count alone, but the width/depth of the nested struct columns or ho...
Hi @jayshan , you're right that it doesn't show up in the Experiments tab. It's accessed through the databricks_genai SDK directly from a notebook. The Experiments tab will only show your run after you launch one via the SDK.I just ran it in my works...
Hi @SantiNath_Dey Databricks jobs/workflows handle orchestration be only for status alerts(Success, Failure, Completion), Delta table data can't be send as content of the email, To send delta table as an email you will need a workflow task that reads...
Hi @jayshan, you're right the material is outdated now. The more current path is Foundation Model Fine-tuning, which is part of Mosaic AI Model Training. You can run it from the Databricks UI or with the databricks_genai SDK, point it at training dat...
