Hello,I need to schedule some of my jobs within Databricks Workflow every other week (or every 4 weeks). I've scoured a few forums for find what this notation would be, but I've been unfruitful in my searches.Is this scheduling possible in crontab? I...
I had been trying to upsert rows into a table in Azure Blob Storage (ADLS Gen 2) based on two partitions (sample code below). insert overwrite table new_clicks_table partition(client_id, mm_date)
select
click_id
,user_id
,click_timestamp_gmt
,ca...
Hi Pat,That worked! Thanks so much for the easy to implement tip.Is there a way for me to add that snippet to my Spark Config instead of having to put it in every single query I run?Best wishes,Netty
