Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-14-2023 03:53 AM
First I would recommend using a multiline f-string in spark.sql like this...
spark.sql(f'''
insert into default.batch_run
(
task_name,
start,
end,
status
) values (
{param_task_name},
{param_start},
NULL,
{param_status}
''')There are other options I havent tried if NULL doesnt work like
Noneor
lit(None)Let me know which works for you 🙂