Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-28-2021 03:25 PM
@Bartosz Wachocki ,
Use timeout, retry interval ,recursion and exception handling
pseudo code below
timeout = 300
def exec_query(query,timeout):
try:
df = spark.createDataFrame(sf.bulk.MyTable.query(query))
except:
if timeout > 0 :
sleep(60)
exec_query(query)
timeout = timeout - 60
else:
print("Timeout")
break;