aicd_de
New Contributor III

            spark.sql("DROP TABLE "+prefix_updates)

            spark.sql("DROP TABLE "+prefix_main)

Fixed it for me.

View solution in original post