I wanted to query a MySQL Table using Databricks rather than reading the complete data using a dbtable option, which will help in incremental loads.
remote_table = (spark.read
.format("jdbc")
.option("driver", driver)
.option("url", URL)
.option("query", query)
.option("user", user)
.option("password", password)
.load()
)
Kindly let me know if there is some way to pass a query like
SELECT * FROM table_name WHERE last_modified_date > 'yyyy-mm-dd';
Regards,
Swapnil
