Hi @Ya Gao and @Brooks foster ! It seems like maybe you two are experiencing a similar need? I would love to know more about what you are trying to solve for - please comment below! And of course if you have made any progress since you posted, definitely let us know.
In the meantime I am going to try and find a Databricks expert who has used Python in a SQL query for you!