topic How to do python within sql query in Databricks ? in Data Engineering

How to do python within sql query in Databricks ?

Yagao — Tue, 28 Jun 2022 22:52:09 GMT

Can anyone show me one use case how to do python within sql query ?

Re: How to do python within sql query in Databricks ?

Anonymous — Wed, 06 Jul 2022 11:39:33 GMT

Did you get any solution? My Nordstrom Employee Portal

Re: How to do python within sql query in Databricks ?

Anonymous — Wed, 06 Jul 2022 22:58:17 GMT

Hi @Ya Gao and @Brooks foster ! It seems like maybe you two are experiencing a similar need? I would love to know more about what you are trying to solve for - please comment below! And of course if you have made any progress since you posted, definitely let us know.

In the meantime I am going to try and find a Databricks expert who has used Python in a SQL query for you!

Re: How to do python within sql query in Databricks ?

Dicer — Sat, 09 Jul 2022 16:50:56 GMT

spark.sql("select <Your Coumn> from <Your Table> ")

Re: How to do python within sql query in Databricks ?

tomasz — Tue, 12 Jul 2022 22:20:58 GMT

To run Python within a SQL query you have to first define a Python function and then register it as a UDF. Once that is done you are able to call that UDF within a SQL query. Please take a look at this documentation here:

https://docs.databricks.com/spark/latest/spark-sql/udf-python.html#register-a-function-as-a-udf

Re: How to do python within sql query in Databricks ?

jose_gonzalez — Fri, 29 Jul 2022 23:12:31 GMT

Hi @Ya Gao,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.