topic Re: SQL CONTAINS Function is not working on Databricks in Data Engineering

SQL CONTAINS Function is not working on Databricks

Prasann_gupta — Fri, 10 Mar 2023 06:40:52 GMT

I am trying to use sql CONTAINS function in my sql query but it is throwing the below error :

AnalysisException: Undefined function: 'CONTAINS'. This function is neither a registered temporary function nor a permanent function registered in the database 'default'.; line 14 pos

Re: SQL CONTAINS Function is not working on Databricks

pvignesh92 — Fri, 10 Mar 2023 08:53:02 GMT

In Spark SQL, the CONTAINS function is not a built-in function.

As an alternative, you can use the below inbuilt functions

LIKE function can be used to check whether a string contains a specific substring. The syntax is as follows:

Sample Code

SELECT * FROM table_name
WHERE column_name LIKE '%substring%'

INSTR function can be used to find the position of a substring within a string. If the substring is not found, the function returns 0. The syntax is as follows:

SELECT * FROM table_name WHERE INSTR(column_name, 'substring') > 0

Or the good old Regex

SELECT * FROM table_name
WHERE column_name RLIKE 'regexp_pattern'

Please let me know if this helps.

Re: SQL CONTAINS Function is not working on Databricks

Lakshay — Fri, 10 Mar 2023 12:38:33 GMT

Hi @Prasann Gupta , Spark sql does not have CONTAINS as a built in function. The best option here would be to use LIKE function.

Re: SQL CONTAINS Function is not working on Databricks

Anonymous — Sat, 01 Apr 2023 00:47:41 GMT

Hi @Prasann Gupta

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!