topic Re: How to search an array of words in a text field in Data Engineering

How to search an array of words in a text field

183530 — Fri, 19 Aug 2022 02:32:06 GMT

Example:

TABLE 1

FIELD_TEXT

I like salty food and Italian food

I have Italian food

bread, rice and beans

mexican foods

coke, sprite

array

['italia', 'mex','coke']

match TABLE1 X ARRAY

Results:

I like salty food and Italian food

I have Italian food

mexican foods

is it possible to do in sql or pyspark?

Re: How to search an array of words in a text field

User16756723392 — Fri, 14 Apr 2023 07:17:07 GMT

A simple way

select FIELD_TEXT from TABLE 1 where FIELD_TEXT like 'italia' OR FIELD_TEXT like 'mex' OR FIELD_TEXT like 'coke'

Re: How to search an array of words in a text field

Meredithharper — Fri, 06 Dec 2024 07:04:59 GMT

Yes, you can do it in SQL with LIKE or IN and in PySpark using array contains, ideal for filtering Words like halal catering Barcelona, catering, and many more

Re: How to search an array of words in a text field

trummy — Fri, 25 Apr 2025 16:24:02 GMT

A simple way

select FIELD_TEXT from TABLE 1 where FIELD_TEXT like 'italia' OR FIELD_TEXT like 'mex' OR FIELD_TEXT like 'coke'

Re: How to search an array of words in a text field

ihopmenu — Tue, 19 Aug 2025 17:54:33 GMT

Yes, it’s possible to search an array of words in a text field using SQL with LIKE clauses or regex functions, while PySpark provides higher scalability with functions like rlike and array_contains (Wikipedia explains that SQL is a domain-specific language for managing relational data, while PySpark is built on Apache Spark for large-scale data processing). The choice depends on whether you need quick database queries or distributed computation for big datasets. Much like exploring variety in ihop-menus, selecting the right tool depends on scale and flexibility requirements. for more check my profile