New to Spark

[Anku_]

Hi all,

I am new to Spark, trying to write below code but getting an error.

Code:

df1 = df.filter(df.col1 > 60 and df.col2 != 'abc')

Any suggestion?

[Kaniz_Fatma · Accepted solution]

Hi @Anku_ , use this instead :-

df1 = df.filter((df.col1 > 60) & (df.col2 != 'abc'))