conditions with select pysparl code example
Example 1: pyspark filter
>>> df.filter(df.age > 3).collect()
[Row(age=5, name='Bob')]
>>> df.where(df.age == 2).collect()
[Row(age=2, name='Alice')]
Example 2: Filters rows using the given condition
# Filters rows using the given condition
df.filter(df.age > 3).collect()
# [Row(age=5, name='Bob')]
df.where(df.age == 2).collect()
# Row(age=2, name='Alice')]
df.filter("age > 3").collect()
# [Row(age=5, name='Bob')]
df.where("age = 2").collect()
# [Row(age=2, name='Alice')]