pyspark.sql.functions.
forall
Returns whether a predicate holds for every element in the array.
col – name of column or expression
f – an function (x: Column) -> Column: ... returning the Boolean expression. Can use methods of pyspark.sql.Column, functions defined in pyspark.sql.functions and Scala UserDefinedFunctions. Python UserDefinedFunctions are not supported (SPARK-27052).
(x: Column) -> Column: ...
pyspark.sql.Column
pyspark.sql.functions
UserDefinedFunctions
a pyspark.sql.Column
>>> df = spark.createDataFrame( ... [(1, ["bar"]), (2, ["foo", "bar"]), (3, ["foobar", "foo"])], ... ("key", "values") ... ) >>> df.select(forall("values", lambda x: x.rlike("foo")).alias("all_foo")).show() +-------+ |all_foo| +-------+ | false| | false| | true| +-------+
New in version 3.1.