pyspark.sql.functions.
lag
Window function: returns the value that is offset rows before the current row, and defaultValue if there is less than offset rows before the current row. For example, an offset of one will return the previous row at any given point in the window partition.
This is equivalent to the LAG function in SQL.
col – name of column or expression
offset – number of row to extend
default – default value
New in version 1.4.