pyspark.sql.streaming.StreamingQueryManager

class pyspark.sql.streaming.StreamingQueryManager(jsqm)[source]

A class to manage all the StreamingQuery StreamingQueries active.

Note

Evolving

New in version 2.0.

__init__(jsqm)[source]

Initialize self. See help(type(self)) for accurate signature.

Methods

__init__(jsqm)

Initialize self.

awaitAnyTermination([timeout])

Wait until any of the queries on the associated SQLContext has terminated since the creation of the context, or since resetTerminated() was called.

get(id)

Returns an active query from this SQLContext or throws exception if an active query with this name doesn’t exist.

resetTerminated()

Forget about past terminated queries so that awaitAnyTermination() can be used again to wait for new terminations.

Attributes

active

Returns a list of active queries associated with this SQLContext