pyspark.sql.functions.sys

This module provides access to some objects used or maintained by the interpreter and to functions that interact strongly with the interpreter.

Dynamic objects:

argv – command line arguments; argv[0] is the script pathname if known path – module search path; path[0] is the script directory, else ‘’ modules – dictionary of loaded modules

displayhook – called to show results in an interactive session excepthook – called to handle any uncaught exception other than SystemExit

To customize printing in an interactive session or to install a custom top-level exception handler, assign other functions to replace these.

stdin – standard input file object; used by input() stdout – standard output file object; used by print() stderr – standard error object; used for error messages

By assigning other file objects (or objects that behave like files) to these, it is possible to redirect all of the interpreter’s I/O.

last_type – type of last uncaught exception last_value – value of last uncaught exception last_traceback – traceback of last uncaught exception

These three are only available in an interactive session after a traceback has been printed.

Static objects:

builtin_module_names – tuple of module names built into this interpreter copyright – copyright notice pertaining to this interpreter exec_prefix – prefix used to find the machine-specific Python library executable – absolute path of the executable binary of the Python interpreter float_info – a struct sequence with information about the float implementation. float_repr_style – string indicating the style of repr() output for floats hash_info – a struct sequence with information about the hash algorithm. hexversion – version information encoded as a single integer implementation – Python implementation information. int_info – a struct sequence with information about the int implementation. maxsize – the largest supported length of containers. maxunicode – the value of the largest Unicode code point platform – platform identifier prefix – prefix used to find the Python library thread_info – a struct sequence with information about the thread implementation. version – the version of this interpreter as a string version_info – version information as a named tuple __stdin__ – the original stdin; don’t touch! __stdout__ – the original stdout; don’t touch! __stderr__ – the original stderr; don’t touch! __displayhook__ – the original displayhook; don’t touch! __excepthook__ – the original excepthook; don’t touch!

Functions:

displayhook() – print an object to the screen, and save it in builtins._ excepthook() – print an exception and its traceback to sys.stderr exc_info() – return thread-safe information about the current exception exit() – exit the interpreter by raising SystemExit getdlopenflags() – returns flags to be used for dlopen() calls getprofile() – get the global profiling function getrefcount() – return the reference count for an object (plus one :-) getrecursionlimit() – return the max recursion depth for the interpreter getsizeof() – return the size of an object in bytes gettrace() – get the global debug tracing function setcheckinterval() – control how often the interpreter checks for events setdlopenflags() – set the flags to be used for dlopen() calls setprofile() – set the global profiling function setrecursionlimit() – set the max recursion depth for the interpreter settrace() – set the global debug tracing function

Functions

breakpointhook(*args, **kws)	This hook function is called by built-in breakpoint().
call_tracing(func, args)	Call func(*args), while tracing is enabled.The tracing state is saved, and restored afterwards.This is intended to be called from a debugger from a checkpoint, to recursively debug some other code..
callstats()	Return a tuple of function call statistics, if CALL_PROFILE was defined when Python was built.
displayhook(object)	Print an object to sys.stdout and also save it in builtins._
exc_info()	Return information about the most recent exception caught by an except clause in the current stack frame or in an older stack frame.
excepthook(exctype, value, traceback)	Handle an exception by displaying it with a traceback on sys.stderr.
exit([status])	Exit the interpreter by raising SystemExit(status).
get_asyncgen_hooks()	Return a namedtuple of installed asynchronous generators hooks (firstiter, finalizer).
get_coroutine_origin_tracking_depth	Check status of origin tracking for coroutine objects in this thread.
get_coroutine_wrapper()	Return the wrapper for coroutine objects set by sys.set_coroutine_wrapper.
getallocatedblocks()	Return the number of memory blocks currently allocated, regardless of their size.
getcheckinterval()
getdefaultencoding()	Return the current default string encoding used by the Unicode implementation.
getdlopenflags()	Return the current value of the flags that are used for dlopen calls.
getfilesystemencodeerrors()	Return the error mode used to convert Unicode filenames in operating system filenames.
getfilesystemencoding()	Return the encoding used to convert Unicode filenames in operating system filenames.
getprofile()	Return the profiling function set with sys.setprofile.
getrecursionlimit()	Return the current value of the recursion limit, the maximum depth of the Python interpreter stack.
getrefcount(object)	Return the reference count of object.
getsizeof(object, default)	Return the size of object in bytes.
getswitchinterval()
gettrace()	Return the global debug tracing function set with sys.settrace.
intern(string)	``Intern’’ the given string.This enters the string in the (global) table of interned strings whose purpose is to speed up dictionary lookups.Return the string itself or the previously interned string object with the same value..
is_finalizing()	Return True if Python is exiting.
set_asyncgen_hooks(*[, firstiter, finalizer])	Set a finalizer for async generators objects.
set_coroutine_origin_tracking_depth	Enable or disable origin tracking for coroutine objects in this thread.
set_coroutine_wrapper(wrapper)	Set a wrapper for coroutine objects.
setcheckinterval(n)	Tell the Python interpreter to check for asynchronous events every n instructions.
setdlopenflags(n)	Set the flags used by the interpreter for dlopen calls, such as when the interpreter loads extension modules.
setprofile(function)	Set the profiling function.
setrecursionlimit(n)	Set the maximum depth of the Python interpreter stack to n.
setswitchinterval(n)	Set the ideal thread switching delay inside the Python interpreter The actual frequency of switching threads can be lower if the interpreter executes long sequences of uninterruptible code (this is implementation-specific and workload-dependent).
settrace(function)	Set the global debug tracing function.

pyspark.sql.functions.sumDistinct pyspark.sql.functions.tan