Package org.apache.spark.sql.streaming

Class StateOperatorProgress

Object
org.apache.spark.sql.streaming.StateOperatorProgress
All Implemented Interfaces:
Serializable
public class StateOperatorProgress extends Object implements Serializable
Information about updates made to stateful operators in a StreamingQuery during a trigger.
See Also:

  • Method Details

    • operatorName

      public String operatorName()

    • numRowsTotal

      public long numRowsTotal()

    • numRowsUpdated

      public long numRowsUpdated()

    • allUpdatesTimeMs

      public long allUpdatesTimeMs()

    • numRowsRemoved

      public long numRowsRemoved()

    • allRemovalsTimeMs

      public long allRemovalsTimeMs()

    • commitTimeMs

      public long commitTimeMs()

    • memoryUsedBytes

      public long memoryUsedBytes()

    • numRowsDroppedByWatermark

      public long numRowsDroppedByWatermark()

    • numShufflePartitions

      public long numShufflePartitions()

    • numStateStoreInstances

      public long numStateStoreInstances()

    • customMetrics

      public Map<String,Long> customMetrics()

    • json

      public String json()
      The compact JSON representation of this progress.

    • prettyJson

      public String prettyJson()
      The pretty (i.e. indented) JSON representation of this progress.

    • toString

      public String toString()
      Overrides:
      toString in class Object