Off Limit Tagger*


This stage supports the filtering of data with the specified threshold values. The specific logic is as follows:

  • Input data with the specified lower limit and upper limit values (Outlier Detection) are filtered.
  • Verify if the value of the record.measurepoint.value field in the record falls in the specified min,max range.
    • If the data value does not fall in the range, the value of the /attr/isOutlier field in the output is set to true.
    • If the data value falls in the range, the value of the /attr/isOutlier field in the output is set to false.
  • The configured threshold values and parameters will be included in the /attr/outlierAttr field as output.
  • Incompatible with old data formats, i.e. cannot filter data by ModelId::PointId.

Configuration

The configuration tabs for this stage are General, Basic, and Input/Output.

General

Name Required? Description
Name Yes The name of the stage.
Description No The description of the stage.
Stage Library Yes The streaming operator library to which the stage belongs.
Required Fields No The fields that the data records must contain. If the specified fields are not included, the record will be filtered out.
Preconditions No The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. For example, ${record:value('/value') > 0}. For the syntax of EL expressions, see Expression Language.
On Record Error Yes

The processing method for error data.

  • Discard: Error data will be discarded and ignored
  • Send to Error: Error messages will be reported
  • Stop Pipeline: The pipeline will be stopped

Basic

Name Required? Description
Quality Filter No Filter the data according to the data quality. Only records that meet the quality conditions will be processed by this stage.

Input/Output

Name Required? Description
Input Measurement Yes Data input point
OpenClose Yes

Select the format of the threshold.

  • (x,y)
  • (x,y]
  • [x,y)
  • [x,y]
  • (-∞,y)
  • (-∞,y]
  • (x,+∞)
  • [x,+∞)
  • (-∞,+∞)
Min-Max Yes Specify the lower limit value and upper limit value of the threshold, separated by comma.
Output Measurement Yes Data output point.When a threshold judgment is made on the input points, Streaming tags the record that exceeds the upper and lower limits and outputs the marking result, and the data output point is the measurement point that carries the output result.

Output Results

The output results of this stage are included in the attr struct. The description of the fields are as follows:

Name Data Type Description
isOutlier Boolean Whether the measurepoint value exceeds the threshold.
minValue Int/Double/Float The set lower limit of the threshold.
maxValue Int/Double/Float The set upper limit of the threshold.
enableMinJudger Boolean Whether minimum value juder is enabled.
enableMaxJudger Boolean Whether maximum value juder is enabled.

Output Example

../../../_images/minmax_outlier_result11.png