logo
Report Vulnerabilities
2.2.0
English
menu
Stream Processing

Stream Processing

Overview

  • EnOS Stream Processing Service Overview

How-to's

  • Installing Operator Libraries and Templates
  • Developing Stream Processing Pipelines
  • Developing with Operators
  • Operating and Maintaining Stream Processing Pipelines
  • Monitoring Cluster Resources

Reference

  • FAQs for Stream Processing
  • FAQs for Stream Operation
  • API Reference
  • Time Window
  • Electric Energy Calculation Logic
  • Operator Documentation
    • Operator Library 0.1.0 Documentation
    • Operator Library 0.2.0 Documentation
    • Operator Library 0.3.0 Documentation
      • Source
      • Asset Data Querying Operators
      • Data Processing Operators
        • Normalizer
        • Point Selector
        • Record Generator
        • Virtual Record Generator
        • Related Record Obtainer
          • Configuration
            • General
            • Basic
            • Input/Output
            • Data Generation
          • Output Results
            • Output Example
              • Same Asset Configuration Sample
              • Child On Tree Configuration Sample
        • Partitioner
        • Record Sorter By Time
        • Fixed Time Window Aggregator
        • Sliding Time Window Aggregator
        • Batch Merger
        • Last Changed Record Appender
        • Latest Record Merger
        • Record Capturer
        • Record Restorer
        • Python Evaluator
        • JavaScript
        • Internal HTTP Client
      • Data Quality Tagging Operators
      • Electric Energy Calculating Operators
      • Destination
      • Operator Performance Description
  • Related Products and Services

Last Updated 2024-08-31

The availability of EnOS functions is subject to licenses and access permissions. Contact your system administrator if certain functions are not available in your environment.
  • Documentation
  • Operator Documentation
  • Operator Library 0.3.0 Documentation
  • Related Record Obtainer

Related Record Obtainer¶


This stage generates new records based on the specified conditions for obtaining the latest data of device measurement points. The functions of this stage include:

  • The measurement points can be of the current device or of devices on an asset tree.

  • Obtaining devices from an asset tree supports asset node recursion.

  • Supports logic asset trees.

  • Obtains the latest data of device measurement points based on Redis service. If the specified measurement points do not exist, or the points do not have data, this stage has no output.

  • The output results are grouped according to the Output Point configuration


Notes:

  • Obtaining asset trees by asset tree tag support 1 tag only. Ensure that the specified asset tree tag is available.

  • Due to the merging of output results, if a large number of devices are obtained from asset trees and multiple related points are specified for output, size of the final output records might be huge. Ensure that the resource allocation is properly evaluated to avoid memory usage problems.

Configuration¶

The configuration tabs for this stage are General, Basic, Input/Output, and Data Generation.

General¶

Name

Required?

Description

Name

Yes

The name of the stage.

Description

No

The description of the stage.

Stage Library

Yes

The streaming operator library to which the stage belongs.

On Record Error

Yes

The processing method for error data.

  • Discard: Error data will be discarded and ignored

  • Send to Error: Error messages will be reported

  • Stop Pipeline: The pipeline will be stopped

Basic¶

Name

Required?

Description

Quality Filter

No

Filter the data according to the data quality. Only records that meet the quality conditions will be processed by this stage.

Input/Output¶

Name

Required?

Description

Related Type

Yes

Specify the method for obtaining devices. Options are:

  • Same Asset: For the current device.

  • Child On Tree: Obtaining devices on an asset tree (calculation for sites).

Asset Tag

No

When the Child On Tree method is selected, search for asset trees with asset tree tag.

Output Asset

No

When the By AssetIDs method is selected, specify the asset ID. In the Output Point field, specify the measurement point for the generated data records, using the format {pointId}.

Input Point

Yes

Specify the input measurement point, using the format {modelId}::{pointId}.

Related Point

Yes

Specify the related measurement point, using the format {modelId}::{pointId}, for identifying the device point for obtaining data.

Output Point

Yes

Specify the measurement point for the generated data records, using the format {modelId}::{pointId}.

Data Generation¶

Name

Required?

Description

Data Source

Yes

Query measurement point data based on Redis service. For the data expiry policy, refer to the Redis API.

Last Update Interval Filter Enabled

No

Select whether to get the latest asset data from Redis using a fixed time interval.

Last Update Interval in Minutes

No

Enter the time interval for getting the latest asset data.

None Existing Point Handle

Yes

When no data is obtained, ignore the measurement point.

Output Results¶

The output results of this stage are the generated records, which include the following:

  • Common fields (such as assetId, pointId, modelId, time, value). The value field has no practical meaning, and its value is 0.

  • Stage configuration attributes, which are included in the attr/relatedRecordObtainer field. The data type of this field is map. The key in the map is the device ID (string), and the value is a map (the key is the measurement point, and the value is the detailed information of the point).

Output Example¶

Same Asset Configuration Sample¶

../../../_images/related_record_obtainer_config_1.png


Output Sample:

../../../_images/related_record_obtainer_result_1.png

Child On Tree Configuration Sample¶

../../../_images/related_record_obtainer_config_2.png


Output Sample:

../../../_images/related_record_obtainer_result_2.png
Previous Next

Preview:

0  words
Comments
  • Latest
  • Oldest
On this page
  • Related Record Obtainer
    • Configuration
      • General
      • Basic
      • Input/Output
      • Data Generation
    • Output Results
      • Output Example
        • Same Asset Configuration Sample
        • Child On Tree Configuration Sample
© 2025 Univers. All Rights Reserved. | Privacy Notice User Agreement