Record Formatter

Supports conversion of the format of the input data. During the conversion, the corresponding Asset Tags and Measurement Tags are queried based on the configuration information, and this tag information is appended to the record.

Configuration

The configuration tabs for this stage are General, Basic, Input/Output and CacheConfig.

General

Name Required? Description
Name Yes The name of the stage.
Description No The description of the stage.
Stage Library Yes The streaming operator library to which the stage belongs.
Required Fields No The fields that the data records must contain. If the specified fields are not included, the record will be filtered out.
Preconditions No The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. For example, ${record:value('/value') > 0}. For the syntax of EL expressions, see Expression Language.
On Record Error Yes

The processing method for error data.

  • Discard: Error data will be discarded and ignored
  • Send to Error: Error messages will be reported
  • Stop Pipeline: The pipeline will be stopped

Basic

Name Required? Description
Input Format Yes

Select the format of the input data, currently 3 formats are supported:

Output Format Yes

Select the format of the output data, currently 3 formats are supported.

Asset Tag Groups No Need to configure the tag group ID defined in the Data Asset Catalog - Tag Management, the operator will use the assetId to query the Data Asset Catalog if the corresponding asset has tags belonging to the configured Assert Tag Groups
Measurement Tag Groups No Need to configure the tag group IDs defined in the Data Asset Catalog - Tag Management, the operator will use the measurementId to query the Data Asset Catalog for tags belonging to the configured Measurement Tag Groups for the corresponding measurement points.

Note

When converting to DCM Format and exporting downstream to a chronological database or other service, you need to make sure that the modelId, modelIdPath, pointId and hasQuality fields are correct in advance. hasQuality is a special field used only by the Record Formatter operator and indicates whether the quality field value in the input data needs to be included when converting to DCM format. The modelId and modelIdPath can be queried by the Asset Lookup operator, and the hasQuality field can be queried by the Point Lookup.

Output Results

Output Example

Configuration information

../../../_images/record_formatter2.png ../../../_images/record_formatter.png