Record Capturer¶
This stage captures the data that passes through this stage and store the data in Redis in the key:field:value format. The format of the Redis key is pipelineId::commonRedisStage::assetId, in which commonRedisStage is a fixed field.
Configuration¶
The configuration tabs for this stage are General, Basic, and Input/Output.
General¶
| Name | Required? | Description |
|---|---|---|
| Name | Yes | The name of the stage. |
| Description | No | The description of the stage. |
| Stage Library | Yes | The streaming calculator library to which the stage belongs. |
| Required Fields | No | The fields that the data records must contain. If the specified fields are not included, the record will be filtered out. |
| Preconditions | No | The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. |
| On Record Error | Yes | The processing method for error data.
|
Basic¶
| Name | Required? | Description |
|---|---|---|
| Quality Filter | No | Filter the data according to the data quality. Only records that meet the quality conditions will be processed by this stage. |
Input/Output¶
| Name | Required? | Description |
|---|---|---|
| Input Point | Yes | Specify the input point of the records, using the format {modelId}::{pointId}. |
