Dev Raw Data Source¶
This stage generates raw data based on the user-provided data, which can be used for debugging only.
This is a native StreamSets stage. For more information, see StreamSets User Guide.
Configuration¶
Before using this stage, set the Execution Mode of the pipeline as Standalone.
The configuration tabs for this stage are General, Raw Data, and Data Format.
General¶
Name |
Required? |
Description |
|---|---|---|
Name |
Yes |
The name of the stage. |
Description |
No |
The description of the stage. |
On Record Error |
Yes |
The processing method for error data.
|
Raw Data¶
Name |
Required? |
Description |
|---|---|---|
Raw Data |
Yes |
The raw data, for example, {“orgId”:”xxx”,”modelId”:”Model”,”modelIdPath”:”/rootModel/Model”,”assetId”:”qXupozjG”,”pointId”:”Point_A”,”time”:1567292293000,”value”:1.2,”quality”:0,”attr”:{}} |
Stop After First Batch |
No |
Specify whether to stop after generating the first batch of data records. |
Data Format¶
Name |
Required? |
Description |
|---|---|---|
Data Format |
Yes |
Select the format of the generated data. Options include JSON, Log, Text, XML, etc. It is recommended to select JSON. |
Compression Format |
Yes |
Select the data compression format. It is recommended to select None. |
Other fields |
No |
Complete the configuration based on the raw data provided and selected data format. |
Output Results¶
The output results of this stage are based on the raw data provided and selected data format.
Output Example¶
