Tutorial Overview

Scenario

In this tutorial, we shall connect the wind turbines of a wind farm to EnOS Cloud, upload the energy production meter reading data to the cloud, and develop a stream processing pipeline to aggregate the meter reading data to get the daily energy production of each wind turbine, the total energy production of the wind farm, and the carbon reduction data of the wind farm. Both the original data and calculated data will be stored in TSDB by the configured storage types and storage time.


This tutorial will walk you through the typical process of developing a stream data processing job with StreamSets operators for complex business scenarios:

  • Registering and connecting wind turbines to EnOS Cloud.
  • Configuring the storage policy for the origin and calculated data.
  • Developing a stream data processing job with StreamSets operators to calculate the daily energy production and carbon reduction of a wind farm.
  • Viewing the origin data and calculated data with Data Insights.

Prerequisites

  • You have completed the Connecting a Simulated Device to EnOS tutorial to understand how to connect a device to EnOS and upload simulated device data to EnOS Cloud.
  • You understand how real-time data flows through the engines, the storage, and the applications. For more information, see Real-time Data Flow.
  • You know the basic steps of creating a stream data processing pipeline with StreamSets calculators. For more information, see Developing with StreamSets Calculators.