• Documentation
  • Data Federation Overview

Data Federation Overview


EnOS Data Federation provides data querying and file writing services from multi-source heterogeneous data storage systems for application developers and data analysts where users can perform hybrid data querying without worrying about the differences of the query languages used in the various data systems through the use of unified SQL syntax standards, and can write local files to various storage systems quickly with just a simple configuration.


Other than the above, the Data Federation service also supports OData and JDBC connections, enabling the quick connection to mainstream BI analysis tools such as Tableau and PowerBI regardless of the differences of the source data storage systems.


The architecture of the Data Federation service is shown as per the below.


_images/data_federation_arch.png


Description to the architecture components

  • Data Sources: The data sources that are supported include MySQL, Blob, HDFS(EnOS), HIVE(EnOS), KAFKA(EnOS), Redis, S3, TSDB(EnOS), and MongoDB.
  • Data Source Connection: Data sources need to be registered through Data Source Registration so that they can be bound with federation channels.
  • Supported data access methods: JDBC, ODATA, and SDK.
  • Target users of Data Federation: data analysts, data engineers, and data scientists.