SQL Operators¶
The MI Pipelines provides the following operators related to database connection:
- Hive Operator
- Mysql Operator
Hive Operator¶
The Hive operator is used to process HIVE SQL, supports Hive SQL syntax, and can be used to create new tables and execute SQL query and other Hive calculation tasks.
In the current operating environment of EnOS, Hive SQL cannot be executed across environments due to the network isolation between different environments.
Input Parameters Description¶
| Name | Required/optional | Type | Description |
|---|---|---|---|
| data_source_name | Required | String | Data source name from the data source connection configuration. |
| sqls | Required | List | Specify the SQL statement to be run (list type). Enter one list element per line. See the following sample of list elements: |
| queue | Optional | String | Specify the name of the big data queue required to run HIVE SQL, which is the name of the Batch Data Processing - Big Data Queue requested through the Resource Management. |
List Element Sample¶
If you need to enter ["a","b","c"], enter as follows:
"a"
"b"
"c"
If you need to enter [1,2,3], enter as follows:
1
2
3
Output parameters description¶
| Name | Type | Description |
|---|---|---|
| resultset | File | Result set outputted after running HIVE SQL. |
Mysql Operator¶
The Mysql operator is used to process MySQL SQL, supports MySQL syntax, and can be used to create new tables, execute SQL query and other tasks.
Input Parameters Description¶
| Name | Required/optional | Type | Description |
|---|---|---|---|
| data_source_name | Required | String | Data source name from the data source connection configuration. |
| sqls | Required | List | Specify the MySQL statement that needs to be run. |
Output parameters description¶
| Name | Type | Description |
|---|---|---|
| resultset | File | Result set outputted after running MySQL. |