Sensor
The sensor stage collects data. This stage is the pipeline entrance, where the data starts flowing.
Select one action to collect data in the sensor stage. The action to collect data includes the action of schedule type that monitor folders and mailboxes and the action of direct type that monitor files uploaded to the FTP server.
Schedule type action and direct type action
Schedule type action is an action that regularly collects data from their own. The pipeline with the schedule type action in the sensor is regularly executed according to the schedule set in action. Or, if the monitoring object has changed, create data according to execution results then transfer data to file stage.
The schedule type action includes the action of monitoring folder and monitoring mailbox.
Direct type action is an action that inputs data from the connection. Direct type action is executed with HTTP server built into pipeline service or FTP server. The sensor works when data reaches a built-in server, data is created, and transferred to the filter stage.
The direct type action includes the action that monitors FTP server and the action that receives the request from a browser.
Processing of record
There are two kinds of sensor actions, one is that the data with two or more records (data of record type)is processed in one request and the other is that single data (data of parameter type) is processed.
In actions where process record type data, there are actions that get the data from database and read data from log files (CSV).
In actions where process parameter type data, there are actions that monitor files.
Type of sensor action
| Parameter type | Record type | |
|---|---|---|
| Schedule type | Action of monitoring files | Action of monitoring database |
| Direct type | Monitor whether record files (CSV) are added to FTP |
Receive XML |