Fix record (source ETL/ELT)
(1) The path and name of the source file. Paths below the installation directory of the Integration Server can be specified relatively with ./ Note: You can use variables, see (4), and placeholders, see tooltip.
You can also specify a URL. Example: https://example.com/myfile.txt
You can also specify file archives (ZIP, TAR, RAR) with multiple files if (12) is set. The task is then executed for each file in the archive (implicit loop).
(2) Extracts the names of the ETL/ELT source fields (i.e. the columns of the row). This only works if the file has a header row, see (7), otherwise the fields are internally named with $COL.1, $COL.2, etc.
(3) Displays the source file.
(4) Selection of ETL/ELT variables.
(5) The source file is deleted after processing.
(6) You can skip rows, independent of the header row.
(7) Indicates whether the source file contains a header row. The header row is then skipped in the processing. In addition, it is used to extract the names of the ETL/ELT source fields, see (2).
(8) If this checkbox is set, each row in the source file is interpreted as one record. Otherwise, the length of a record must be specified.
(9) Indicates the indices (starting at 0) from which the individual fields are read in. An help tool is available via the symbol on the right.
(10) Either all rows are read in or only those that fulfil certain conditions, see the following section.
(11) This is an expert setting (Scriptella) and can be ignored. Note: If an HTTP source is used in (1) and an entry stream=true is created here in (11), the data is read in line by line.
(12) See (1).
Filtering Rows
(1) The 'column number' (see indices) of the fix record row.
(2) The search value. ETL/ELT variables can be used, syntax @Var@, and regular expressions.
(3) Automatically generated by the query wizard, see (1) and (2). Can be adjusted.
(4) Loads the source file as test data into (5).
(5) The test data can either be entered manually or loaded via (4).
(6) Applies the query (3) to the test data (5).
(7) The result of the query.