Settings

(1) Filename with absolute path: The path and name of the source file. Paths below the installation directory of the Integration Server can be specified relatively with ./ Note: You can use variables, see (4), and placeholders, see tooltip.

You can also specify a URL. Example: https://example.com/myfile.csv

You can also specify file archives (ZIP, TAR, RAR) with multiple files if (13) is set. The task is then executed for each file in the archive (implicit loop).

(2) Magic wand icon to the right of (1): Extracts the names of the ETL/ELT source fields (i.e. the columns of the row). This only works if the file has a header row, see (8), otherwise the fields are internally named with $COL.1, $COL.2, etc.

(3) Eye icon to the right of (1): Displays the source file.

(4) Burger menu to the right of (1): Selection of ETL/ELT variables.

(5) Delete file after successful finish: The source file is deleted after processing. Note: Does not work if the file name in (1) is dynamically generated (e.g. with variables or placeholders).

(6) Null values: The replacement value for source fields without value.

(7) Skip rows: You can skip rows, independent of the header row.

(8) Header row contains column names: Indicates whether the source file contains a header row. The header row is then skipped in the processing. In addition, it is used to extract the names of the ETL/ELT source fields, see (2).

(9) Separator: The column separator used in the source file.

(10) Quoting: Specifies which character in the field values of the source file is interpreted as quoting character.

(11) Load data from source: Either all rows are read in or only those that fulfil certain conditions, see the following section "Filtering rows".

(12) Miscellaneous ETL driver settings: This is an expert setting (Scriptella) and can be ignored. Note: If an HTTP source is used in (1) and an entry stream=true is created here in (12), the data is read in line by line.

(13) Data comes in compressed: See (1).

Filtering rows

(14) Col#: The column number of the CSV row.

(15) Search: The search value. ETL/ELT variables can be used, syntax @Var@, and regular expressions.

(16) CSV query (comma separated): Automatically generated by the query wizard, see (14) and (15). Can be adjusted.

(17) Load test data: Loads the source file as test data into (18).

(18) Test data: The test data can either be entered manually or loaded via (17).

(19) Execute query: Applies the query (16) to the test data (18).

(20) Test result: The result of the query.