ETL+ Extract, Transform and Load (ETL) Page

1. Data Warehouse info: The target database/data warehouse that is loaded with data extracted from the Source Objects and Target Objects. Name of the data warehouse connected to this ETL+ session. The info shows as [<MS SQL Instance Name>].[<Database name>].

2. Find. Click to open the search box. (shortcut: Ctrl + F):Settings_Gear:

   

3. Log. Click to open the ETL Log page. (shortcut Ctrl + G)

4. ETL Working Files.

5. Help. ❔ Click to open documentation for this ETL+ page in a web browser (shortcut F1)

6. Settings :Settings_Gear: Click to open the Settings page.

7. Version number: format: vYYYY.MM.DDBB.

   • Example: v2022.08.2901 means the 1st build on 08/29/2022.

8. ETL+ User name and Entity for the current session.

   • User: the ETL+ username (email address) that is currently logged to ETL+.

   • Entity: the Entity identifies the mappings shown on this page.

   • SQL instance hosting ETL+ etl_metadata DB: only shows for admin users.

9. Close. Click to close the current ETL+ session.
   To close without saving changes click Close and click Yes to the ‘Leave without saving?' prompt.

10. Save. Click to save changes (shortcut Ctrl + S).

    • An asterisk indicates there are unsaved changes.

      

11. Load Panel. Load All, Replace, Upsert and Append.
    For more see ETL+ Table Load Types.

12. Confirm.

13. Parse toggle. When on, changes made to the columns named in the SELECT clause on the Extract SQL Statement panel will be reflected on the target table.

14. Source Objects panel.

15. Target Objects panel.

16. Extract SQL Statement panel.

NOTES: Hover over and/or right-click icons and objects on ETL+ to view their functions and/or metadata.

Source Objects Panel

Names and maintains connections to data sources.

• ETL+ reads a wide variety of data sources.
  See ETL+ Source Types, Source Systems and IT

• Lists configured data sources and their tables (click Refresh to list tables).

• Expand or collapse the display of tables/files in a data source by selecting + or - next to the data source name.

Source Objects panel of ETL+ Extract, Transform and Load (ETL) window.

Add Table: Select a table under a data source and click Add Table. Add Data Source: Click to add a new data source. More at ETL+ Source Types | Adding-Data-Sources Delete Source. Select a data source and click to delete. :Refresh+A: Refresh. Select a data source and click to refresh it's list of tables. (F5) :Properties_Wrench: Properties. Select a data source and click to change the settings. Similar to Add Data Source. More at ETL+ Data Sources | Configuring a Data Source :Add_Table_to_Target: Add Table to Target data sources. Select a data source and click Properties to configure. (Ctrl + I)

Data Sources

Data sources are source systems (data sources) available to extract data.

zData Warehouse is the target/destination data warehouse. Read and write-back data to transform data already in the data warehouse. See also zData Warehouse (Reimports) in the Target Objects panel.

• Used to created calculated fields, apply formulas, run SQL functions and make other data manipulations to the data warehouse.

Related Pages: ETL+ Source Drivers, ETL+ Source Types
Adding a new data source to ETL+

Target Objects Panel

The center section of the Target Objects panel is a hierarchical menu consisting of target tables grouped by data source and target column names.

Configures the mapping of Source Objects to Target Objects. Allows data warehouse table maintenance and data load. Lists the tables and columns mapped to the data warehouse grouped by data source.

x x x x x x

Create Table. Select to create a new data warehouse table from scratch. Name it and then create SQL for it in the Extract SQL Statement panel. Delete Table. Select a table then select Delete Table to delete it, select Yes to confirm. (Ctrl + Del) Duplicate Table. Select a table, then select Duplicate Table to duplicate it. (Ctrl + 2) Rename Table: Select a table, then click Rename Table to rename it. (F2) Design: Select a table and click Design to design the columns format and extra data manipulation. More at: ETL+ Design Page Preview Table: Select a table, then lick Preview Table to preview data in the Preview page. (Ctrl + P) The Preview page display a sample of its records from the table’s data source (ETL+ executes the top records from the Extract SQL Statement to preview). Load Now: Select a table and click Load Now to load its source data into the data warehouse. (Ctrl + L) (The corresponding SQL and Load type options in the Extract SQL Statement panel determines how and what data is loaded.) More Actions. Show Columns Expand All / Collapse All: Expand or Collapse hierarchical menu Download to CSV Freeze: Disable changes. Job. Opens the Job page. (Ctrl + J) More at: ETL+ Job Page

Right-click Target Objects (target databases, tables or columns)
	Load Now Preview Table Design Rename Table Duplicate Table Delete Table Create Table More Actions Show Columns Expand All / Collapse All Download to CSV Freeze

Target Objects

A target object is a list of data warehouse tables mapped to a data source in the Source Objects panel.

zData Warehouse (Reimports) is a pre-defined source linked to the data warehouse. This source lists tables from the data warehouse re-imported into the data warehouse (for data manipulations).

Tables

Target Tables represent tables in the data warehouse.

Table Columns

Every table consists of one or more table columns.

Double-click a table or right-click it → Show Columns → +/- to expand/collapse its list of columns.

Types of Table Columns

• PK (Primary Key) icon: Columns that are part of the table’s primary key.

• Black column icon: The data warehouse column format is the same as from the source.

• Green column Icon: The data warehouse column format has been edited in the Design page.

How to edit column data types and PK

• Select a Table in the Target Objects panel → Design. More at: ETL+ Design Page

Extract SQL Statement Panel

Edits the SQL code (SQL statements) that controls the mapping of the source data connections in the Source Objects panel to the data warehouse tables in Target Objects panel.

Each SQL statement corresponds to a source group and table from the Target Objects panel. The output of the SQL SELECT statement loads into the destination data warehouse displayed just below the page title. See Data Warehouse info.

1. Display of the names of the corresponding source group and table on the Target Objects panel.

2. Extract SQL Statement. Editable text of SQL code/statement.

   • To view or edit SQL for a table: Select a table on the Target Objects panel. The corresponding SQL statement should appear in the Extract SQL Statement panel.

   • Use the SQL Statement syntax of the data source. Look at the SQL syntax for MS SQL Server sources in MS SQL Server, Providex syntax for for the Providex ODBC, etc.

3. Load Type: Controls how the data load process for the selected table.
   More at ETL+ Table Load Types.

4. Confirm. Click Confirm to accept the changes.
   To reject the changes click on another table and click No to the Confirm changes? prompt.

   • A asterisk indicates that the SQL has been edited.

     

5. Parse.

v2023.07 ✅