ETL+ System Diagrams
ETL+ Overview
An ETL+ powered data warehousing provides the following benefits:
ETL+ is a high-performance, no-code, low-code, full-code Extraction, Transform, and Load tool to get your data sources' data into MS SQL Server data warehouses and then optimize and secure access for reporting.
You can leverage regular MS SQL and reporting tools and features in conjunction with ETL+. ETL+ is an additional powerful and easy-to-use tool, not a limitation on what you can do.
The ETL+ Agent can trigger reporting tasks on schedule. Depending on user-selected security settings, one can use it to trigger tasks on demand remotely.
DataSelf Analytics Processes
The following shows the processes and communications involved in a DataSelf Analytics cloud system.
ETL+ Table Loading
The following diagrams explain the processes involved during an ETL+ table loading.
Load All and Append
Using the (1) Source Info and (2) Extract SQL Statement, ETL+ requests a (3) table extraction from the source.
The source (4) renders the table, which passes through ETL+ Desktop app coming through the Extract and then the Transform & Load Engines.
The Transform and Load Engine sends the source data into the (5) target database (dw) into the (6) temporary table to load the raw data. Once completed, the (7) Design sends to the dw the (8) instructions to load (and transform, if applicable) the Temp Table data into the (9) target table.
Replace and Upsert
The Extract Engine reads the (1) delta filter value (constant or from the target table), which (2) changes the (4) Extract SQL Statement accordingly. Then it combines (4) and (3) and sends the (5) extract request to the data source.
The data source (6) renders the table which passes through ETL+ Desktop app coming through the Extract and then to the Transform & Load Engines.
The Transform and Load Engine sends the source data into the (7) target database (dw) into the (8) temporary table to load the raw data. Once completed, the (9) delta filter value defines and executes the (10) deletion of delta rows in the target table. Then Design sends to the dw the (11) instructions to (12) load (and transform, if applicable) the Temp Table data into the (13) target table.
Table Loading SQL to SQL
The following Temp table loading process happens to all load types (All, Replace, Upsert, and Append) when the data source and target database are in the same SQL instance.
Using the (1) Source Info, (2) Extract SQL Statement, and (3) target database, ETL+ requests a (4) table extraction & load from the data source to the target database.
The data source (5) renders the data straight into the (6) Temp table.
Once the load completes inon the Temp table, the remaining steps to load into the Target Table occur the same way as described in the diagrams above.
Component & Data Flow Diagram for ETL+
ETL+ Process Diagram
Puts the main sections of ETL+ user interface in content of external software components and data flows.
Older Versions
