Index of links by topic and/or subject. Glossary of terms.
ETL, ETL+ Glossary
See ETL+ Concepts & Definitions for more glossary definitions
-
Destination table – same as Target Table. See Target table for definition.
-
Target Table – same as destination table. A ETL extracts/reads data from the data source/source database and loads transformed data into target tables.
-
DataSelf ETL – DataSelf ETL vs. DataSelf ETL+. DataSelf ETL was retired in March 2022 and replaced by DataSelf ETL+ See DataSelf ETL Retirement (Legacy Product)
-
Command-line / Command Prompt / CMD Commands The commands sent to the Windows Command Prompt are commonly referred to as "Command-line commands.", "Command Prompt commands", or “CMD commands”.
-
Configuration Configuring ETL+ describes modifying/adjusting ETL+ settings, options, preferences or parameters. Configuration settings allow users to tailor ETL+ to specific users needs or preferences.
-
Data Warehouse Defined A data warehouse is a centralized data store for structured business data used to generate reports and conduct analysis. Data warehouse modeling is the process of designing and structuring data within a data warehouse to support effective business intelligence, decision-making, and complex queries.
-
Datastore -
Data Access Layer & Technology Data access layer and data access technology are generic terms for software that is used to read or write data. Examples include ODBC.
-
Data Source Defined From some online sources In the context of ETL (Extract, Transform, Load) systems, "source container," "data store," and "data source" are all related terms, but with slightly different meanings. A "source container" refers to the specific storage location or repository that holds the data to be extracted for processing in an ETL system. This could include various types of storage systems such as databases, files, cloud storage, or other structured or unstructured data sources. A "data store," on the other hand, is a more general term that refers to any system or technology that is designed to store and manage data, including both the source and target containers in the ETL process. A data store can include databases, data warehouses, data lakes, cloud storage, or other storage solutions. Finally, a "data source" is any external system, application, or service that provides data to an ETL system, including source containers. A data source could include APIs, web services, streaming platforms, or any other system that can provide data to an ETL system. In summary, while "source container" and "data store" are related terms that specifically refer to the location of data in the ETL process, "data source" is a broader term that refers to any system that provides data to an ETL system, including both source containers and other external data sources.
-
Change or Modification Flag Fields for Delta Loads or Updates ETL+ delta update processing creates the logical equivalent of a change flag for each source row or record. Notes on the concept of a ‘change flag’ for delta loads.
-
Endpoint - API Endpoints Defined API Endpoints are URLs where a web service or API receives requests. DataSelf employs endpoints for the SQL Extractor API and Tableau Extractor API.
-
ETL+ Entity A fundamental object or concept in ETL+. Encompasses the objects/things/elements seen on ETL+ sessions and logs such as ETL+ Extract, Transform and Load (ETL) page, ETL+ Job, and ETL+ Settings pages. Identified by Entity ID on the Client Information page.
-
ETL Defined ETL is an acronym for Extract, Transform, Load. Definition and conceptual description of ETL.
-
ETL+ Objects ETL+ uses the term Objects in the Source Objects and Target Objects panels to refer to connections to data sources and data warehouses, databases, tables or files, columns/fields, and data warehouses.
-
zData Warehouse User guide page for the special use zData Warehouse and zData Warehouse (Reimport) source and target objects. zData Warehouse is a unique data source in the administered by ETL+ for two primary purposes. First to lookup and retrieve data in static reference tables. Second in order to allow re-importing data from existing target tables in the data warehouse for further transformations.
-
Links -
Mappings in ETL+ The term mapping or mappings in ETL and data processing is a useful but generic term. However, It’s often not clear what is mapped to what.
-
OOTB (Out-of-the-Box) Templates Definition Pre-built, also known as OOTB (out-of-the-box), pre-mapped, or preconfigured templates that configure the DataSelf solution to work with ERP, CRM and other business systems.
-
Public IP Concepts A public IP (Internet Protocol) address is a unique identifier that is visible to the internet. Also definition of static vs. dynamic IPs.
-
Primary Key, Unique Key Exploration of different types, concepts and meanings about “keys”. Discussion includes primary keys, unique keys, the Key+ column on the Design page and more.
-
Sequentially Incremented Values Values that increase in a sequential and incremental manner. Sequentially incremented values are commonly used to assign unique identifiers to records in database tables. These values are typically integers that automatically increase in value by one with each new record added.
-
Source Container Definition Source Container – also known as a Source System – refers to a specific data source repository such as a database management system (DBMS). For ETL+ Source System is generally the preferred term.
-
Source Driver Defined Source drivers are modules in ETL+ that 1) connect to and extract data from data sources and 2) create and maintain ETL+ Source Objects which identify named data source connections within ETL+. See also ETL+ Source Drivers.
-
Source Systems Defined A data source such as a ERP, CRM system or other business system. For ETL+ all source systems have data sources, but not all data sources are source systems. Source system, Source Type and data source are related concepts. Often used interchangeably with data source. System in source system refers to the database centric business software/business application that maintains the data in the data source / source database.
-
Definitions: Source Type See ETL+ Data Source List: 500,000+for a comprehensive list. In the context of ETL+, the term refers to various types of connections to data stores (files or data bases) or source systems supported by ETL+. The term Source systems (ERP, CRM and other business systems or databases and ETL+ Source Drivers.
-
Target Column (aka Target Field) The objects in the Target Objects panel are, in hierarchical order, target objects (databases / data warehouses), target tables and finally, target columns. Columns are also less formally known as “fields”.
-
ETL+ Keyboard Shortcuts Keyboard Shortcuts involve pressing specific keys or key combinations to select buttons on the ETL+ user interface.
-
On-Premises vs. Cloud On-premises means hosting the software on one's own hardware or on hardware that you control such as a server on a data center or cloud service. The short form is: on-prem. In DataSelf documentation cloud generally refers to software hosted on cloud server managed by DataSelf.
-
API Defined API (Application Programming Interface). Interfaces between software systems that enable them to send and receive data and commands.
-
ETL+ No-code Features
🛠️ Incrementally (or delta) loading data after an initial full data load is a widely used ERP scenario. The delta load types in ETL+ are ETL+ Load Upsert, ETL+ Load Replace and ETL+ Load Append. Work in progress.
Glossary Definitions Needed
Work in Progress – list of terms that need definitions and/or link
Tableau
-
Tableau Calculations used @ Tableau Functions for Calculated Fields
-
Tableau Date Buckets used @ Filtering Dates in Tableau Web Editor
-
Tableau Functions used @ Tableau Functions for Calculated Fields
-
Tableau Number Units used @ Tableau Customizing Number Units