Overview
DataSelf supports both cloud-based and on-premises data extraction. The appropriate architecture depends primarily on whether DataSelf’s cloud services can directly access both:
-
The source systems from which data will be extracted
-
The destination data warehouse into which the data will be loaded
When both systems are accessible, the complete ETL process can run in the DataSelf cloud without installing ETL+ Desktop or an extraction agent in the customer’s environment.
Architecture Comparison
|
Consideration |
DataSelf Cloud Extraction |
On-Premises Extraction |
|---|---|---|
|
ETL+ Desktop installation |
Not required |
Required |
|
Extraction processing |
DataSelf cloud |
Customer environment |
|
Source connectivity |
Must be directly accessible from DataSelf cloud |
Must be accessible from the ETL+ Desktop server |
|
Data warehouse connectivity |
Must be directly accessible from DataSelf cloud |
Must be accessible from the ETL+ Desktop server |
|
On-premises systems |
Supported with IP allowlisting or other approved connectivity |
Supported through the customer’s internal network |
|
Firewall requirements |
Inbound access from DataSelf’s designated IP and required ports |
Primarily outbound access from ETL+ Desktop, plus internal access to sources and the data warehouse |
|
Credentials |
Securely provided to DataSelf |
Configured for use by ETL+ Desktop |
|
Local server requirements |
None |
Windows computer or server meeting ETL+ requirements |
|
Best suited for |
Cloud-accessible or IP-allowlisted systems |
Private, restricted, or internal-only systems |
DataSelf Cloud Extraction
DataSelf Cloud Extraction runs the complete extraction and loading process from DataSelf’s cloud services. It is commonly used when source systems and data warehouses are securely accessible through APIs, database connections, or other supported interfaces. The key requirement is that DataSelf’s cloud services have direct and secure network access to both the source and destination.
Connecting to On-Premises Databases
DataSelf Cloud Extraction can access an on-premises source or data warehouse when the customer’s firewall permits secure IP-to-IP connectivity from DataSelf.
To enable this connectivity, allowlist DataSelf’s public IP address:
44.226.93.93
Only the ports required for the applicable systems should be opened. For example:
-
An on-premises Microsoft SQL Server source must allow connections from DataSelf’s IP address, typically over port 1433, using dedicated read-only database credentials.
-
A destination Microsoft SQL Server data warehouse must allow connections from DataSelf’s IP address, typically over port 1433, using dedicated credentials with the required data-loading and management permissions—typically the
db_ownerdatabase role.
Once the required network access, credentials, and permissions are configured, DataSelf’s cloud services can connect directly to the source and destination. No ETL+ Desktop installation or extraction agent is required within the customer’s environment.
Connection Information Required
The customer must securely provide DataSelf with the applicable connection information for each source and destination:
-
Public IP address or fully qualified hostname
-
Port number
-
Database server and instance name, if applicable
-
Database name
-
Dedicated username and password
-
API credentials or authentication information, if applicable
-
Any additional connection, encryption, or authentication requirements
Credentials must be provided using a secure method approved by DataSelf—not through unencrypted email.
On-Premises Extraction with ETL+ Desktop
ETL+ Desktop is typically installed within the customer’s environment when DataSelf’s cloud services cannot directly access the source system or destination data warehouse.
Common scenarios include:
-
Source databases that are accessible only from the customer’s internal network
-
Data warehouses that do not permit inbound cloud connections
-
Firewalls or security policies that prohibit IP allowlisting
-
Legacy applications that require locally installed drivers or connectors
-
Customer policies requiring data extraction to run within their environment
-
Network architectures that require private access through a local server
ETL+ Desktop runs from a Windows computer or server with access to the applicable source systems and destination data warehouse. It can execute scheduled jobs without exposing those systems directly to DataSelf’s cloud extraction services.
For hardware, operating system, firewall, and software requirements, see: