DataSelf ETL+ Minimum System Requirements
Hardware and software requirements for cloud, hybrid, and on-premises (client-hosted) architectures.
v2023.10 ✅
ETL+ Minimum Hardware and Software Requirements
Hardware: 1 CPU core, 2GB of free RAM, 20GB of free disk space. A shared or dedicated VM/computer. Recommended monitor resolution: 1280x800 or higher. Reliable internet connection.
Operating Systems: Windows Server 2016 or 2019 or 2022, or Windows 10 or 11. We recommend Windows Server for ETL+ scheduled tasks. .NET 4.7.2 or newer (usually included in the OS).
Secured IP-to-IP connection: ETL+ whitelists your public IP address (ETL+ Public IP Whitelisting).
Firewall: Many servers have outbound ports open and there’s no need to adjust the firewall. If ports are closed, please allow outbound communication with HTTP (port 80), HTTPS (port 443), SSL SQL connections (port 1433), and preferably SMTP protocol for refresh emails (port 587). We can provide you with our public IP addresses for your IP-to-IP whitelisting. Instead of the above, we can set up other methods such as a VPN to secure the connection.
Antimalware: Be sure it doesn’t block DataSelf ETL+, DataSelf Agent, and the source database(s).
On-premises source data to be imported: One ETL+ installation must be in a location that is able to connect to this data.
DataSelf Cloud Data Warehouses
Nothing else is required. DataSelf will securely host your data warehouse(s) in our AWS or Azure servers.
MS SQL Server for On-Premises/Private-Cloud Data Warehouses
Please use the following guidelines when hosting your data warehouse on your own MS SQL Server:
MS SQL Server versions: 2022, 2019, 2017, 2016, or 2014.
MS SQL architecture: Server or serverless, including Azure SQL.
MS SQL Editions: any.
SQL Authentication supported: Windows, SQL, Azure Entra ID Password.
Guidelines for hardware specs:
In most deployments, the data warehouse data space will be 5% to 20% of the source database data space (data space without logs).
For fast performance, allocate RAM for SQL to be at least twice as big as the largest table to be hosted in the data warehouse. For instance, allocate 16GB of RAM for SQL if the largest data warehouse table will have 8GB of data. With this spec, SQL won’t be forced to do HD swaps when working with this table. For top performance, all data space should fit into the available RAM.
Here are guidelines based on the expected data warehouse data space:
Up to 4GB: 2+ CPU threads, 2GB+ of RAM. Azure SQL eDTUs: 100 to 200
Up to 16GB: 4+ CPU threads, 8GB+ of RAM. Azure SQL eDTUs: 200 to 300
Up to 32GB: 4+ CPU threads, 16GB+ of RAM. Azure SQL eDTUs: 300 to 800
Up to 128GB: 8+ CPU threads, 64GB+ of RAM. Azure SQL eDTUs: 400 to 1,600
Up to 1TB: 16+ CPU threads, 256GB+ of RAM. Azure SQL eDTUs: 800 to 3,000
Above 1TB: contact us.
Disk space (SSD preferably): Minimum free 150GB. Make it 5+ times the expected data space.
Recovery model: Simple (or Full).
Compatibility level: Latest available.
Collation: the same as your source systems', if applicable. Our default is SQL_Latin1_General_CP1_CI_AS.
ETL+ requires dbo role for the MS SQL database hosting the data warehouse.
Recommended to set up SQL
Encrypt connection
andTrust server certificate
, and its HD with encryption at rest.
Related Pages
ETL+ System Diagrams – architecture diagrams
Default architecture: ETL+ Multi-tenant Cloud Metadata. Contact us for dedicated or privately hosted ETL+ metadata.