Skip to main content
Skip table of contents

ETL+ System Diagrams: v2025.06 Beta

DataSelf ETL+

An ETL+ powered data warehousing provides the following benefits:

  • ETL+ is a high-performance, no-code, low-code, full-code Extraction, Transform, and Load tool to get your data sources' data into MS SQL Server data warehouses and then optimize and secure access for reporting.

  • You can leverage MS SQL and reporting tools and features in conjunction with ETL+. ETL+ is an additional powerful and easy-to-use tool, not a limitation on what you can do.

  • The ETL+ Agent can trigger reporting tasks on a scheduled basis. Depending on security settings, one can use it to remotely trigger tasks on demand.

  • DataSelf’s DFT data model transforms a source-specific database into a standardized structure, enabling efficient, secure, fast, and low-maintenance reports and dashboards.

  • The new Web UI enables users to securely maintain their ETL processes at any time and from anywhere.

  • The new ETL+ AI assists in data modeling.

ds_etl_data_warehousing_diagram_250529h.jpg

DataSelf ETL+ Data Flow

DataSelf ETL+ is comprised of the following parts:

  • ETL+ Server, which contains and manages ETL metadata. No transaction data reaches the ETL+ Server, just metadata and logs. The ETL+ Server is usually hosted in DataSelf Cloud, but it can also be hosted behind the client’s firewall. It has the following components:

    • Metadata Servers supporting ETL+ Desktop installations:

      • ETL+ Desktop metadata servers: MS SQL databases and stored procedures.

      • DFT - Dimension, Fact, and Time modeling: customizable templates for ETL+, MS SQL, Excel, Power BI, and Tableau. They enable plug-and-play reports and dashboards for popular ERPs, CRMs, and other systems.

    • ETL+ Web (currently, only available in DataSelf Cloud):

      • Server: OS: Linux, Web App Server: Nginx.

      • Back-end: Language: PHP; Framework: Laravel.

      • Front-end: Language: Typescript/Javascript; Framework: Vue 3.

      • ETL+ Web metadata database: MS SQL Server.

      • Web API: Provides ETL+ API cloud services for ETL+ installations, users, and services. Languages: Typescript/Javascript, C#; Framework: ExpressJS.

    • AI: An AI Training Database and AI API integration (Linux, JavaScript, Chroma DB).

  • ETL+ Desktop that provides the user interface and executes ETL processes (Windows, C#, .NET). Depending on source systems, ETL+ might process the extraction and some transformation during the data loading into the data warehouse (ex.: extract and transform OData data into the target MS SQL), or all tasks might be executed directly by the target SQL Server under the ETL+ directions (ex.: extract and transform MS SQL source data into the target MS SQL).

  • Integration with 3rd party BI platforms such as MS Excel, MS Fabric, MS Power BI, and Tableau. For instance, ETL+ can trigger the refresh of Power BI semantic models and Tableau Cloud data sources as part of the ETL process.

The following diagram contains production components and new features to be released through 2025 (click the image to zoom in).

image-20250526-155550.png

Architecture options:

  1. All DataSelf components are hosted in our cloud.

  2. Have the data warehouse hosted in the client’s private cloud or on-premises.

  3. Have the ETL+ metadata Server and data warehouse in the client’s private cloud or on-premises; and ETL+ Web, API, and AI in DataSelf’s cloud.

  4. Have all DataSelf components in the client’s private cloud or on-premises.

Once ETL+ Desktop loads the source’s metadata to its ETL+ Server, users can manage many ETL processes without connecting to the source system again. For instance, adding source tables and columns.

Using a fast and friendly no-code approach, the ETL+ ecosystem allows users to extract data from over 430 sources. Other sources such as API integration require low-code or full-code implementations.

The ETL+ system can also execute ETL tasks on schedule and demand.

DataSelf Analytics

DataSelf Analytics is a business intelligence (BI) and analytics solution designed to extend the reporting capabilities of ERP and CRM systems like Acumatica, Sage, Microsoft Dynamics, NetSuite, and others. It provides data visualization, reporting, and AI-driven insights to help businesses make better decisions.

Key Features of DataSelf Analytics

  • Streamlined Data warehousing powered by ETL+: Consolidates and optimizes data from multiple sources.

  • Pre-built BI Templates: Comes with 8,000+ customizable reports, dashboards, and KPIs.

  • Powerful data visualization: Uses Tableau and Power BI for advanced reporting.

  • Self-service BI: Enables non-technical users to create reports and dashboards easily.

  • AI & predictive analytics: Helps forecast trends and identify business insights.

  • Fast Deployment: Complete deployments can be done in hours.

image-20250311-022055.png

Related Pages

Search terms:

data warehousing MS SQL Server based, MSSS, reporting and analytics tools, Tableau, Excel, Power BI, Crystal reports, SSRS, database management system, data sources, ETL, extract, data warehouse

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.