OneConnect - General Architecture

OneConnect - General Architecture

The diagram below illustrates the high-level architecture of the OneConnect solution. It depicts SAP ECC or S/4HANA as the data producer, with multiple downstream systems—such as ClickHouse, Snowflake, and Databricks—acting as subscribers. Other destinations can also be supported.



1. SAP Data Modeler

Responsible for modeling SAP entities based on SAP tables, CDS views, or ABAP programs.

Replication Methods:
  • Table Format: Each SAP table or CDS view is transformed into a Kafka topic, preserving primary keys—similar to Change Data Capture (CDC).
  • Document Format: Each SAP document is converted into a Kafka topic with a nested, hierarchical structure. This structure resembles an IDOC, but instead of segments, it contains SAP tables or CDS views.
Data Delivery:

Data and metadata are pushed to the Smart Gateway either in batch mode or through real-time SAP event triggers (e.g., BOR Events, RAP Events). Communication is secured via HTTP Intranet or Private Connection, ensuring data integrity and protection during transport.


2. Smart Gateway

A Kubernetes-based component that ingests data and metadata from SAP.

  • Translates incoming content into Confluent-compatible schemas and Kafka topics
  • Serializes messages into Avro format for efficient transport and schema enforcement
  • Communicates securely over HTTP Intranet or Private Connection

Note: The Smart Gateway database is hosted in the Kubernetes environment; this data base only stores operational metrics and administrative metadata. No customer-sensitive or private information is stored.

​

3. Onibex Premium Connectors

Enterprise-grade connectors that streamline Kafka integrations with modern analytics platforms.

Supported Targets:
  • Databricks
  • Snowflake
  • ClickHouse
  • Apache Iceberg
  • Many more....
Key Features:
  • Rapid deployment of streaming pipelines
  • Automated schema evolution
  • Idempotent writes for consistent data ingestion
  • Secure, high-performance data transfers

These connectors accelerate data modernization and deliver measurable business value— often within hours of deployment.


    • Related Articles

    • OneConnect - SmartGateway Network Architecture

      The SmartGateway Network architecture provides a secure and scalable connectivity layer between on-premise systems, cloud environments, and modern data platforms. It ensures reliable data exchange across AWS Customer Account, Onibex, and SAP Rise, ...

    • Azure - OneConnect Deployment and Configuration

      One Connect Platform: Kubernetes Azure Deployment Manual for Private Network This manual outlines the steps required to deploy the One Connect system on a Kubernetes cluster within a Private Network (meaning the OneConnect Platform will not be ...

    • OneConnect - Docker Deployment Guide

      OneConnect – Docker Deployment Guide This article explains how to deploy OneConnect using Docker on a Linux virtual machine. 1) Prerequisites Before starting the deployment, make sure you meet the following requirements: Download the compressed files ...

    • OneConnect - Advanced Configurations for Kubernetes

      Advanced Configurations for Kubernetes These configurations are optional and should only be applied if required by the client’s environment. They allow you to control how Kubernetes schedules and distributes pods within the cluster. 1. Tolerations ...

    • Performance Between Snowflake Connector vs Onibex Connector

      Onibex Connector vs Snowflake Native Performance Analysis and Comparison Study Onibex Connector: Up to 35% Performance Improvement Optimized for high-throughput data ingestion into Snowflake Executive Summary This comprehensive performance analysis ...