Flink-based Heterogeneous Database Synchronization Adapter Design

Abstract

The existing data synchronization scheme can satisfy the data synchronization between homogeneous table databases. Still, it restricts the table structures that can be synchronized and cannot solve the table heterogeneous database synchronization problem. In this paper, based on the existing data synchronization tools, we analyze the key problems in data synchronization, such as data type differences, data storage differences, data expression differences, etc. To design a synchronization model for these problems, this paper investigates the implementation of Flink CDC and the design idea of the Binlog model and designs a highly available and easily scalable heterogeneous database synchronization model by combining the actual data synchronization scenarios and traditional synchronization ideas.