Data Middleware Software Engineer
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Bachelor's degree or above, major in computer science, with over 8 years of R&D experience in middleware or data platform-related fields. • Proficient in Java, with solid programming skills, excellent coding standards, and performance tuning capabilities. • Deeply understand the architecture and implementation principles of at least one open-source data synchronization middleware (Canal, FlinkCDC, SeaTunnel, Redis Replicator), and those with relevant secondary development or source code contribution experience are preferred. • Familiar with the internal mechanisms of at least one mainstream database (MySQL, PostgreSQL, Elastic Search, Redis), and have in-depth understanding of Binlog/Redo Log/Logical Replication/Redis Replicator Buffer. • Familiar with the source code of common database middleware (Mybatis, Lettuce, Jedis, Rest ES, ShardingJDBC, MySQL Connector Java). • Have a profound understanding of core theories of distributed systems, including but not limited to consensus protocols (Raft/Paxos), distributed transactions, high availability design, etc. • Possess excellent system analysis and problem-solving capabilities, and be able to independently undertake the architecture design and technical攻关 of complex systems. • Those with experience as a core member of the data infrastructure or middleware team in large-scale Internet companies are preferred.
Responsibilities
• Responsible for the design and development of the company's database middleware. This includes but is not limited to the design and implementation of Redis, Mybatis, ES, and Lindorm SDK, as well as meeting the core technical requirements in scenarios with extremely high transaction traffic and low latency. • Design high-availability and high-performance database middleware and data access layer architectures, optimize SQL performance and distributed transaction processing. • Build a data monitoring system, design integration solutions and data consistency guarantee mechanisms. • Be responsible for the overall architecture design, development and evolution roadmap planning of the company's next-generation data synchronization platform, aiming to create a core foundation for high-throughput, low-latency and highly available real-time data transmission. • Lead the core module development of the data synchronization middleware, including but not limited to real-time capture of heterogeneous data sources (CDC), data transformation (ETL), transmission protocol optimization, and distributed task scheduling. • Deeply study open-source data synchronization technologies such as Canal, FlinkCDC, and SeaTunnel, analyze their underlying principles (such as Binlog parsing, snapshot mechanisms, and breakpoint resumption), and conduct in-depth customized development and performance optimization. • Benchmark against industry-leading commercial products (such as Alibaba Cloud DTS), design and implement enterprise-level features such as dynamic topology management, data consistency verification, fine-grained monitoring and alerting, and self-healing capabilities for faults. • Solve complex technical challenges such as extreme performance bottlenecks, network jitter, and data consistency in massive data synchronization scenarios, and develop universal solutions. • Build an observability system for the data synchronization platform, providing end-to-end data link tracking, latency analysis, and throughput monitoring to enhance the stability and maintainability of the system.
Benefits
• Competitive total compensation package • L&D programs and Education subsidy for employees' growth and development • Various team building programs and company events • Wellness and meal allowances • Comprehensive healthcare schemes for employees and dependants • Disclaimer: Please note that Hong Kong is a group-level service hub, and OKX does not carry on a business of operating a virtual asset trading platform in Hong Kong. • Disclaimer: • All official OKX vacancies are published on this website. While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. If in doubt, please apply directly through our official careers website. • If in doubt, please apply directly through our official careers website. • Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice.