At EnterpriseDB, I engineered Go-based microservices and Java Reader/Writer modules using Debezium and Kafka for real-time Change Data Capture between source databases and target destinations. I also tuned data replication performance and developed automated cross-cloud migration tests.
At HuaWei Canada Research Institute, I worked on distributed systems and microservices for high-volume data transfer between cloud servers and an indexing system. I created Bazel build configurations for MongoDB and RocksDB that reduced compiling time by 50%, and contributed to a RocksDB compaction checksum validation solution and related paper.
At HSBC, I built Spark and Scala ETL pipelines on HDFS for financial transaction data used in fraud detection and risk modeling. I also developed validation frameworks to catch data quality issues before release.
