Trần Ngọc Phúc

I’m a Senior Data Engineer and Technical Lead with a track record of building and evolving large-scale data platforms across cloud and on-premise environments. I’ve designed real-time ingestion and observability systems handling up to 1TB/day, and I lead platform improvements that impact architecture, deployment efficiency, and codebase maintainability—not just feature delivery. I’m comfortable moving between architecture decisions and hands-on implementation, especially when I can ensure systems stay maintainable and operationally reliable as they grow.

At CMC Global, I transitioned from hands-on Senior DE work into Technical Lead roles, standardizing and refactoring helper modules, extracting reusable vendor logic, and designing a metadata-driven master DAG architecture to replace isolated orchestration. I rebuilt Azure DevOps CI/CD pipelines around incremental deployment strategy and improved Power BI data freshness with Databricks incremental refresh jobs. I also owned end-to-end observability platform solutioning—architecting an on-premise, air-gapped Elastic Stack system (30–120s latency), tuning ILM/indexing/sharding for sustained workloads, and implementing ingestion safety with Persistent Queue and Dead Letter Queue, plus security design (network segmentation, HTTPS enforcement, RBAC).