vinay kumar

I’m a Senior Data Engineer with 12+ years of experience building, validating, and optimizing large-scale data platforms, distributed systems, and cloud-native analytics solutions. I’m especially focused on ETL/ELT pipelines, data quality engineering, and performance optimization in production environments.

For the last 4+ years at Zscaler, I’ve driven data platform initiatives using Spark, PySpark, dbt, Airflow, AWS, Hadoop, PostgreSQL, Kafka, and Apache Iceberg. I designed and optimized Spark-based ETL pipelines for high-volume telemetry and analytics workloads, and built automated PySpark data validation frameworks to ensure data accuracy, integrity, and consistency across distributed systems.

I improved Spark processing performance by approximately 40% through partition optimization, caching strategies, and broadcast joins, while also building Airflow orchestration for enterprise-scale processing pipelines. I develop and support dbt models for transformation and validation, collaborate on Kafka/Iceberg architectures for scalable workloads, and lead teams of 5 engineers delivering 15+ quarterly releases—backed by earlier experience as a Verification Engineer Lead/QA Lead with strong testing rigor and stakeholder communication.