James Malik

I am a Senior Data Engineer with over 10 years of experience designing, building, and optimizing large-scale data infrastructure across cloud and hybrid environments. I specialize in architecting end-to-end ETL and streaming pipelines using Apache Spark, Kafka, Airflow, dbt, and modern data warehouse technologies.

At recent roles I architected cloud-native platforms for AI/ML workloads, modernized legacy pipelines to serverless AWS Glue and Step Functions, and built ETL systems processing over 5TB daily, leading migrations to BigQuery and reducing infrastructure costs substantially. I implemented observability and governance using OpenTelemetry, CloudWatch, Great Expectations, and data cataloging tools while championing data mesh principles.

I lead cross-functional teams, mentor engineers, and drive CI/CD and IaC best practices with Terraform, Docker, and GitHub Actions to deliver reliable, cost-effective data platforms. I am motivated to build scalable systems that enable analytics and ML, while improving data quality, lineage, and operational excellence.