At Microsoft, I engineer large-scale Spark and Hadoop pipelines that process structured and unstructured telemetry data for enterprise analytics. I’ve optimized Spark workloads and orchestrated ETL workflows with Airflow, Hive, and PostgreSQL for machine learning and reporting.
At Wipro, I developed Kafka and Spark Streaming pipelines that wrote event data to HBase, and deployed big data workloads on AWS EMR. Earlier at Capgemini, I built Python data integrations for PostgreSQL and MongoDB and prepared datasets with data scientists for machine learning.
