Natarajan A

I am a Big Data Engineer with around 2 years of experience in designing, implementing, and optimizing real-time data pipelines and large-scale data solutions. My proficiency in Apache Kafka, Spark, and Databricks allows me to tackle complex data challenges effectively. I leverage programming languages like Java and Python, along with SQL, to deliver scalable and high-performance solutions in Big Data environments.

At MahilTechLab Solutions, I architected real-time data pipelines using Apache Kafka and Spark Structured Streaming on Azure Databricks, significantly improving data processing efficiency. My previous role at Fiserv involved designing real-time data pipelines that reduced latency by 30% and conducting rigorous testing to enhance software reliability. I am passionate about driving data-driven decision-making and continuously seek opportunities to innovate in the field of data engineering.