I am an experienced Data Engineer with a strong background in Python and SQL. I have a proven track record of building scalable and fault-tolerant data platforms, ensuring data accuracy and reliability. I have expertise in Apache Spark, Delta Lake, PyTest, Git and Airflow.
In my current role as a Senior Data Engineer at NASDAQ, I have contributed to the development of a microservices architecture using AWS, Databricks, and Python. I have successfully supervised and maintained hundreds of datasets, resolving data issues and ensuring dataset timeliness and accuracy. I have also collaborated with cross-functional teams to efficiently resolve customer and partner queries.
Prior to my current role, I worked as a Senior Associate Data Engineer at Themath Company. In this role, I led a team of 5 data engineers and played a key role in solution design and client satisfaction. I have successfully optimized PySpark projects, reducing cluster uptime and operational costs. I have also worked on a 40 million dollar initiative to modernize manufacturing plants, designing and building data pipelines and reports as per technical specifications.
I hold a Bachelor's degree in Mechanical Engineering from Birla Institute of Technology and Science, Pilani. I am a Microsoft Certified: Azure Fundamentals and AWS Certified Cloud Practitioner.
