Aditya Sharma
@adityasharma11
Seasoned Data Engineer with expertise in scalable data solutions.
What I'm looking for
I am a seasoned Data Engineer with over 9 years of experience in developing and refining data pipelines. My expertise lies in utilizing Azure Data Factory, Apache Spark, Azure Purview, Snowflake, and Azure Databricks to build scalable and robust data solutions. I lead two teams and manage three projects, focusing on solving complex business problems and creating value across various domains.
At PepsiCo, I spearheaded the design and development of a Data Lake platform, enhancing data integration and analytics capabilities. My efforts led to significant improvements in performance and security, including a 60% increase in metadata management efficiency and a 40% boost in data security. I have also been recognized for my contributions at AB InBev, where I defined a high-capacity data processing framework that improved data quality checks by 60%.
Experience
Work history, roles, and key accomplishments
Data Architect
PepsiCo
Dec 2022 - Mar 2025 (2 years 3 months)
Spearheaded the design and development of the Data lake platform (ADLS) utilizing the Medallion architecture pattern with Data bricks, enhancing data integration and analytics capabilities across business units at PepsiCo, processing up to 5 terabytes of data daily. Leveraged Azure Purview to guide the configuration, integration, and data governance enforcement within the multi cloud and SAAS envi
Data Engineering III
AB-InBev
Sep 2021 - Dec 2022 (1 year 3 months)
Defined a high-capacity data processing Pyspark framework for IoT devices, handling millions of data points daily and storing in Time Series Databases and ADLS Gen2, enhancing retrieval speed and storage efficiency by 25%. Designed Data Quality rules and frameworks to automate sample data validations increasing the data quality checks by 60%.
Senior Software Engineer
Seanergy Digital
Dec 2020 - Sep 2021 (9 months)
Engineered expansive big data infrastructures on Azure Cloud, Snowflake accommodating data expansion from hundred terabytes to over 2 petabytes, which doubled the system's capacity to manage an annual data growth of 200%. Combined Kafka and Spark Streaming to develop a real-time data processing system. This integration handled streaming data, boosting throughput by more than 50% and cutting down l
Quality Engineer
TechnipFMC
Jun 2015 - Dec 2020 (5 years 6 months)
Defined Hive tables using HiveQL, handling and analyzing more than 5 TB of data across these tables to facilitate data driven decision making in organizational projects. Demonstrated solid experience with Big Data services including Spark, HDFS and Hive, optimizing data processing workflows that handled over 25 petabytes of data annually, which increased operational efficiency and reduced costs by
Education
Degrees, certifications, and relevant coursework
KL University
Bachelor Of Technology, Mechanical Engineering
2011 - 2015
Grade: 9.2/10
Activities and societies: Silver Medalist in Mechanical Engineering.
Achieved a 9.2/10 grade point average and was awarded the Silver Medal in Mechanical Engineering.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Aditya?
You can contact Aditya and 90k+ other talented remote workers on Himalayas.
Message AdityaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
