Aditya Sharma

Spearheaded the design and development of the Data lake platform (ADLS) utilizing the Medallion architecture pattern with Data bricks, enhancing data integration and analytics capabilities across business units at PepsiCo, processing up to 5 terabytes of data daily. Leveraged Azure Purview to guide the configuration, integration, and data governance enforcement within the multi cloud and SAAS envi

Defined a high-capacity data processing Pyspark framework for IoT devices, handling millions of data points daily and storing in Time Series Databases and ADLS Gen2, enhancing retrieval speed and storage efficiency by 25%. Designed Data Quality rules and frameworks to automate sample data validations increasing the data quality checks by 60%.

Engineered expansive big data infrastructures on Azure Cloud, Snowflake accommodating data expansion from hundred terabytes to over 2 petabytes, which doubled the system's capacity to manage an annual data growth of 200%. Combined Kafka and Spark Streaming to develop a real-time data processing system. This integration handled streaming data, boosting throughput by more than 50% and cutting down l

Defined Hive tables using HiveQL, handling and analyzing more than 5 TB of data across these tables to facilitate data driven decision making in organizational projects. Demonstrated solid experience with Big Data services including Spark, HDFS and Hive, optimizing data processing workflows that handled over 25 petabytes of data annually, which increased operational efficiency and reduced costs by

Grade: 9.2/10

Activities and societies: Silver Medalist in Mechanical Engineering.

Achieved a 9.2/10 grade point average and was awarded the Silver Medal in Mechanical Engineering.