At ITC Infotech, I design ETL pipelines for Workforce360, bringing employee data from five HR systems into a single warehouse. I use AWS Glue, Lambda, Step Functions, and PySpark to clean, validate, and load the data.
I developed incremental loading and SQL scripts that reduced pipeline execution time by 40% and data load time by 30%. I also designed workforce data models and built Power BI dashboards used by HR and business stakeholders.
For my Crime Rate Prediction and Analytics System project at SPPU University, I created Azure Data Factory pipelines and a Bronze-Silver-Gold data lake architecture. I used Databricks and PySpark to prepare the data, evaluated an LSTM model, and developed Power BI dashboards for crime trends and predictions.
