Looking for a job

Shilpa Rani

@shilparani

Data Architect at AU Small Finance Bank optimizing AWS data pipelines and cutting EMR costs by 40%.

At AU Small Finance Bank, I act as an SME for the AWS-based data platform and make technical decisions on pipeline design, cost optimization, and data reliability.

I designed an ETL framework on AWS EMR and optimized SQL and PySpark processing, reducing EMR cluster costs by 20%. I also implemented incremental processing that cut running costs by 40% while improving reliability.

At Celebal Technologies Pvt. Ltd., I led the migration of on-premises data services to Azure Cloud. I designed data and BI solutions using Azure Data Factory and Synapse Analytics, and created Power BI dashboards for KPI monitoring.

Earlier, at SSIL Infotech Pvt. Ltd., I developed SSIS migration workflows and SSRS reports for government finance datasets. At ThinkStart Private Limited, I developed C# web services for client-facing applications.

Experience

Work history, roles, and key accomplishments

Current

Senior Manager

Current

AU Small Finance Bank

Dec 2022 - Present (3 years 10 months)

Act as SME for the team's AWS-based data platform, owning technical decisions on pipeline design, cost optimisation, and data reliability for 2M+ daily customer transactions. Designed and developed an ETL framework on AWS EMR, achieving a 20% reduction in EMR cluster costs through SQL and PySpark optimization.

AWS EMR S3 Redshift Athena SQL PySpark Airflow Data Warehouse Data Modeling ETL Cost Optimization Mentorship

Consultant

Celebal Technologies Pvt. Ltd.

May 2021 - Nov 2022 (1 year 6 months)

Led migration of on-premises data services to Azure Cloud, engaging multiple teams to define architecture and migration approach. Designed and implemented medium-to-large-scale data and BI solutions using ADLS, Azure Data Factory, and Synapse Analytics.

Azure ADLS Azure Data Factory Synapse Analytics SSAS Power BI Data Migration ETL Data Warehouse

Senior Programmer

SSIL Infotech Pvt. Ltd.

Jan 2019 - May 2021 (2 years 4 months)

Designed and optimized SQL queries, stored procedures, and database processes for large government finance datasets. Developed SSIS packages for bulk data migration, transformation, and file-processing workflows.

SQL T SQL SSIS SSRS SQL Server Performance Optimization Data Migration

Software Developer

ThinkStart Private Limited

Feb 2018 - Dec 2018 (10 months)

Designed complex SQL queries for data retrieval and business reporting on client projects. Developed and hosted C# web services supporting client-facing applications built on .NET.

SQL C#.NET Web Services