Looking for a job

Shivika Maheshwari

@shivikamaheshwari

Message

I build scalable batch and real-time data pipelines for analytics and AI-driven products.

India

Message

At HSBC, I lead data engineers and own architecture for scalable ETL/ELT workflows supporting multiple business domains.

I've built cloud-native batch and real-time pipelines processing millions of daily records with Snowflake, Databricks, PySpark, AWS Glue, Apache Airflow, Apache Beam, GCP Dataflow, and BigQuery. I optimized 30+ pipelines, reducing end-to-end execution time by 40%.

I also build analytics-ready dbt models, data-quality frameworks, observability standards, and Terraform-based CI/CD deployments. Earlier at Datamatics, I developed NLP data-processing pipelines using AWS Comprehend for medical-record entity recognition.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer

Current

HSBC

Feb 2025 - Present (1 year 7 months)

Led a team of data engineers, owning design and architectural decisions for scalable ETL/ELT workflows. Created cloud-native batch and real-time data pipelines processing millions of records daily using Snowflake, Databricks, PySpark, and AWS Glue.

Snowflake Databricks PySpark AWS Glue Airflow DBT GenAI Claude AI LLM Terraform Jenkins CI CD Data Quality Data Validation Cloud Monitoring Observability

Software Engineer

HSBC

Aug 2022 - Feb 2025 (2 years 6 months)

Designed scalable batch and streaming data pipelines using Apache Beam, Airflow, PySpark, GCP Dataflow, and BigQuery, processing 200GB+ enterprise datasets. Built scalable data ingestion feeds integrating structured and event-driven Kafka jobs.

Apache Beam Airflow PySpark Dataflow BigQuery Kafka Data Modeling Data Ingestion

Project Intern - Data Science

Datamatics

Jun 2021 - Aug 2021 (2 months)

Preprocessed datasets containing medical records, performing data cleaning, normalization, and validation. Built NLP-based data processing pipelines using AWS Comprehend for automated entity recognition in medical datasets.

Data Cleaning Data Normalization Data Validation NLP

Education

Degrees, certifications, and relevant coursework

University of Petroleum and Energy Studies

Bachelor of Technology, Computer Science

2018 - 2022

Activities and societies: Participant in Smart India Hackathon 2.0; Key Speaker at Technical Workshops organized by UPES Dehradun; Basketball and Badminton Player.

Pursued a Bachelor of Technology with Honors in Computer Science, specializing in Cloud Computing and Virtualization.