Open to opportunities

Nrupali Patel

@nrupalipatel

Message

Results-driven Senior Data Engineer with extensive experience in data solutions.

United States

Message

What I'm looking for

I am seeking a role that fosters innovation and collaboration, with opportunities for growth and impactful projects.

I am a results-driven Senior Data Engineer with over 9 years of experience in designing, building, and optimizing data pipelines and large-scale data solutions. My expertise lies in developing robust ETL/ELT workflows using Apache Spark, Databricks, and Airflow, which support advanced analytics and machine learning initiatives. I have a proven track record of working in multi-cloud environments, including Azure, AWS, and GCP, focusing on data engineering and platform modernization.

Throughout my career, I have successfully led the migration of on-premise data pipelines to the cloud, improving performance and scalability while reducing infrastructure costs. I am skilled in implementing real-time and batch data processing, utilizing technologies such as Spark Structured Streaming, Kafka, and Snowflake. My strong programming background in Python, Scala, and SQL has enabled me to automate data processing and enhance performance tuning, ensuring high-quality data solutions for my teams.

Experience

Work history, roles, and key accomplishments

Current

Sr. Data Engineer

Current

SunPower Corporation Inc

Apr 2022 - Present (3 years 3 months)

Led the design and implementation of scalable, cloud-native ETL pipelines on Databricks, processing billions of energy and customer data records. Engineered real-time and batch data workflows using Apache Spark, Scala, and Python, reducing report latency by 65%.

Data Engineer

Bank of America

Apr 2021 - Mar 2022 (11 months)

Designed and developed ETL pipelines using Apache Spark, Scala, and Python to support large-scale financial transaction processing and reporting. Built and maintained batch and streaming data pipelines using Apache Spark Structured Streaming and Kafka, ensuring near real-time data availability.

Apache Spark Scala Python Spark Structured Streaming Kafka AWS Glue S3 Azure SQL Databricks Snowflake MySQL Oracle Sqoop Hadoop HDFS Hive Airflow Datadog)

Senior Data Engineer

A2Z Solutions

Mar 2018 - Feb 2021 (2 years 11 months)

Designed and maintained SQL-based dashboards and reports for business stakeholders across operations, finance, and product teams. Developed Python scripts to automate repetitive data cleansing, aggregation, and reporting tasks, improving efficiency and reducing manual effort.

SQL Python Tableau Power BI Agile Data Modeling Data Quality ETL

Data Analyst

SilverStripe Software

Jun 2016 - Feb 2018 (1 year 8 months)

Developed and maintained SQL-based reports and dashboards to support business decisions in retail operations, marketing, and supply chain. Automated recurring reporting processes using Python scripts, reducing manual effort by 50% and improving accuracy.