Open to opportunities

Astha Joshi

@asthajoshi

Message

Skilled software engineer specializing in data engineering and cloud solutions.

India

Message

What I'm looking for

I am seeking opportunities that allow me to leverage my skills in data engineering and cloud technologies, while fostering a collaborative and innovative work environment.

I am a dedicated software engineer with a strong focus on data engineering and cloud solutions. Currently, I am involved in a significant project migrating ETL data pipelines to Google Cloud Platform (GCP) for American Express, where I designed a scalable architecture that ensures regular data sync-ups. My experience includes working with high-volume data streams and contributing to back-end components that enhance data infrastructure, utilizing technologies such as BigQuery, Pub/Sub, and Kafka.

Previously, I developed a data catalog management application for Bank of America, where I successfully processed around 30 million records through a single batch job. My technical expertise spans various programming languages and tools, including Python, Java, Apache Spark, and ETL processes. I thrive in collaborative environments and enjoy working closely with stakeholders to deliver data-driven solutions that meet business needs.

Experience

Work history, roles, and key accomplishments

Current

Software Engineer

Current

Impetus

Aug 2024 - Present (11 months)

Designed a scalable and resilient architecture to migrate existing ETL data pipelines on GCP for regular data sync-ups. Worked on creating channels to stream high volume data to address business KPIs.

GCP BigQuery Dataflow Pub Sub Python ETL Hive Apache Kafka Airflow

Software Engineer

Impetus

Nov 2023 - Jul 2024 (8 months)

Designed and developed a data catalog management application from scratch for a client to catalog data from different sources daily. Developed Spark jobs to fetch metadata from multiple source databases and populate it in the target database.

Python ETL Oracle Bash Scripting

Associate Software Engineer

Impetus

Apr 2023 - Aug 2023 (4 months)

Designed an efficient service architecture, choosing the most efficient services for the use case. Created an ETL framework, data pipelines, and set up integrations to sync full load, incremental, and CDC data from the source channel.

Java Spring Boot Python MySQL GCP Dataflow Cloud Functions Cloud Pub Sub Google Cloud Storage Google BigQuery

Project Trainee

Impetus

Jan 2022 - Jun 2022 (5 months)

Designed and analyzed the problem statement to build an online application with three end-users: customer, underwriter, and admin. Implemented an efficiently managed solution using optimized code and algorithms to build the application.

Java REST Hibernate

Education

Degrees, certifications, and relevant coursework

Medi-Caps University

Bachelor of Technology, Computer Science Engineering

Completed a Bachelor of Technology in Computer Science Engineering. The curriculum focused on core computer science principles and their applications.