Open to opportunities

Abhishek Kirve

@abhishekkirve

Message

Data Engineer with 3+ years of experience in ETL and Spark.

India

Message

What I'm looking for

I am seeking a role that offers opportunities for growth and innovation in data engineering.

I am a dedicated Data Engineer with 3+ years of professional experience in the field. My expertise lies in developing robust ETL pipelines and working extensively with the Hadoop ecosystem, particularly HDFS, Hive, and Spark. I have a proven track record of executing parallel jobs and managing dependencies through Airflow, ensuring efficient data processing and job scheduling.

Throughout my career, I have successfully contributed to various projects, including creating ETL data pipelines for Exxon Mobility and Bajaj Allianz. My role involved gathering client requirements, transforming data, and delivering reports on time. I am adept at using tools like Azure Synapse and AWS for data integration and have a strong foundation in Python, PySpark, and SQL, which I leverage to optimize performance and ensure data integrity.

Experience

Work history, roles, and key accomplishments

Data Engineer

Murphy Oil Corporation

May 2021 - Jun 2021 (1 month)

Migrated data from Hadoop Hive to SQL Server, ensuring data integrity and scheduling jobs using Cron Scheduler.

Hadoop SQL Server Data Migration

Data Engineer

Healthcare Project

Apr 2021 - May 2021 (1 month)

Involved in data extraction and integration from multiple Amazon RDS sources to consolidate into an enterprise data lake using advanced Spark transformations. Mentored team members and monitored performance.

AWS Redshift Spark Data Integration ETL Mentoring Performance Monitoring Data Analysis

Data Engineer

Healthcare Domain Project

Apr 2021 - May 2021 (1 month)

Led data extraction and integration from multiple Amazon RDS sources to an enterprise data lake using advanced Spark transformations.

AWS Redshift Spark ETL Data Integration

Data Engineer

Sagility

Mar 2021 - Apr 2021 (1 month)

Built ETL data pipelines using Azure Synapse, implementing automation and audit mechanisms for data processing.

Azure Synapse SQL Spark Dataflow ETL

Data Engineer

Bajaj Allianz India Pvt Ltd

Feb 2021 - Mar 2021 (1 month)

Created ETL processes and job dependencies using Airflow. Responsible for data transformation and timely reporting to clients.

Python Spark PostgreSQL Airflow ETL

Data Engineer

Exxon Mobility

Jan 2021 - Feb 2021 (1 month)

Developed ETL data pipelines using Databricks to transform data from various sources. Responsible for gathering requirements, data transformation, and timely delivery of projects.

Python Spark Databricks ETL SQL