Open to opportunities

Krishna Sanagapalli

@krishnasanagapalli

Message

Certified Data Engineer with 11+ years of IT experience.

India

Message

What I'm looking for

I am looking for a challenging role that fosters growth, innovation, and collaboration in data engineering.

I am a Certified Senior Data Engineer with over 11 years of extensive experience in designing, analyzing, developing, and managing ETL/ELT solutions. My expertise lies in leveraging Big Data technologies, including Hadoop, Spark, and Azure, to support business intelligence initiatives across various domains such as banking, e-commerce, and transportation.

Throughout my career, I have successfully implemented complex data pipelines using Azure Data Factory and Databricks, ensuring seamless data movement and transformation. I am adept at optimizing data workflows and enhancing system performance through effective data modeling and validation techniques. My strong analytical skills and ability to adapt quickly to changing environments have enabled me to contribute significantly to the success of the projects I have been involved in.

Experience

Work history, roles, and key accomplishments

Current

Azure Data Engineer

Current

American Airlines

Oct 2023 - Present (1 year 8 months)

Implemented ETL processes using Azure Data Factory to extract, transform, and load data from various sources into Azure data storage. Developed and optimized ETL processes using Azure Databricks for scalable big data processing. Ensured data security with Azure Key Vault and developed CI/CD pipelines for automating deployments.

Azure Data Factory Databricks Azure Key Vault CI CD SQL ETL Azure Functions

Azure Data Engineer

Penske USA (Capgemini)

Jan 2022 - Apr 2023 (1 year 3 months)

Developed, deployed, and maintained data services for multiple pipelines using Azure Data Factory. Created Databricks notebooks for data transformations and managed data in Azure Data Lake. Automated QA validations and implemented CI/CD pipelines for deployment.

Azure Data Factory Databricks Data Lake CI CD SQL Azure Blob Storage

AWS Data Engineer

Citi Bank USA (Capgemini)

Sep 2019 - Jan 2022 (2 years 4 months)

Developed PySpark jobs for data migration and implemented transformation logic based on business requirements. Optimized Hive queries and built end-to-end pipelines for data export from S3 to Amazon RDS.

Pyspark AWS Hive SQL Data Migration Jenkins Lambda RDS EMR

Data Engineer

Movimento-Delphi (Value Labs)

Jul 2015 - Aug 2019 (4 years 1 month)

Contributed to the design and development of data solutions for multiple clients. Configured Hadoop and Cassandra clusters, processed data using PySpark and Hive, and generated reports using Tableau.

Hadoop Cassandra Pyspark Hive Tableau Data Processing ETL SQL AWS Data Analysis

Java Developer

Snapfish USA (Value Labs)

Jul 2013 - Jul 2015 (2 years)

Integrated Spring Data modules and worked with Kafka for data processing. Developed web components and implemented complex SQL queries for data analysis. Deployed applications on client servers and provided production support.