Open to opportunities

Jyoti Reddy

@jyotikeesari

Message

Senior Data Engineer with expertise in scalable data solutions.

United States

Message

What I'm looking for

I seek a challenging role in a dynamic environment that fosters growth and innovation.

I am a Senior Data Engineer with over 6 years of experience in architecting scalable data solutions on AWS and Azure. My expertise lies in designing real-time and batch data pipelines using services like Glue, Kinesis, Data Factory, and Databricks. I have a strong background in Big Data technologies, including Apache Spark, Kafka, and Hadoop, and I excel in translating complex data into actionable business insights.

Throughout my career, I have successfully implemented end-to-end data warehouse solutions using Redshift, Snowflake, and Azure Synapse, supporting high-volume analytics and reporting. I am proficient in CI/CD automation with Terraform, Jenkins, and Azure DevOps, and I have a commitment to continuous learning and improvement. My experience includes working in fast-paced, cross-functional environments where I have developed modular ETL workflows and automated data extraction routines, significantly improving reliability and reducing manual effort.

Experience

Work history, roles, and key accomplishments

Current

Sr. Data Engineer

Current

State Farm Insurance

Jan 2024 - Present (1 year 4 months)

Designed and deployed real-time and batch data pipelines using AWS Glue, Kinesis, and Lambda. Built data pipelines in Azure Databricks for fraud detection and data enrichment. Orchestrated workflows using Apache Airflow and Azure Data Factory, ensuring efficient data processing and analytics.

AWS Glue Kinesis Lambda Databricks Apache Airflow Python Snowflake ETL Data Warehousing Terraform

Data Engineer

Microsoft

Mar 2023 - Jan 2024 (10 months)

Created Bash scripts for automating data ingestion into AWS S3. Designed scalable data solutions using AWS services. Built ETL pipelines with Informatica and Python, and implemented real-time data streaming using Apache Kafka and AWS Lambda.

AWS S3 Informatica Python Apache Kafka ETL SQL Azure Synapse Terraform Power BI Tableau

Software Engineer

Wipro

Apr 2019 - Jul 2022 (3 years 3 months)

Developed ADF pipelines for data ingestion from various sources. Optimized SQL procedures for high-volume processing. Containerized applications using Docker and deployed on Azure Kubernetes Service, enhancing scalability and performance.

Azure Data Factory SQL Server Docker Azure Kubernetes Service T SQL Power BI Agile Informatica

Jr. Software Engineer

Genpact

Apr 2018 - Mar 2019 (11 months)

Processed CSV files for data extraction and cleaning. Developed ETL pipelines using Python and SQL. Assisted in building data validation routines and maintained documentation for automated workflows.

Python SQL ETL Data Validation Power BI Agile Data Processing Documentation Data Warehousing

Education

Degrees, certifications, and relevant coursework

webster University

master's, Information Technology and Management

2022 - 2024

Grade: 3.83

Activities and societies: Student Worker

Christu Jyothi Institute of Technology & Science

Bachelor of Technology, Electronics and Communications Engineering

2015 - 2019

Completed a Bachelor of Technology in Electronics and Communications Engineering, gaining foundational knowledge in electronic systems, communication technologies, and engineering principles.