Open to opportunities

JAYASRI YALAVARTHI

@jayasriyalavarthi

Message

Experienced Data Engineer with a passion for scalable data solutions.

United States

Message

What I'm looking for

I am looking for a role that fosters innovation, collaboration, and growth in data engineering and cloud technologies.

I am an experienced Data Engineer with over 8 years of expertise in architecting, developing, and optimizing scalable data pipelines and cloud-native solutions across Azure, AWS, and GCP. My proficiency in building and orchestrating end-to-end ETL/ELT pipelines using tools like Azure Data Factory and AWS Glue has enabled me to deliver high-performance data solutions tailored to business needs.

Throughout my career, I have successfully led data migration projects, ensuring zero data loss and optimized performance. I have a strong background in cloud-based data engineering, data modeling, and machine learning integrations, which allows me to drive continuous innovation and deliver actionable insights. My collaborative approach and ability to work cross-functionally have been key to my success in delivering business-driven data solutions.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Prominent Insurance

Apr 2024 - Present (1 year 3 months)

Involved in requirement gathering, architecture development, design, development, and deployment of solutions built on the Azure Data Factory platform. Developed high performant data ingestion pipelines from multiple sources using Azure Data Factory and Azure Databricks.

Azure Data Factory Databricks ETL PowerShell Azure SQL Azure Synapse Python Pandas Pyspark ArcGIS BigQuery Google Cloud Storage

Data Engineer

CVS Healthcare

Jul 2022 - Present (3 years)

Designed and managed scalable data pipelines using Azure Data Factory and Snowflake, enabling seamless data ingestion, transformation, and integration from multiple sources. Migrated legacy systems to Azure and Snowflake, significantly improving performance, reducing operational costs, and enhancing data accessibility and scalability.

Azure Data Factory Snowflake Delta Lake Python Azure Functions Azure DevOps CI CD Cloud Build GitHub

Data Engineer

Zoho

Jan 2020 - Present (5 years 6 months)

Developed and optimized Spark jobs using Python, Spark SQL, and Data Frames for complex data transformations, aggregations, and batch processing workflows. Managed and optimized ETL pipelines using PySpark on AWS EMR and Glue, processing 10TB+ datasets daily and improving data ingestion speed by 67%.

Spark Python Avro Parquet JSON CSV AWS S3 AWS Glue EC2 Power BI Tableau PowerShell Hadoop Hive Kafka AWS Step Functions

Data Engineer

IBM

Mar 2017 - Present (8 years 4 months)

Tuned and optimized new ETL processes for faster load times and reduced resource consumption. Designed and implemented scalable data pipelines to collect, process, and store data.

Keras NumPy Spark ETL Data Pipelines Scala Pyspark APIs Databases Data Validation Data Security Query Optimization Indexing Partitioning Caching

Education

Degrees, certifications, and relevant coursework

Zoho

Bachelor of Technology, Computer Science

Developed and optimized Spark jobs using Python, Spark SQL, and Data Frames for complex data transformations, aggregations, and batch processing workflows. Worked with data serialization formats like Avro, Parquet, JSON, and CSV; applied techniques such as partitioning, compression, and caching for performance tuning.