Chinnolla Sathvik Reddy UserCU
Open to opportunities

Chinnolla Sathvik Reddy User

@chinnollasathvikredd

Data Engineer with 5 years' experience in scalable data pipelines.

United States
Message

What I'm looking for

I am seeking a role that fosters innovation and collaboration, where I can leverage my data engineering skills to drive impactful solutions and contribute to a dynamic team.

I am a Data Engineer with 5 years of experience specializing in building scalable data pipelines within Azure environments. My expertise lies in designing and deploying ETL solutions using Azure Data Factory, Databricks, and related tools, which streamline data transformation and enhance business intelligence. I excel in advanced data modeling and multi-layered architectures, consistently ensuring quality and efficiency in agile development settings.

Throughout my career, I have collaborated with business users to gather requirements and develop complex Spark applications using Scala. I have successfully migrated MapReduce programs to Spark for optimized processing and leveraged Python and PySpark in Azure Databricks to implement data quality checks. My experience also includes designing interactive dashboards using Power BI and creating scalable ETL pipelines to ingest data from various source systems into Azure Data Storage solutions.

I am passionate about utilizing my skills in data analysis, migration, cleansing, and integration to drive actionable insights. I thrive in collaborative environments and am committed to continuous improvement through Agile methodologies, ensuring that I contribute effectively to team success and project goals.

Experience

Work history, roles, and key accomplishments

CE
Current

Data Engineer

Centene

Jul 2024 - Present (1 year)

Collaborated with business users to gather and document evolving requirements, ensuring alignment with project goals. Developed complex Spark applications using Scala and migrated MapReduce programs to Spark for optimized processing. Leveraged Python and PySpark in Azure Databricks to build Spark scripts, implementing data quality checks to enhance processing time.

PA

Data Engineer

Paychex

Nov 2023 - Jun 2024 (7 months)

Led requirements gathering, analysis, design, development, change management, and deployment to ensure cohesive project execution. Developed Spark scripts with Scala shell commands for data cleansing and testing, and created Spark streaming pipelines for real-time data batching, anomaly detection, and integration with HBase. Engineered Spark applications in Scala and PySpark for data validation, c

VM

Data Engineer

VMWare

Jun 2022 - Jul 2023 (1 year 1 month)

Gathered and analyzed business requirements, designing data products to meet user needs and streamline data solutions. Developed Spark applications in Scala for large-scale data transformations, denormalization, and data quality checks on relational datasets. Converted Hive and SQL queries into Spark RDD transformations using Scala, optimizing data processing workflows.

VE

Data Engineer

Verisk

Mar 2020 - May 2022 (2 years 2 months)

Collaborated with Business Analysts and SMEs across departments to gather requirements and identify actionable development items. Engineered Spark applications in Scala for enriching clickstream data by merging it with user profile data, enhancing data relevance. Developed maintainable and scalable Python and Scala code for data processing, analytics, and application needs, leveraging inbuilt libr

Education

Degrees, certifications, and relevant coursework

Saint Peter's University logoSU

Saint Peter's University

Master of Science, Data Science

Pursued a Master of Science in Data Science. Gained expertise in data analysis, machine learning, and statistical modeling. Completed relevant coursework and projects in the field.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Chinnolla Sathvik Reddy User - Data Engineer - Centene | Himalayas