Chinnolla Sathvik Reddy User
@chinnollasathvikredd
Data Engineer with 5 years' experience in scalable data pipelines.
What I'm looking for
I am a Data Engineer with 5 years of experience specializing in building scalable data pipelines within Azure environments. My expertise lies in designing and deploying ETL solutions using Azure Data Factory, Databricks, and related tools, which streamline data transformation and enhance business intelligence. I excel in advanced data modeling and multi-layered architectures, consistently ensuring quality and efficiency in agile development settings.
Throughout my career, I have collaborated with business users to gather requirements and develop complex Spark applications using Scala. I have successfully migrated MapReduce programs to Spark for optimized processing and leveraged Python and PySpark in Azure Databricks to implement data quality checks. My experience also includes designing interactive dashboards using Power BI and creating scalable ETL pipelines to ingest data from various source systems into Azure Data Storage solutions.
I am passionate about utilizing my skills in data analysis, migration, cleansing, and integration to drive actionable insights. I thrive in collaborative environments and am committed to continuous improvement through Agile methodologies, ensuring that I contribute effectively to team success and project goals.
Experience
Work history, roles, and key accomplishments
Data Engineer
Centene
Jul 2024 - Present (1 year)
Collaborated with business users to gather and document evolving requirements, ensuring alignment with project goals. Developed complex Spark applications using Scala and migrated MapReduce programs to Spark for optimized processing. Leveraged Python and PySpark in Azure Databricks to build Spark scripts, implementing data quality checks to enhance processing time.
Data Engineer
Paychex
Nov 2023 - Jun 2024 (7 months)
Led requirements gathering, analysis, design, development, change management, and deployment to ensure cohesive project execution. Developed Spark scripts with Scala shell commands for data cleansing and testing, and created Spark streaming pipelines for real-time data batching, anomaly detection, and integration with HBase. Engineered Spark applications in Scala and PySpark for data validation, c
Data Engineer
VMWare
Jun 2022 - Jul 2023 (1 year 1 month)
Gathered and analyzed business requirements, designing data products to meet user needs and streamline data solutions. Developed Spark applications in Scala for large-scale data transformations, denormalization, and data quality checks on relational datasets. Converted Hive and SQL queries into Spark RDD transformations using Scala, optimizing data processing workflows.
Data Engineer
Verisk
Mar 2020 - May 2022 (2 years 2 months)
Collaborated with Business Analysts and SMEs across departments to gather requirements and identify actionable development items. Engineered Spark applications in Scala for enriching clickstream data by merging it with user profile data, enhancing data relevance. Developed maintainable and scalable Python and Scala code for data processing, analytics, and application needs, leveraging inbuilt libr
Education
Degrees, certifications, and relevant coursework
Saint Peter's University
Master of Science, Data Science
Pursued a Master of Science in Data Science. Gained expertise in data analysis, machine learning, and statistical modeling. Completed relevant coursework and projects in the field.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Chinnolla Sathvik Reddy?
You can contact Chinnolla Sathvik Reddy and 90k+ other talented remote workers on Himalayas.
Message Chinnolla Sathvik ReddyFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
