Open to opportunities

sudarshan reddy

@sudarshanreddy

Message

Experienced data engineer with expertise in ETL and data integration.

Zimbabwe

Message

What I'm looking for

I am seeking a role that offers opportunities for growth and challenges in data engineering.

I am a competent professional with over 5 years of IT experience specializing in data engineering functions. My expertise encompasses data extraction, transformation, loading, and integration, which supports enterprise data infrastructure. I have hands-on experience with data extraction from REST APIs, data munging, and data modeling, utilizing tools such as Python, Redshift, S3, and Snowflake.

In my current role as a Senior Data Engineer at Madul Tech Software Pvt Ltd, I have developed a standardized ETL process to load affiliate transaction data into Snowflake DWH and automated price updates using SQL. I am skilled in orchestrating and automating ETL pipelines using Apache Airflow, and I have a proven track record of providing data-driven solutions that support decision-making processes. My experience also includes data migration from Redshift to Snowflake and ensuring data accuracy and reliability through rigorous validation and troubleshooting.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Madul Tech Software Pvt Ltd

Dec 2022 - Present (2 years 7 months)

Analyzed client specifications and business processes, developing DQ scripts with SQL to track missing data. Designed and implemented an automated architecture for frequent price updates using SQL and control tables.

SQL Python Airflow Snowflake Redshift S3 GitHub Shell Scripting Data Modeling ETL

Senior Software Engineer

L&T Infotech

Jul 2022 - Nov 2022 (4 months)

Managed monthly data loading and reconciliation activities, ensuring data accuracy and consistency. Monitored production support, providing timely resolutions for failures and handling production issues.

Reconciliations Troubleshooting

Data Engineer

Yinbotech Systems Pvt.Ltd

Mar 2019 - Jan 2022 (2 years 10 months)

Created data pipelines in Azure Data Factory to copy data from various sources to Synapse, and transformed data using dataflow and Azure Databricks. Developed stored procedures for data manipulation in Synapse and generated PDF reports with Python.

Azure Data Factory Databricks Azure Synapse SQL Python GitHub Shell Scripting

Education

Degrees, certifications, and relevant coursework

Mahatma Gandhi Kasi VidhyaPith

Graduation, Unknown

Completed a graduation degree from Mahatma Gandhi Kasi VidhyaPith. This education provided a foundational understanding for a career in IT and data engineering.