Gokul Palanivelu
@gokulpalanivelu
Experienced Data Quality Engineer with expertise in ETL and Big Data.
IndiaWhat I'm looking for
I am an accomplished Data Quality Engineer with 14 years of extensive experience in ETL/ELT and Big Data Testing. My proficiency in both manual and automation techniques allows me to effectively test data pipelines using Python, SQL, and orchestrate them with Apache Airflow. I have a strong background in handling multiple data sources, including structured and semi-structured data, and I excel in developing data workflows and pipelines using Pyspark and SQL.
Throughout my career, I have demonstrated success in managing multiple projects simultaneously, showcasing my strong organizational and time management abilities. I am committed to delivering high-quality solutions and driving continuous improvement through innovative approaches and best practices. My ability to mentor teams and guide them in automation skills fosters a collaborative and productive work environment, ensuring adherence to industry standards and best practices.
Experience
Work history, roles, and key accomplishments
Lead Software Engineer
EPAM
Jan 2022 - Present (3 years 4 months)
Currently leading data quality initiatives for a media company in Canada and a global provider of advanced analytics in life sciences. Developed ETL validation pipelines and quality metrics dashboards using Apache Airflow, Snowflake, and Python. Ensured compliance with regulatory requirements and identified automation opportunities.
Lead Software Engineer
EPAM
Jan 2022 - Present (3 years 4 months)
Currently leading data quality initiatives for a media company and a life sciences analytics provider. Developed ETL validation pipelines and data quality metrics dashboards using Apache Airflow, Snowflake, and Python. Implemented robust data validation rules and automated testing processes, ensuring compliance with regulatory standards.
Test Lead
Ernst and Young
Jan 2020 - Sep 2021 (1 year 8 months)
Led the development of data quality pipelines and onboarding activities using Azure Functions and Databricks. Created CI/CD pipelines for test automation and interactive test reports using Python and Dash. Built validation frameworks for API interactions and legacy table comparisons.
Test Analyst
Infosys
Jan 2015 - Aug 2020 (5 years 7 months)
Focused on data validation and automation in various industries, including semiconductor and auto finance. Developed test automation frameworks and validation reports using Python and Pandas. Led a team in requirement gathering and status reporting, ensuring data accuracy and integrity.
Test Lead
Ernst and Young
Jan 2020 - Jan 2021 (1 year)
Led the development of data quality pipelines and onboarding activities using Azure Functions and Databricks. Created CI/CD pipelines for test automation and interactive test reports using Python and Dash. Built validation frameworks for external APIs.
Test Analyst
Infosys
Jan 2015 - Jan 2020 (5 years)
Worked on data validation and testing for various industries including semiconductor and auto finance. Developed test automation frameworks and quality reports using Python and Dash. Led a team and conducted requirement gathering and status reporting.
System Engineer and Test Analyst
Air Compressor Manufacturer
Jan 2011 - Mar 2014 (3 years 2 months)
Designed and developed ETL jobs using SAP BODS. Collaborated with onshore teams for technical designs and handled data from various sources. Delivered high-quality components through effective ETL/reporting features.
System Engineer and Test Analyst
Air Compressor Manufacturer
Jan 2011 - Mar 2014 (3 years 2 months)
Designed and developed ETL jobs using SAP BODS, collaborating with onshore teams for technical designs. Managed data from various sources and ensured high-quality component delivery through effective ETL/reporting features.
Education
Degrees, certifications, and relevant coursework
Unknown
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Gokul?
You can contact Gokul and 90k+ other talented remote workers on Himalayas.
Message GokulFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
