Looking for a job

Avinash kumar

@avinashkumar35

Associate Manager, Data Engineer at Tredence, building governed Supply Chain data pipelines across 100+ enterprise tables.

India

Message

What I'm looking for

I’m looking for remote opportunities in ETL and Data Engineering where I can use my 10+ years of experience with Python, PySpark, SQL, Databricks, and cloud data platforms. I enjoy solving real-world data problems, building reliable pipelines, and working with teams across different locations to deliver practical, scalable solutions.

At Tredence, I design end-to-end ETL pipelines for Mars Pet Nutrition’s Supply Chain domains, using SAP and OMP source data. I own Silver-layer engineering across 100+ enterprise tables and support promotions from DEV through QA to PROD.

I implemented data observability and quality checks, including schema, null, range, and accepted-value validations. I also work with governance and observability teams on documentation and production readiness.

At Altimetrik for Novartis, I developed ETL processes for PNO data, added incremental processing and data quality checks in Databricks, and managed governed Delta tables with Unity Catalog. I integrated curated data into Snowflake for a consolidated analytical view.

Earlier, I built PySpark pipelines for Nike at Kloud9 and worked on analytics and data engineering at Coredge.io, Essar, and HyperCityFresh.com. My project work includes a 10M-records-per-day Nike pipeline and Delta Lake platforms for Novartis and Mars Pet Nutrition.

Experience

Work history, roles, and key accomplishments

Current

Associate Manager, Data Engineer

Current

Tredence

Sep 2024 - Present (2 years 1 month)

Designed and implemented end-to-end ETL pipelines across multiple Supply Chain domains, ingesting data from SAP and OMP. Own Silver-layer data engineering for 100+ enterprise tables and lead DEV to PROD code promotions.

Azure Databricks PySpark Delta Lake Azure Data Factory SQL SAP OMP Data Quality Data Observability Data Governance

Senior Data Engineer

Altimetrik

Jul 2023 - Sep 2024 (1 year 2 months)

Designed and developed ETL processes for PNO data, ensuring reliable and scalable data movement. Developed Databricks notebooks implementing data quality checks and integrated curated data into Snowflake.

Databricks PySpark Delta Lake Unity Catalog Snowflake SQL Data Quality ETL

Data Engineer

Kloud9

Aug 2021 - Jul 2023 (1 year 11 months)

Designed and developed highly scalable PySpark data pipelines to ingest large-volume data from multiple source systems into the enterprise data warehouse. Implemented Airflow DAG monitoring and configured alerts for missed or delayed executions.

PySpark Apache Spark Airflow SQL Data Warehouse ETL Data Mapping

Senior Software Engineer

Coredge.io

Nov 2020 - Jul 2021 (8 months)

Built interactive Kibana dashboards and Apache Superset reports for telecom and CDN analytics. Optimized curated datasets using Spark, improving query performance by 99%.

Kibana Apache Superset Spark Data Visualization ETL Observability

Deputy Manager – Analytics

Essar

Apr 2018 - Sep 2019 (1 year 5 months)

Explored data in Jupyter Notebook using Python, performing ad-hoc analyses to uncover trends. Produced Tableau visualizations for campaign management and member targeting.

Python Jupyter Notebooks Tableau SQL ETL Data Quality

Data Analyst

E-Commerce (HyperCityFresh.com)

Jun 2017 - Mar 2018 (9 months)

Owned analytics for online operations, driving profitability through data-led insights. Built Tableau dashboards to address business problems and monitor KPIs.

Tableau SQL Data Analysis Customer Segmentation Regression Modeling

Analyst (Trainee)

C1 India Pvt Ltd

Mar 2017 - May 2017 (2 months)

Configured Database Mail and scheduled jobs to alert on SQL job failures for proactive support. Set up and troubleshot transactional replication, minimizing end-user downtime.

SQL Server Database Administration Troubleshooting Performance Optimization