Abinanthan Kandasamy

I’m an experienced Data Engineer with 4+ years of expertise building and modernising data platforms in cloud lakehouse environments, with a strong focus on end-to-end ETL/ELT pipelines, data transformation, validation, and advanced analytics. I design scalable cloud architectures and optimize performance to help teams deliver reliable, faster data processing for real business outcomes.

Across my roles, I’ve migrated and modernized data systems by converting complex legacy T-SQL logic into efficient PySpark workflows in Databricks, including SQL Server table and stored procedure migrations to PySpark notebooks in Azure Databricks. I’ve also strengthened data trust by implementing reconciliation and validation checks, establishing automated validation scripts and monitoring tools, and driving governance frameworks that reduce manual effort on large datasets.

I’m hands-on in building business-ready outputs—developing and enhancing Power BI dashboards for rule violations, exception records, and reporting visibility with automated refresh schedules. Alongside delivery, I’m certified (Databricks and Azure) and driven by problem-solving, continuous learning, and building innovative, data-driven business solutions, with proven leadership in governance and team management.