Open to opportunities

Sourabh Joshi

@sourabhjoshi3

Message

Data Engineering Lead with 11 years delivering scalable data platforms, DataOps, and data quality on AWS/Azure.

India

Message

What I'm looking for

I’m looking to lead end-to-end data engineering—designing scalable pipelines, strengthening DataOps and governance, and mentoring teams—so we deliver reliable, high-quality analytics that unlock business value.

I am a passionate and results-driven Data Engineering Lead with 11 years of experience in designing, building, and optimising data pipelines and workflows. I deliver scalable and efficient solutions for complex enterprise data challenges, grounded in reliable data infrastructure and robust data management practices.

At Tesco Bank (2016–2024), I led cloud-native data solutions across AWS and Azure, improving cloud-based analytics, data governance, and operational excellence. I also took on versatile roles as a Cloud Engineer and Cloud Data Engineer, specializing in data architecture design and scalable pipeline optimization.

My impact includes spearheaded creation of a strategic roadmap for scalable information delivery, conceptualizing and establishing a comprehensive DataOps framework, and architecting a cutting-edge data quality framework to enhance accuracy and reliability. I designed and implemented automation/testing using BDD and TDD methodologies, improving quality and efficiency and enabling a 30% reduction in ETL testing time.

I thrive in cross-functional teams, mentoring and collaborating to unlock the true potential of data assets. I actively contribute to the Open Source Data Tools Community and authored a blog series focused on leveraging open-source data tools for modern data engineering challenges.

Experience

Work history, roles, and key accomplishments

Data Engineering Lead

Tesco Bank Barclays

Jan 2016 - Jan 2024 (8 years)

Spearheaded an enterprise data engineering roadmap and built a DataOps framework to streamline data and analytics workflows. Architected data governance and data quality frameworks, and automated testing (BDD/TDD) to improve reliability and operational excellence.

AWS Azure DataOps Data Governance Data Quality Data Warehousing ETL ELT CI CD TDD

Data Analyst

ANZ Operations and Technology

Jan 2015 - Jan 2016 (1 year)

Created ETL and BI reporting workflows and developed actionable dashboards to support data-driven decision-making. Engineered an ETL testing sample data generator tool, reducing testing time by 30%.

ETL BI Reporting Python SQL Data Quality Data Validation Pandas Apache Superset

Data Engineer

Accenture Services

Jan 2013 - Jan 2015 (2 years)

Developed and optimized data extraction, transformation, and loading pipelines to ensure high-performance integrations and accurate data migration. Implemented cost-optimization and automated testing solutions, reducing manual effort and improving pipeline efficiency.

Python ETL ELT SQL Apache Airflow DBT Spark Data Pipelines Data Validation

Data Engineer Intern

Datagenic India

Jan 2012 - Jan 2013 (1 year)

Built data pipelines and performed dataset transformations while collaborating with senior engineers to improve data accuracy and automate reporting workflows. Supported end-to-end data pipeline development for reliable data delivery.

Spark Kafka Python ETL Data Pipelines data transformation AWS S3 Data Modeling