Open to opportunities

Srikumar Subramanian

@srikumarsubramanian

Message

Senior Data Engineer specializing in scalable ETL, Databricks, and cloud pipelines.

India

Message

What I'm looking for

I seek a hands-on data engineering role building scalable, automated, observable ETL and data platform solutions with strong emphasis on CI/CD, data quality, and collaboration with analytics/ML teams.

I am a Senior Data Engineer with 7+ years designing scalable distributed data pipelines across Databricks, PySpark, AWS, and Azure for Banking, Finance, Pharma, and Retail digital products.

I have architected and orchestrated 100+ production pipelines, built CI/CD-enabled ETL frameworks using GitLab CI, and implemented robust data quality guardrails with Pydantic and Medallion architectures to improve resilience and RCA.

My hands-on achievements include processing 2TB+ daily transactions, implementing Databricks Auto Loader and Spark Structured Streaming, automating ingestion with AWS Lambda and Step Functions, and tuning Delta Lake performance with Z-ordering, bucketing, and partitioning.

I partner effectively with analytics and ML teams to deliver KPI dashboards and predictive pipelines, and I focus on automation, observability, and secure, high-availability data platforms.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Tiger Analytics

Jan 2025 - Present (11 months)

Designed end-to-end ETL pipelines processing 2TB+ daily transactions using Databricks, PySpark, Airflow and AWS, and implemented CI/CD and data quality modules to improve ETL resilience and near real-time availability.

Databricks Pyspark Airflow AWS Lambda Gitlab CI Delta Lake Pydantic Ansible

Senior Data Engineer

PwC AC

Aug 2022 - Jan 2025 (2 years 5 months)

Built reporting and compliance solutions for pharma using SnapLogic, SQL Server and Databricks, developed Delta Lake transformations and optimization techniques to accelerate analytics and ensure schema consistency.

Snaplogic SQL Server Databricks Delta Lake Power BI Alteryx SQL Partitioning

Data Engineer

Cognizant

Dec 2021 - Aug 2022 (8 months)

Built ETL modules in BigQuery and dashboards in Data Studio to detect spam/illegal listings, collaborating with ML teams to improve fraud detection by ~15% via data pipelines and DQ checks.

BigQuery Google Data Studio ETL Data Quality SQL Anomaly Detection Collaboration

Data Analyst

TechMahindra

Apr 2018 - Dec 2021 (3 years 8 months)

Delivered real-time Power BI dashboards for operational insights and fraud detection, built a Python data-masking tool processing 1.5M+ records daily that reduced third-party costs and streamlined reporting.

Power BI Python SQL Data Masking Stored Procedures Dashboarding