Open to opportunities

Bala santhosh

@balasanthosh

Message

I build governed, scalable Databricks data pipelines for enterprise analytics and reporting.

India

Message

What I'm looking for

I'm looking to build scalable, governed data platforms and reliable analytics pipelines, with opportunities to own data quality, cloud architecture, and Databricks/AWS delivery in Agile teams.

I've built and maintained Databricks and Delta Lake pipelines at LatentView Analytics for Adobe, ingesting marketing data from 20+ digital channels and owning 80+ production tables for global marketing and finance reporting.

I design API-driven ETL/ELT pipelines using Python, PySpark, SQL, AWS, Snowflake, and Medallion Architecture. I've also administered Unity Catalog, RBAC, cluster policies, service principals, and Databricks migrations while improving data quality through reconciliation and production issue resolution.

Across Vanguard, MERCK, and Accenture, I've delivered large-scale enterprise data ingestion, Airflow orchestration, AWS infrastructure support, CI/CD automation, and Spark SQL transformations. I'm a four-time certified data professional focused on scalable, secure, reliable data platforms.

Experience

Work history, roles, and key accomplishments

Current

Assistant Manager- Data Engineering

Current

LatentView Analytics - Adobe

Jun 2025 - Present (1 year 2 months)

Built and maintained large-scale batch ETL/ELT pipelines on Databricks and Delta Lake, ingesting marketing data from 20+ channels into a centralized Unity Catalog platform. Architected API-driven pipelines and implemented Medallion Architecture for unified reporting.

Databricks PySpark Delta Lake Unity Catalog Medallion Architecture Python SQL AWS Snowflake RBAC CI CD

Consultant

Vanguard – Deloitte USI Pvt Ltd

Jul 2024 - May 2025 (10 months)

Built and optimized scalable ETL pipelines on Databricks using PySpark, SQL, Delta Lake, and Unity Catalog. Managed Databricks workspace administration and operated AWS services for production pipeline support.

Databricks PySpark SQL Delta Lake Unity Catalog AWS Glue Lambda Step Functions CloudFormation S3 IAM Athena Sagemaker Bamboo Bitbucket GitHub

Data Engineering Analyst

MERCK – Accenture Solutions Pvt Ltd

Nov 2022 - May 2024 (1 year 6 months)

Implemented ELT pipelines for MERCK's Data Integration Framework using AWS, Databricks, and PySpark for large-scale enterprise data ingestion and transformation. Developed PySpark transformations and optimized SQL queries on Delta Tables.

AWS S3 EMR Lambda Glue Athena Databricks PySpark SQL Delta Lake Unity Catalog

Application Development Associate

Accenture Solutions Pvt Ltd

May 2021 - Nov 2022 (1 year 6 months)

Developed and managed ETL processes for a leading telecom client using Spark SQL for structured data transformations. Migrated product and discount datasets across sources and storage systems ensuring data accuracy.

ETL Data Migration