Looking for a job

Manjot Singh

@manjotsingh7

Message

Senior Data Engineer building cloud-native lakehouse ETL and AI solutions on AWS/Azure.

India

Message

What I'm looking for

I’m looking to build scalable cloud-native lakehouse and ETL systems with strong governance and compliance, using Databricks/AWS/Azure. I want to own architecture decisions, ship production-grade pipelines, and deliver measurable cost and efficiency gains.

I’m a Senior Data Engineer with 5+ years of experience designing and delivering cloud-native Lakehouse architectures, large-scale ETL pipelines, and AI-powered data solutions across AWS, Azure, and Databricks. I’ve led end-to-end enterprise data platform initiatives—owning architecture design, technical decision-making, and stakeholder communication—while delivering measurable impact like $1M in cost reduction, a 90% reduction in manual effort, and 400+ production-grade pipelines.

My work is grounded in modern Databricks capabilities (Delta Live Tables, Auto Loader, PySpark) and strong governance (Unity Catalog, RBAC, GxP/SOX/PII compliance, and data lineage). I build secure, scalable pipelines using Medallion Architecture, enforce validation at the table and row level, and translate complex data engineering into reliable analytics-ready datasets for teams.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Aptus Data Labs

Jul 2023 - Present (2 years 11 months)

Led end-to-end delivery of an enterprise lakehouse modernization on AWS/Databricks, designing ingestion and curated datasets with GxP/PII compliance and reusable ETL templates. Delivered measurable impact across 400+ production pipelines, including $1M cost reduction and a 90% reduction in manual effort.

Delta Lake Unity Catalog Medallion Architecture Pyspark AWS S3 AWS Glue GxP & PII Compliance

Data Engineer

Aptus Data Labs

Jul 2022 - Jun 2023 (11 months)

Built automated Azure Databricks pipelines for document processing and validation using AWS Textract, enabling early cash flow issue detection and $1M cost reduction. Developed a scalable caregiver messaging system with Azure Communication Service and optimized caregiver-response tracking to improve workload efficiency by 89%.

Azure Databricks Azure Messaging Services Azure Blob Storage Document Processing SpaCy Universal Sentence Encoder Data Validation Cost Optimization

Junior Data Engineer

Aptus Data Labs

Jun 2021 - Jun 2022 (1 year)

Digitized and orchestrated enterprise audit workflows by building form-based automation and scheduling pipelines with Apache Airflow, using Python and Trino for federated queries. Delivered Web3/NFT metadata extraction and ML-driven credit risk analytics, including a RandomForestClassifier to mitigate defaults across loans totaling approximately $3.5M.

Apache Airflow Python PostgreSQL Web3 Etherscan Extraction AWS EC2 SQL Reconciliation