Open to opportunities

Rydam Jain

@rydamjain

Message

Data Engineer building scalable ETL/ELT pipelines, lakehouse architectures, and governed big data workflows.

India

Message

What I'm looking for

I’m looking to grow in a role where I can build scalable ETL/ELT and lakehouse pipelines, optimize Spark performance and costs, and implement strong governance and orchestration on Azure/AWS with modern tooling.

I’m a Data Engineer who builds scalable ETL/ELT pipelines and data lakehouse architectures, delivering end-to-end solutions for enterprise clients (including HP). I focus on reliable, high-performance data workflows with strong governance, data modeling, and security controls.

In my recent role as a Senior Software Engineer (Data Engineer) at Info Objects, I designed and optimized Azure Databricks ETL pipelines, improving transformation performance by 4x. I also built lakehouse architecture on ADLS Gen2 and Delta Lake (ACID, schema evolution), developed incremental pipelines using Delta Lake MERGE operations, and integrated Azure Data Factory for orchestration.

Previously, as a Software Engineer (Data Engineer) at In Time Tec, I led migration from Dataiku DSS to Databricks Lakehouse—reducing processing time by 50% and cost by 20%. I implemented CI/CD with data quality checks, created Airflow DAGs and Azure Data Factory scheduling, mentored 5+ engineers, and served as Scrum Master to drive planning and delivery.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer (Data Engineer)

Current

Info Objects

Dec 2025 - Present (7 months)

Designed and optimized scalable ETL pipelines on Azure Databricks, building an ADLS Gen2 + Delta Lake lakehouse and improving data transformation performance by 4x. Implemented incremental pipelines with Delta Lake MERGE, orchestrated with Azure Data Factory, and enforced governance using Unity Catalog with monitoring and alerting.

Azure Databricks Azure ADLS Gen2 Delta Lake Apache Spark Azure Data Factory Unity Catalog Data Governance ETL ELT Monitoring Logging Alerting

Software Engineer (Data Engineer)

In Time Tec

Jan 2023 - Dec 2025 (2 years 11 months)

Built and maintained large-scale ETL/ELT pipelines using PySpark and Apache Spark (Spark SQL and Spark Streaming), and led migration from Dataiku DSS to Databricks Lakehouse for a 50% reduction in processing time and 20% cost reduction. Implemented CI/CD and data quality checks, scheduled orchestrations with Airflow and Azure Data Factory, developed DBT models, and worked with AWS services and gov