Looking for a job

Sumit jha

@sumitjha2

Senior Data Engineer at ADM building Databricks and SAP Datasphere pipelines, including Spark tuning that cut execution time 30%+.

India

Message

At Archer Daniels Midland (ADM), I build and maintain Databricks pipelines across Bronze, Silver, and Gold layers, and develop SAP Datasphere pipelines across Inbound, Harmonization, and Reporting layers. I optimized Spark jobs to improve pipeline execution time by 30%+.

I also create data models and Power BI dashboards, tune report performance, and implement CI/CD promotion across DEV, QA, UAT, and PROD. Previously, at Accenture, I improved data accuracy by 40%+ through validation checks, reconciliation rules, and governance controls.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Archer Daniels Midland

Jul 2022 - Present (4 years 3 months)

Built and maintained Databricks pipelines across Bronze, Silver, and Gold layers, and developed SAP Datasphere pipelines for enterprise analytics. Optimized cluster configurations and implemented CI/CD pipelines, improving pipeline execution time by 30%+.

Databricks SAP Datasphere Apache Spark PySpark ETL Data Modeling Power BI CI CD Azure SQL Python SAP S 4HANA CDS Views SAP BW Azure Machine Learning Data Lineage Row level security

Data Engineer Analyst

Accenture

Jun 2021 - Jul 2022 (1 year 1 month)

Owned end-to-end data pipelines and analytics solutions, translating business requirements into scalable KPI models and dashboards. Resolved 90%+ of production issues within SLA and improved data accuracy by 40%+ through validation and governance controls.

Data Pipelines KPI Dashboards Power BI Jira Data Quality Validation Governance SQL Python

Associate Technology L1

Publicis Sapient

May 2019 - Jun 2021 (2 years 1 month)

Led stakeholder engagements and architected enterprise analytics and KPI frameworks using Power BI. Designed automated data workflows with Shell scripting and Cron jobs, and optimized Hadoop and Hive platforms for large-scale processing.

Power BI Shell Scripting Cron Hadoop Hive ETL Row level security Data Governance

Quality Assurance Analyst

Twinspark

Aug 2018 - Mar 2019 (7 months)

Led projects and coordinated with cross-functional teams to ensure quality delivery. Analyzed requirements and developed specification documents and test use cases.

Quality Assurance Test Case Development Requirements Analysis Cross functional Coordination