Looking for a job

SATYAM PANDEY

@satyampandey5

Message

I build Azure Databricks finance data products, agentic NLP solutions, and high-performance Medallion pipelines.

India

Message

At ZS Associates, I build client-facing finance data products on Azure Databricks, including an agentic NLP query solution on Databricks Genie that reached 78% accuracy and lets 15+ stakeholders query finance data without SQL.

I architect Medallion-based pipelines that consolidate SAP HANA, NetSuite, JD Edwards, and user-managed data into ADLS. I also optimized a daily ETL pipeline processing about 100 million rows, reducing processing time by 70%.

Previously at Celebal Technologies, I developed Delta Live Tables pipelines and SAP ingestion accelerators while improving processing speed with PySpark and Spark SQL. I lead delivery from LLD/HLD design through QA, production cutover, incident RCA, and team onboarding.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

ZS Associates

Apr 2024 - Present (2 years 5 months)

Built an agentic NLP query solution on Databricks Genie for Gold-layer metric views, reaching 78% accuracy and enabling 15+ business stakeholders to self-serve finance data without SQL. Architected Medallion-based pipelines on Azure, consolidating SAP, NetSuite, and JDE data into ADLS for a client-facing finance data product.

Databricks Azure Databricks Genie Medallion Architecture SAP Hana NetSuite JDEdwards ADLS ETL PySpark Spark SQL Delta Lake Databricks Workflows LLD HLD SDLC RCA Team Leadership

Data Engineer

Celebal Technologies

Feb 2023 - Jan 2024 (11 months)

Designed and deployed Medallion-based Delta Live Tables pipelines, reducing processing time by 20% and improving data reliability. Built a reusable SAP accelerator to automate data ingestion from SAP ECC into ADLS, and migrated data from various sources into Azure Data Lake Storage using Azure Data Factory.