Himalayas logo
SA
Open to opportunities

Saptarshi Acharyya 18

@saptarshiacharyya18

Data Engineer specializing in Azure, Spark, and real-time data pipelines to drive business insights.

India
Message

What I'm looking for

I seek roles building scalable, real-time data platforms on cloud (Azure) with opportunities to lead pipeline architecture, mentor engineers, and improve data governance and performance.

I am a results-oriented Data Engineer with nearly four years of experience designing and implementing scalable, high-performance data pipelines and real-time streaming systems on Azure and Spark technologies.

At Infosys, I architected and executed data transformation pipelines using Scala and PySpark within Azure Data Factory and Databricks, modernized legacy batch jobs to reduce runtimes by over 90%, and decoupled transactional and analytical processes to improve data accessibility.

I leverage AI-driven tools to automate schema generation, anomaly detection, and test planning, and I built monitoring and governance frameworks using PowerBI and cloud-native tools to ensure data integrity, SLA adherence, and proactive issue resolution.

I mentor junior engineers, lead cross-functional collaboration, and continuously optimize performance and resource allocation on platforms like Azure Synapse, Databricks, Kafka, and Spark to deliver reliable, compliant data solutions for product-based organizations.

Experience

Work history, roles, and key accomplishments

IL
Current

Data Engineer

Nov 2021 - Present (3 years 11 months)

Architected and executed scalable data transformation pipelines on Azure Databricks and Data Factory, modernizing legacy batch jobs to reduce processing runtimes by over 90% and improving data accessibility with near-real-time ingestion for financial operations.

Education

Degrees, certifications, and relevant coursework

IM

Institute of Engineering and Management

Bachelor of Technology, Electrical and Electronics Engineering

2017 - 2021

Completed a B.Tech. in Electrical and Electronics Engineering at the Institute of Engineering and Management from 2017 to 2021.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Saptarshi Acharyya 18 - Data Engineer - Infosys Ltd. | Himalayas