Saptarshi Acharyya 18
@saptarshiacharyya18
Data Engineer specializing in Azure, Spark, and real-time data pipelines to drive business insights.
What I'm looking for
I am a results-oriented Data Engineer with nearly four years of experience designing and implementing scalable, high-performance data pipelines and real-time streaming systems on Azure and Spark technologies.
At Infosys, I architected and executed data transformation pipelines using Scala and PySpark within Azure Data Factory and Databricks, modernized legacy batch jobs to reduce runtimes by over 90%, and decoupled transactional and analytical processes to improve data accessibility.
I leverage AI-driven tools to automate schema generation, anomaly detection, and test planning, and I built monitoring and governance frameworks using PowerBI and cloud-native tools to ensure data integrity, SLA adherence, and proactive issue resolution.
I mentor junior engineers, lead cross-functional collaboration, and continuously optimize performance and resource allocation on platforms like Azure Synapse, Databricks, Kafka, and Spark to deliver reliable, compliant data solutions for product-based organizations.
Experience
Work history, roles, and key accomplishments
Architected and executed scalable data transformation pipelines on Azure Databricks and Data Factory, modernizing legacy batch jobs to reduce processing runtimes by over 90% and improving data accessibility with near-real-time ingestion for financial operations.
Education
Degrees, certifications, and relevant coursework
Institute of Engineering and Management
Bachelor of Technology, Electrical and Electronics Engineering
2017 - 2021
Completed a B.Tech. in Electrical and Electronics Engineering at the Institute of Engineering and Management from 2017 to 2021.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Saptarshi?
You can contact Saptarshi and 90k+ other talented remote workers on Himalayas.
Message SaptarshiFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
