Preyanshu Gupta
@preyanshugupta
Highly skilled Lead Data Engineer with expertise in Big Data analytics.
What I'm looking for
I am a Lead Data Engineer with over 11 years of experience specializing in Big Data and Data Analytics at scale. My expertise lies in utilizing technologies such as Apache Spark, Scala, and AWS to design robust and highly scalable data pipelines. I have a proven track record of leveraging advanced data analysis and machine learning techniques to derive actionable insights, particularly in the US healthcare sector.
In my current role at Demandbase, I successfully led the implementation of a RAG pipeline that improved contact accuracy by 5% and developed end-to-end data pipelines that increased efficiency by 9x. My leadership experience includes managing a diverse team of data engineers, data scientists, and research analysts, driving significant improvements in data coverage and operational efficiency. I am passionate about solving high-impact challenges and continuously seek innovative solutions to enhance data-driven decision-making.
Experience
Work history, roles, and key accomplishments
Lead Data Engineer
Demandbase
Jan 2022 - Present (3 years 4 months)
As a Lead Data Engineer at Demandbase, I led the implementation of a RAG pipeline, enhancing contact accuracy by 5%. I developed end-to-end data pipelines, increasing efficiency by 9x for managing datasets of 100M companies and integrated mapping for 3 million new companies, achieving a 50% growth in data scope.
Consultant
Deloitte
Aug 2017 - Jan 2022 (4 years 5 months)
At Deloitte, I led the development of a data pipeline using Apache Spark, reducing processing time by 90%. I enhanced application performance by 30% through Spark tuning and SQL optimization, and delivered full automation using CI/CD pipelines, reducing deployment time by 80%.
Research Analyst
ConvergeHealth by Deloitte
Jul 2015 - Aug 2017 (2 years 1 month)
In my role as a Research Analyst, I implemented machine learning and optimization models to tackle healthcare challenges, reducing hospital staffing needs by 20% and increasing operating room utilization by 25% through linear programming.
Software Developer
Infogain India Pvt. Ltd
Apr 2011 - Apr 2013 (1 year 11 months)
As a Software Developer at Infogain, I designed and tested Java applications for clients in the telecom and logistics sectors, focusing on delivering high-quality software solutions.
Education
Degrees, certifications, and relevant coursework
Tata Institute of Social Sciences
Master of Public Health, Public Health
2013 - 2015
Completed a Master of Public Health with a focus on BioStatistics and Epidemiology, gaining expertise in statistical methods and their applications in public health.
University of Minnesota
Summer Exchange Program, Public Health
2014 - 2014
Participated as a Summer Exchange Student at the Public Health Institute, enhancing knowledge in global health issues and public health practices.
Uttar Pradesh Technical University
Bachelor of Technology, Computer Science
2007 - 2011
Earned a Bachelor of Technology in Computer Science and Engineering, focusing on software development, algorithms, and data structures.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Preyanshu?
You can contact Preyanshu and 90k+ other talented remote workers on Himalayas.
Message PreyanshuFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
