Rishabh Gupta
@rishabhgupta2
Lead Data Engineer with over 12 years of experience in data warehousing.
IndiaWhat I'm looking for
I am a Principal Data Engineer with more than 12 years of extensive experience in data warehousing and advanced ETL/ELT technologies, including Apache Airflow, Snowflake, and Apache Spark. My expertise spans various databases such as Redshift, Aurora, Oracle, PostgreSQL, and MySQL. I have successfully designed and developed data pipelines and built data warehouses in cloud environments like AWS and GCP. Currently, I am exploring a techno-managerial role where I can lead a team of enthusiastic individuals and drive projects to success.
Throughout my career, I have demonstrated a strong ability to manage complex data migration projects and lead teams effectively. My recent role involved designing and implementing ELT solutions using Apache Airflow and EMR in AWS, where I was responsible for all aspects of data migration from legacy systems to modern data warehouses. I take pride in my ability to write complex SQL queries and develop interactive dashboards, ensuring that data is not only stored efficiently but also presented in a user-friendly manner.
Experience
Work history, roles, and key accomplishments
Principal Data Engineer
United States (Remote, India)
Feb 2024 - Present (1 year 4 months)
Currently leading data engineering efforts by designing and developing data pipelines using AWS technologies. Responsible for building a data warehouse on Snowflake and creating interactive dashboards using Streamlit.
Principal Software Engineer
Bengaluru, India
Mar 2021 - Feb 2024 (2 years 11 months)
Designed and developed an ELT solution using Apache Airflow and EMR in AWS. Led a team of 4, focusing on data migration and transformation tasks.
Principal Engineer
Pramati Technologies
Nov 2017 - Mar 2021 (3 years 4 months)
Implemented distributed database solutions and data ingestion pipelines using Spring Cloud Data Flow. Developed automation scripts for database setup in GCP.
Senior Member of Technical Staff
Metricstream Infotech Pvt. Ltd.
Dec 2016 - Nov 2017 (11 months)
Performed data ingestion from Oracle to HDFS and designed Hive databases. Automated data processing tasks using Oozie and created complex queries for reporting.
Senior Systems Engineer
Infosys Technologies Pvt. Ltd.
Jun 2013 - Dec 2016 (3 years 6 months)
Responsible for ETL design and development, including stored procedures in PLSQL and UNIX script modifications for data processing.
Project Associate
Indian Institute of Technology Kanpur
Aug 2012 - Jun 2013 (10 months)
Responsible for software modifications and enhancements, including writing complex business logic in C++ and building executable software packages.
Education
Degrees, certifications, and relevant coursework
Gautam Buddha Technical University
Bachelor of Technology, Computer Science Engineering
2008 - 2012
Grade: 81.6%
Completed a Bachelor of Technology in Computer Science Engineering with a focus on various aspects of computer science and engineering principles.
Uttar Pradesh Board
Intermediate, Science
2006 - 2008
Grade: 82.3%
Completed intermediate education with a focus on science subjects, achieving a strong percentage.
Uttar Pradesh Board
High School, General Education
2004 - 2006
Grade: 88%
Completed high school education with a strong performance in various subjects.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Rishabh?
You can contact Rishabh and 90k+ other talented remote workers on Himalayas.
Message RishabhFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
