Abhishek M
@abhishekm
Data Engineer with expertise in big data solutions and analytics.
What I'm looking for
I am a dedicated Data Engineer with over 3.10 years of experience specializing in building big data solutions and managing efficient data pipelines. My expertise lies in utilizing frameworks such as Hadoop, Hive, and PySpark, along with cloud platforms like AWS and Snowflake, to create scalable and reliable data infrastructures. I have a proven track record of automating data workflows and enhancing data quality, which has significantly improved operational efficiency in my previous roles.
At Cognizant Technology Solutions, I successfully built a robust framework for data ingestion, loading over 2 TB of incremental data daily from SAP HANA into S3 Data Lake. My efforts in optimizing SQL queries and implementing data quality checks have led to substantial improvements in data accuracy and processing speed. I am passionate about mentoring junior engineers and fostering a collaborative team environment to drive project success and innovation.
Experience
Work history, roles, and key accomplishments
Associate Data Engineer
Cognizant Technology Solutions Pvt. Ltd.
May 2021 - Present (4 years 1 month)
As an Associate Data Engineer, I built a robust framework for data ingestion, loading over 2 TB of data daily into S3 Data Lake using AWS Glue and PySpark. I optimized workflows, mentored junior engineers, and improved data processing speed and accuracy significantly.
Data Engineer
Cognizant Technology Solutions Pvt. Ltd.
May 2021 - Apr 2022 (11 months)
In my role as a Data Engineer, I streamlined data pipeline workflows, implemented data quality checks, and collaborated with peers to resolve complex challenges, enhancing project delivery timelines and data accuracy.
Trainee Data Engineer
Cognizant Technology Solutions Pvt. Ltd.
May 2021 - Apr 2022 (11 months)
As a Trainee Data Engineer, I migrated legacy systems to a cloud-based platform, developed de-duplication logic in PySpark, and automated metadata extraction, significantly improving efficiency and reducing manual efforts.
Education
Degrees, certifications, and relevant coursework
Chandigarh University
Bachelor of Engineering, Computer Science
2017 - 2021
Pursued a Bachelor of Engineering in Computer Science, focusing on software development, data structures, algorithms, and system design. Engaged in various projects that enhanced practical knowledge and skills in computer science principles.
Availability
Location
Authorized to work in
Job categories
Interested in hiring Abhishek?
You can contact Abhishek and 90k+ other talented remote workers on Himalayas.
Message AbhishekFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
