Seeking a Data Engineer opportunity focused on developing and optimizing scalable data pipelines and data processing solutions. Skilled in SQL, Python, PySpark, Databricks, Azure, ETL/ELT, data transformation, and performance optimization. Looking to contribute to end-to-end data engineering projects while continuing to grow in cloud data technologies and modern data platforms.
SS
Looking for a job
Soumojit Sahoo
@soumojitsahoo1
Data Engineer at Infosys who optimized retail data processing with Spark, Python, SQL, and Delta Lake.
IndiaWhat I'm looking for
At Infosys, I led a retail data engineering project using Apache Spark, Python, SQL, and Delta Lake to optimize data processing. I applied caching and broadcast joins to improve processing speed and efficiency.
Previously at Infosys, I designed ETL pipelines and integrated data from relational databases, flat files, and APIs into on-premises data lakes and warehouses. I also worked as a QA Engineer, executing functional and regression testing for networking applications and reporting defects.
Experience
Work history, roles, and key accomplishments
IN
Current
Led a data engineering project in a retail environment using Apache Spark, Python, SQL, and Delta Lake to optimize data processing. Employed Spark optimization techniques like caching and broadcast joins to improve data processing speed and efficiency.
IN
Designed and optimized ETL pipelines using SQL, Python, and Spark to extract, transform, and load data from multiple teams into an on-premises data warehouse. Integrated diverse data sources into on-premises data lakes and warehouses, ensuring seamless availability for reporting and dashboarding.
IN
Executed end-to-end functional and regression testing for networking applications, ensuring seamless integration of network protocols, firewalls, and security policies. Identified and reported critical defects in network infrastructure components, improving system reliability and reducing production issues by 30%.
UC
Data Engineer
Unknown Company
Developed and optimized ETL/ELT data pipelines, worked with SQL, Python, PySpark, and Databricks, and implemented data quality checks.
Education
Degrees, certifications, and relevant coursework
Haldia Institute of Technology
Bachelor of Technology, Mechanical Engineering
2018 - 2021
Pursued a Bachelor of Technology in Mechanical Engineering from July 2018 to June 2021.
Tech stack
Software and tools used professionally
Availability
Looking for a job
Location
IndiaAuthorized to work in
Salary expectations
1000k+ INR
Social media
Job categories
Interested in hiring Soumojit?
You can contact Soumojit and 90k+ other talented remote workers on Himalayas.
Message SoumojitGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
