Satya swarup satpathy

I am a dedicated Big Data Developer with a strong foundation in managing and optimizing data processing pipelines. Currently, I work as an Associate Engineer at IRIS Software, where I have successfully implemented PySpark to handle large data volumes and complex workloads. My efforts in migrating Hive-based systems to PySpark have resulted in a significant 40% reduction in processing time, showcasing my ability to enhance system performance and efficiency.

Prior to my current role, I served as a Programmer Analyst at Cognizant, where I developed and executed test cases for automation projects. My experience includes handling data cleaning and implementing protocols to ensure smooth task processing. I am passionate about continuous improvement and have actively participated in brainstorming sessions to expand automation scope. My technical skills, combined with my strong analytical abilities, enable me to troubleshoot issues effectively and optimize Spark jobs for better performance.