Open to opportunities

joseph devadass

@josephdevadass

Message

Data engineering consultant specializing in large-scale Spark/Hadoop solutions and cloud-based ETL pipelines.

India

Message

What I'm looking for

I am seeking senior data engineering roles focused on scalable ETL and cloud-based big-data platforms, collaborative teams, technical leadership, and opportunities to optimize pipelines and drive measurable business impact.

I am a Technology Business Services Consultant and seasoned Data Engineer with nearly 15 years of experience designing, implementing, and managing large-scale data solutions. I have led ETL and big-data initiatives using Spark, Hadoop, Hive, Sqoop and AWS EMR, delivering measurable improvements such as 50% increased integration efficiency and 30% improved predictive accuracy through collaboration with data scientists.

My expertise spans Spark performance tuning, PySpark optimizations, Spark on Kubernetes, data profiling and quality, and automation with Python and Scala. I have experience administering Hadoop ecosystems, optimizing Hive and EMR clusters, implementing monitoring/alerting, and leading cross-functional teams and transitions to improve operational efficiency and uptime.

Experience

Work history, roles, and key accomplishments

Current

Technology Business Services Consultant

Current

Wells Fargo

May 2023 - Present (2 years 6 months)

Deploys and manages Hadoop and Spark clusters on cloud platforms (AWS EMR, Azure HDInsight, GCP Dataproc) and led ETL pipeline development that improved data integration efficiency by 50% while automating routines to boost team productivity.

Apache Spark Hadoop Pyspark ETL Data Pipelines Python

Sr. Data Engineer

SapphireIMS Solutions

Mar 2022 - May 2023 (1 year 2 months)

Integrated Spark with data lakes (AWS S3, HDFS) and designed ETL processes and optimized Spark clusters to improve query performance and resource utilization across big data workloads.

Pyspark AWS S3 HDFS Hive ETL Performance Tuning

Big Data Developer

IBM India Pvt Ltd

Nov 2019 - Feb 2022 (2 years 3 months)

Orchestrated end-to-end Spark workflows on AWS EMR, developed custom Spark aggregations and streaming solutions, and automated ingestion/transformation scripts to improve pipeline reliability and reduce data errors by 25%.

Apache Spark MLlib Python SQL Hive Data Modeling

System Engineer – Tech Infra

IBM

Aug 2016 - Nov 2019 (3 years 3 months)

Established automated server deployment routines, optimized system performance and availability (averaging 99.95% uptime), and implemented monitoring and backup improvements across Windows and Linux servers.

Windows Server Linux Ansible System Monitoring Virtualization AWS Automation

Service Lead

IBM

Jan 2014 - Jan 2016 (2 years)

Managed end-to-end incident/ticket volumes for a major client, produced daily SDO reports, identified defect trends, and led client review calls to improve service delivery and reduce aged incidents.

Incident Management ITIL Service Delivery Reporting Stakeholder Management Root Cause Analysis SLA Management

Tech Support Executive

247.ai

Dec 2009 - Mar 2011 (1 year 3 months)

Provided technical support and customer-facing incident resolution, working in an agile environment and coordinating with product teams to meet deliverables.

Technical Support Customer Service Agile Collaboration Ticketing Systems Client Communication

Education

Degrees, certifications, and relevant coursework

Sikkim Manipal University

Bachelor of Commerce, Commerce

Activities and societies: Involved in requirement gathering, documentation, and implementation of infrastructure solutions; participated in team activities and customer handling.

Bachelor of Commerce degree awarded by Sikkim Manipal University in 2015.