Open to opportunities

Satish User

@satishuser2

Message

AWS-focused Big Data Engineer specializing in PySpark, Glue, EMR and data pipeline automation.

India

Message

What I'm looking for

I seek a hands-on data engineering role focused on AWS/Spark pipelines, scalable data lakes, MDM work, and opportunities to optimize performance and automate production workflows.

I am an AWS-focused Big Data Engineer with six years of experience designing and operating data pipelines using AWS services, Spark, Hive and traditional RDBMS sources.

I have built and optimized ETL/ELT workflows using AWS Glue, Lambda, Step Functions, EMR and Spark (RDD, DataFrame, Spark SQL) to move and transform data into Redshift and Snowflake for OLAP and analytics.

I led data migration strategies from heterogeneous sources (Oracle, Sybase, IBM DB2, MySQL) using Sqoop and custom ingestion methods, created Hive and external tables, and implemented partitioning, bucketing and other tuning approaches to improve performance.

I collaborate with stakeholders across upstream and downstream teams, create automation and runbooks, troubleshoot production failures with RCAs, and prioritize cost-effective, scalable solutions for data lakes and MDM pipelines.

Experience

Work history, roles, and key accomplishments

Current

AWS Data Engineer

Current

Boven Technologies

Jun 2023 - Present (2 years 4 months)

Built and maintained AWS-based ETL pipelines using Glue, Lambda and Spark to ingest, transform and load data into Redshift and Snowflake, and implemented Step Functions to orchestrate scheduled batch workflows for OLAP reporting.

AWS Glue AWS Lambda Spark Step Functions S3 Redshift)Snowflake Pyspark Redshift

Data Engineer

Collabera Technologies

Sep 2022 - May 2023 (8 months)

Developed PySpark and Hive-based ETL on EMR/S3 to process heterogeneous data sources and optimized Spark/Hive jobs to improve performance for batch data pipelines ingested via Sqoop.

Pyspark Hive EMR Sqoop Hadoop S3 Performance Tuning

Associate

Capgemini

Oct 2021 - Jul 2022 (9 months)

Supported MDM and AWS data pipelines by building Glue scripts, integrating Reltio and Snowflake, automating reports, and resolving production failures with RCA and runbooks.

AWS Glue Reltio Snowflake AWS S3 IAM Pyspark Automation Incident RCA

System Engineer

Delta Itech Solutions

Aug 2019 - Oct 2021 (2 years 2 months)

Implemented data ingestion and ETL processes using Sqoop, Hive and Spark on Hadoop/EMR to populate Hive/HBase tables and enable downstream analytics and reporting.