Rajesh M
@rajeshm2
Data engineer specializing in cloud-native ETL, big data pipelines, and scalable analytics solutions.
What I'm looking for
I am a Data Engineer with four years of hands-on experience building scalable data pipelines and cloud-based data architectures using AWS and Azure. I design and implement ETL processes, orchestration, and data lakes to deliver reliable, high-performance analytics platforms.
I've implemented production solutions using AWS services (Glue, Lambda, EMR, Redshift, S3), Azure services (Data Factory, Databricks, Synapse), and orchestration tools like Airflow and Control-M. I develop Spark and PySpark jobs, automate deployments with CI/CD pipelines, and optimize performance and costs through right-sizing and data partitioning.
I combine strong programming skills in Scala, Python, SQL, and Java with experience in Snowflake, Hadoop ecosystems, NoSQL databases, and BI tools like Tableau and Power BI to translate complex data into actionable business insights.
Experience
Work history, roles, and key accomplishments
Designed and implemented AWS-based ETL and data lake architectures, migrating terabytes of data to Snowflake and Redshift while automating data quality checks and CI/CD pipelines to improve ingestion reliability and reduce manual deployment effort.
Data Engineer
HSBC
Jan 2021 - Jun 2023 (2 years 5 months)
Built end-to-end Azure data solutions using ADF, Databricks, and ADLS, optimized Spark jobs and SQL queries to reduce processing time by ~25%, and deployed automated workflows and containerized services to support scalable analytics.
Education
Degrees, certifications, and relevant coursework
Saint Peter's University
Master of Science, Data Science
Pursuing a Master of Science in Data Science with coursework and projects focused on data engineering, machine learning, and analytics.
Chaitanya Institute Of Technology And Science
Bachelor of Technology, Information Technology
Completed a Bachelor of Technology in Information Technology covering software engineering, databases, and computing fundamentals.
Tech stack
Software and tools used professionally
Apache Spark
AWS Glue
AWS Step Functions
GitHub
Kubernetes
Azure Kubernetes Service
AWS CodePipeline
Jenkins
NumPy
Pandas
PySpark
dat
Sqoop
MySQL
PostgreSQL
MongoDB
Cassandra
Hadoop
HBase
Gmail
Yarn
Databricks
AWS CloudFormation
Azure DevOps
Jira
Java
Kafka
AWS Lambda
Serverless
Azure Functions
Azure SQL Database
Airflow
Amazon EMR
SQL
Transform
Enhance
Unity Catalog
Task
Factory
Jan
Movement
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Rajesh?
You can contact Rajesh and 90k+ other talented remote workers on Himalayas.
Message RajeshFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
