At ALGORIMS, I researched cloud technologies for data engineering and strengthened my foundation in cloud-based distributed systems, data security, automation, and cost optimization.
I designed an ETL pipeline using AWS S3, Glue Studio, and Athena, automating data cataloging and transformation with Glue Crawlers and ETL jobs.
In a separate data-ingestion use case, I developed an AWS Glue pipeline for incremental loading from Amazon S3 to Amazon Redshift. I used Apache Parquet and Glue Job Bookmarks to improve query performance and prevent duplicate processing.
I also developed AWS projects for marketing campaign analytics, data quality monitoring, and IoT data processing. My certifications include AWS Certified Data Engineer ASSOCIATE (DEA-C01), Programming, Data Structures and Algorithms using Python (NPTEL), and Cloud Foundations (AWS Academy).
