At Code Icons Technology, I designed and built a data lakehouse using Azure Data Factory, Azure Databricks, PySpark, Delta Lake, and ADLS Gen2. Its incremental loads and partitioning reduced execution time by 20%.
I developed automated ETL pipelines for structured and semi-structured data, reducing manual processing effort by approximately 30%. I also delivered curated datasets for Power BI dashboards with automated data quality checks.
On the AWS Redshift modernization work at Code Icons Technology, I modernized legacy ETL processes using Python, PySpark, AWS S3, AWS Glue, and Amazon Redshift. This reduced manual workflow effort by approximately 25%.
I built workflows for data ingestion, transformation, validation, and loading, and optimized SQL and transformation logic in Amazon Redshift. The work improved query performance and reduced average processing time by approximately 20%.
