Experienced 3yr Data Engineer |AWS(S3,lambda,athena,glue,redshift,IAM, etc), Azure & Terraform | ETL pipelines, SQL, Kafka and Python | Snowflake, SAP | PySpark, Hadoop | Tableau, Excel #immediate_Joiner.Serving Notice Period. LWD- 31ST JAN 2025
Project 1: Bayer Pharma Analytics
Key Responsibilities: Integrated SAP and Oracle datasets to achieve 99% data consistency.
Designed and managed ETL pipelines for high-throughput data processing, incorporating Kafka for messaging and Grafana for real-time visualization.
Automated cloud infrastructure provisioning and management using Terraform, resulting in significant cost reductions.
Developed comprehensive Kafka and Grafana dashboards to enhance monitoring and data quality assurance.
Collaborated closely with stakeholders to enable data-driven decision-making through actionable insights.
Project 2: Infineum Data Engineering
Key Responsibilities:
Built and maintained scalable data pipelines utilizing Azure Data Lake Storage (ADLS), Snowflake, and Power BI to streamline data processing and visualization.
Designed and implemented Data Vault 2.0 data models to improve data governance, quality, and scalability.
Managed Azure DevOps projects to ensure efficient delivery and seamless integration of data products.
Acted as a technical liaison, effectively bridging the gap between business and engineering teams to align technical solutions with business objectives.
Delivered real-time data insights by optimizing cloud automation solutions and orchestration workflows.
