Open to opportunities

Farooq Gill

@farooqgill

I build cloud data platforms, real-time pipelines, and automated analytics systems across Snowflake, Azure, and AWS.

I've built cloud data platforms and automation systems for Niagara Bottling, JazzCash, S&P Global, and JAZZ. My work spans Snowflake modernization, real-time fraud detection, enterprise data warehousing, and analytics delivery.

At Niagara Bottling, I migrated legacy SQL and monolithic ETL into modular dbt models, shortening deployment cycles by 60%, and built Azure Function-based IIoT ingestion and device-health reporting across 50+ manufacturing plants. For JazzCash, I designed a Kafka streaming pipeline handling millions of financial transactions per hour to support real-time fraud detection.

I've also led a 1.5 TB SQL Server-to-PostgreSQL migration on AWS RDS, improving performance and scalability by over 40%. I use Python, SQL, Snowflake, Azure, AWS, Kafka, dbt, Airflow, and data modeling to deliver reliable, governed data for BI, analytics, and AI/ML workflows.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Niagara Bottling

Nov 2023 - Present (2 years 9 months)

Architected Snowflake data platform assessments and future-state designs, defining ELT standards and migrating legacy ETL to dbt models. Deployed Azure Function Apps for IIoT data ingestion and automated monitoring, reducing manual diagnostics by 85%.

Snowflake Azure Python DBT Docker Power BI GitHub CI CD Data Governance Data Modeling ETL ELT Azure Functions REST APIs GraphQL Pandas HTML CSS SMTP

Independent Data Engineering Consultant

JazzCash

Jun 2023 - Jan 2024 (7 months)

Designed and deployed a Kafka-based streaming pipeline for real-time fraud detection, processing millions of transactions per hour. Developed Python producers/consumers and integrated with Apache Hudi and Snowflake for historical query support.

Kafka Minio Python Pandas Snowflake Docker Apache Hudi Streaming Data Pipelines

Senior Database & BI Consultant

S&P Global

Nov 2016 - Nov 2023 (7 years)

Led migration of a 1.5 TB SQL Server data warehouse to PostgreSQL on AWS RDS, improving performance by over 40%. Developed dbt workflows with CI/CD and orchestrated pipelines in Apache Airflow.

SQL Server PostgreSQL AWS DBT Airflow Power BI Cognos Data Modeling CI CD ETL

Database & BI Developer/ Consultant

JAZZ

Aug 2008 - Nov 2016 (8 years 3 months)

Designed and developed ETL workflows using SSIS to integrate telecom and fintech data into a centralized warehouse. Created Power BI and Cognos dashboards for KPI monitoring and optimized SQL Server performance.

SSIS SQL Server Power BI Cognos ETL Data Modeling Stored Procedures Indexing