Kenny Lim
@kennylim
Principal Data Engineer building reliable, cloud-native ELT platforms with Snowflake, dbt, and strong data quality focus.
NetherlandsWhat I'm looking for
I’m a Principal Data Engineer with 10+ years building reliable data platforms and cloud-native ELT pipelines across FinTech and enterprise SaaS. I take end-to-end ownership—from ingestion through transformation to serving—with a consistent focus on data quality and platform stability.
In my current role, I lead technical engagements on Snowflake Data Cloud, designing and governing multi-layer pipelines (raw, curated, consumption) and integrating dbt transformation logic with automated testing and freshness checks. I’ve improved Snowflake SQL performance, established data contract standards with column-level security for regulatory compliance, and driven Snowflake Cortex and Dynamic Tables adoption for near-real-time availability.
Across prior Snowflake roles and earlier engineering work, I built streaming pipelines (e.g., Snowpipe) to reduce reporting lag, created reusable dbt packages and macros to standardize transformations, and automated deployment pipelines with Terraform and GitHub Actions. I also mentor engineers through reviews and workshops, act as the primary escalation point during critical production incidents, and bring a long track record of migrating and monitoring data systems to prevent downstream failures.
Experience
Work history, roles, and key accomplishments
Led technical engagements for FinTech clients on Snowflake Data Cloud, covering ingestion design, data modeling, and performance optimization for digital banking and payments workloads. Designed governed multi-layer pipelines with dbt testing/freshness checks, improved Snowflake SQL query performance to reduce compute costs, and drove Snowflake Cortex/Dynamic Tables adoption while mentoring engine
Unified disparate enterprise data sources into Snowflake Data Cloud for CRM, HR, and workflow automation teams using Snowpipe streaming and reusable dbt packages. Built Snowpipe pipelines to reduce reporting lag from multi-hour batch windows to under five minutes and automated Snowflake deployment pipelines with Terraform and GitHub Actions to improve release reliability.
Built end-to-end ELT solutions for Snowflake Data Cloud clients across e-commerce, retail, and government portals, including ingestion, inventory modeling, and automated freshness alerting for operational reporting. Integrated tools such as Fivetran, Airbyte, and Stitch, created audit-ready data lineage documentation, and diagnosed Snowflake task chains and dbt DAG failures in escalated support ca
Migrated Atlassian’s internal analytics ETL from on-prem to cloud-native pipelines using GCP Dataflow and BigQuery during the company’s active GCP migration. Implemented automated schema drift detection and data quality monitoring that prevented over 90% of downstream dashboard breakages and maintained pipeline documentation and governance-aligned data dictionaries.
Tech Support Team Lead
XebiaLabs
Mar 2018 - Aug 2019 (1 year 5 months)
Designed reporting data feeds and built SQL transformation pipelines for XebiaLabs XL Deploy and XL Release to support enterprise release automation and release cycle performance reporting. Led onboarding and tooling documentation for new data team hires and automated manual reporting workflows to reduce repetitive data extraction for operational staff.
Tech Support Engineer
XebiaLabs
Jan 2017 - Mar 2018 (1 year 2 months)
Wrote and maintained ETL scripts for XebiaLabs XL Deploy logistics and supply chain clients, resolving batch job failures to ensure consistent data availability for operational reporting. Diagnosed escalated data integration issues and communicated technical findings to non-technical stakeholders.
Docker Support Engineer
ServiceRocket
Jul 2015 - Jan 2017 (1 year 6 months)
Provided data and platform support for ServiceRocket’s Atlassian ecosystem services and Docker-based managed services, maintaining reliability and resolving connectivity issues across client environments. Produced troubleshooting documentation that became the primary reference for tier-1 data support cases.
Middleware Specialist
DiGi Telecommunications
May 2012 - Jun 2014 (2 years 1 month)
Managed the common service gateway and middleware integration layer for DiGi Telecommunications’ OSS/BSS systems, integrating billing, CRM, and network management while ensuring data consistency in the live production environment. Monitored integration health and resolved latency issues before they impacted end users.
Education
Degrees, certifications, and relevant coursework
Lancaster University
Bachelor's Degree, Information Technology
2010 - 2012
Earned a Bachelor's degree in Information Technology at Lancaster University from 2010 to 2012.
Tech stack
Software and tools used professionally
Availability
Location
NetherlandsAuthorized to work in
Job categories
Skills
Interested in hiring Kenny?
You can contact Kenny and 90k+ other talented remote workers on Himalayas.
Message KennyFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
