Open to opportunities

Darryn McBain

@darrynmcbain

Message

Senior Data Engineer modernizing mission-critical data systems through Apache NiFi and fault-tolerant architectures.

South Africa

Message

What I'm looking for

I’m looking for Lead and Principal opportunities where I can drive architectural excellence—building distributed, fault-tolerant data orchestration and high-availability platforms using Apache NiFi, modern migrations, and robust integration patterns.

I’m a Strategic Senior Data Engineer with 15+ years of experience modernizing mission-critical data systems, with a strong focus on Apache NiFi and high-availability architecture. I’ve built and migrated complex legacy infrastructure into scalable, real-time data orchestration ecosystems.

In my current role, I’m leading the 2026 High-Availability roadmap at Tilte, spearheading the migration of legacy data processing to a distributed Apache NiFi 2.0+ cluster. I decommission legacy loaders and architect the internal data platform’s transition to a fault-tolerant, high-availability environment.

My work is hands-on and integration-driven: I use the NiFi 2.x Python API, JOLT transforms, and REST integrations to deliver resilient pipelines. Previously at Kurtosys Systems, I migrated existing data loaders to Apache NiFi, replacing legacy tech including SSIS and JavaScript, and delivered JSON/JOLT-based orchestration with CRON scheduling, Python, and REST APIs.

Earlier, at Confluence Technologies (previously Infovest (Pty) Ltd), I implemented data warehousing and portfolio compliance solutions for the investment management industry. I’ve also delivered loyalty/rewards program data operations and supported subscription and reporting systems—bringing a practical, end-to-end mindset to every architecture and migration I lead.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Tilte Solutions SA

Mar 2024 - Present (2 years 3 months)

Serving as the Data Lead for the 2026 High-Availability roadmap, I am responsible for the architectural transition of our data infrastructure. My focus is on decommissioning rigid legacy systems and replacing them with a distributed, fault-tolerant Apache NiFi Cluster slated for completion in early 2026.

Apache NiFi Apache Calcite Python Groovy API Integration JOLT Orchestration Clustering

Data Engineer

Kurtosys Systems

Jun 2021 - Feb 2024 (2 years 8 months)

Acted as the primary technical driver for modernizing the investment data ecosystem. I specialized in decommissioning legacy technical stacks (SSIS, JavaScript) and architecting their replacement within the Apache NiFi platform.

JSON Apache NiFi Apache Calcite Python Groovy API Integration JOLT Orchestration

Technical Implementation Consultant

Confluence

Apr 2017 - May 2021 (4 years 1 month)

Directed the technical deployment of proprietary data warehousing and portfolio compliance solutions for the global Investment Management industry. I focused on bridging the gap between rigid legacy financial infrastructure and modern SaaS-based analytics platforms.

Microsoft SQL Server Data Pipelines Data Visualization Reports And Dashboards Data Warehousing

Education

Degrees, certifications, and relevant coursework

CTI (Claremont Campus)

BTEC Higher National Diploma in Information Systems (Software Development), Information Systems (Software Development)

2008 - 2012

Earned a Level 5 BTEC Higher National Diploma in Information Systems (Software Development) at CTI (Claremont Campus), studying part-time from 2008 to 2012.