Looking for a job

Thalente Dlamini

@thalentedlamini

Senior Data Engineer at Derivco who cut nightly batch processing from 2h 35m to 42 minutes across ITSM, timesheet and telemetry data.

South Africa

Message

At Derivco, I designed medallion batch pipelines that bring uptime, ITSM, time-logging and project data from 11 source systems into OneLake and Snowflake. Fourteen Gold data products feed EXCO Power BI dashboards covering delivery, financials, uptime and ITSM.

I rebuilt incremental loads and partitioning, reducing the nightly ITSM, timesheet and telemetry batch from 2h 35m to 42 minutes. I also added CI/CD, data-quality tests and lineage, and held a 99.3% successful-refresh rate over 12 months.

Across insurance and retail, I built reporting-ready data models and Power BI semantic models for claims, premiums and e-commerce performance. Earlier, at the National Education Collaboration Trust, I established centralised data repositories and BI standards and delivered national-level management dashboards.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Derivco (Pty) Ltd

Oct 2022 - Present (4 years 1 month)

Designed medallion batch pipelines in Fabric, Azure Data Factory, and Spark, landing data from 11 source systems into OneLake and Snowflake. Rebuilt incremental loads and partition strategy, reducing nightly batch runtime from 2h 35m to 42 minutes.

Python PySpark Spark SQL T SQL Azure Data Factory Microsoft Fabric OneLake ADLS Snowflake Apache Spark Git Azure DevOps Power BI Data Quality CI CD

Data Engineer

Old Mutual Insure

Aug 2022 - Oct 2022 (2 months)

Built SQL extracts and T-SQL transforms to move short-term insurance claims and premium-collections data into reporting-ready warehouse tables. Delivered Power BI semantic models and data-quality checks for operations and collections.

SQL T SQL Data Warehouse Power BI Data Quality Insurance

Data Engineer

OneCart / SovTech (Woolworths Dash)

Jul 2021 - Jun 2022 (11 months)

Designed SQL and cloud batch ETL pipelines for high-volume e-commerce data into a reporting data warehouse. Optimized T-SQL and incremental loads, reducing a core commercial pipeline runtime from 85 to 22 minutes.

SQL ETL Data Warehouse T SQL Dimensional Modeling Power BI GA3

Lead Data Analyst

National Education Collaboration Trust (NECT)

Feb 2020 - Jul 2021 (1 year 5 months)

Established centralised data repositories and BI standards. Delivered national-level management dashboards and led process optimisation initiatives using LEAN and Design Thinking methodologies.

Data Analysis BIツール Dashboarding Lean Design Thinking

Process Engineer

Standard Bank Group

Apr 2019 - Feb 2020 (10 months)

Delivered analytics, process engineering, and automation solutions. Supported Agile transformation across banking operations and designed end-to-end processes and analytical reporting frameworks.

Analytics Process Engineering Automation Agile Reporting