# shivakrishna budda

shivakrishna budda is a remote worker on Himalayas, Senior Data Engineer at Capitec Bank, based in South Africa.

Source: https://himalayas.app/@shivakrishnabudda

```text
Senior Data Engineer at Capitec Bank building Azure lakehouse pipelines for enterprise banking data.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | South Africa |
| Authorized to work in | South Africa |
| Salary expectations | 3168k+ INR |
| Job categories | Data Engineer |
| Skills | Data Engineering, ETL ELT, Data Pipeline Development, Cloud Data Engineering, Data Lakehouse Architecture, Data Warehouse, Data Lake, Batch Processing, Real time Data Processing, Data Streaming, Data Modeling, Dimensional Modeling, Star Schemas, Dimensional Modeling (Star And Snowflake Schemas), Change Data Capture |

## About

```text
At Capitec Bank, I design end-to-end ETL/ELT pipelines that bring enterprise banking data into ADLS Gen2 and Azure Synapse Analytics. I also implement Bronze/Silver/Gold lakehouse architecture with Delta Lake for batch and near-real-time workloads.

Across banking, healthcare, telecom and financial data projects, I’ve designed cloud data lakes, warehouses and streaming workflows on Azure, AWS and GCP. At Gravity Cybertech, I led the migration of legacy healthcare data systems to Azure, using Azure Databricks, Azure SQL and Blob Storage.
```

## Experience

### Senior Data Engineer (current)

[Capitec Bank](https://himalayas.app/companies/capitec-bank). Feb 2025 - Present

```text
Design and develop end-to-end ETL/ELT pipelines using Azure Data Factory, ingesting enterprise banking data into ADLS Gen2 and Azure Synapse Analytics. Implement Azure Databricks and PySpark transformations for cleansing, enrichment, validation and large-scale data processing.
```

Skills: Azure-Data-Factory, Azure-Databricks, ADLS-Gen2, Delta-Lake, Azure-Synapse, Azure-SQL, Event-Hub, Stream-Analytics, azure-monitor, Log-Analytics, Key-Vaults, Azure-DevOps, Power-BI, PySpark, ETL, ELT, CDC

### Senior Data Engineer

[Publicis Sapient](https://himalayas.app/companies/publicis-sapient). Feb 2024 - Jan 2025

```text
Developed end-to-end data pipelines using Apache Spark, Azure Data Factory and Apache Airflow across databases, APIs, files and Teradata. Implemented batch and streaming integration using Azure Data Factory, Event Hubs, Kafka and Apache NiFi.
```

Skills: Azure-Databricks, Azure-Data-Factory, Azure-Synapse, ADLS, AKS, Snowflake, SQL-Server, Oracle, Python, Scala, PySpark, Kafka, Apache-Flink, Airflow, Power-BI, Git, Jenkins, Apache-Spark, Event-Hub, Apache-NiFi

### Senior Data Engineer

Gravity Cybertech. Sep 2018 - Jan 2024

```text
Led migration of legacy healthcare data systems to Azure using Azure SQL, Blob Storage and Azure Databricks. Designed cloud data lake and warehouse architectures using ADLS Gen2, Delta Lake and Databricks for EHR, claims and longitudinal data.
```

Skills: Azure-Databricks, ADLS-Gen2, Delta-Lake, Azure-Data-Factory, Azure-SQL, Azure-Event-Hubs, Kafka, Service-Bus, Azure-Purview, Azure-DevOps, Jenkins, Airflow, Python, PySpark, ETL, ELT, Streaming, Data-Governance

### Senior Data Engineer

Megasoft. Jan 2017 - Jul 2018

```text
Designed end-to-end data pipelines using AWS Glue, Lambda, EMR and DMS for financial transaction and market data. Built scalable data lakes on Amazon S3 and data warehouse solutions on Amazon Redshift.
```

Skills: AWS-Glue, Lambda, EMR, DMS, S3, Redshift, Kinesis, Athena, QuickSight, IAM, PySpark, Spark, Kafka, Python

### Data Engineer

Anvi Soft Solutions. May 2015 - Dec 2016

```text
Designed and developed scalable telecom data pipelines using Google Cloud Storage (GCS), Google BigQuery, Apache Spark, PySpark, and Hadoop to process Call Detail Records (CDRs), subscriber information, and network usage datasets. Developed batch ETL pipelines using Google Cloud Dataproc, Apache Spark, and PySpark.
```

Skills: Google-Cloud-Platform, BigQuery, Google-Cloud-Storage, Google-Cloud-Dataproc, Google-Cloud-Dataflow, Google-Cloud-Pub-Sub, Apache-Spark, PySpark, Python, Scala, SQL, Hadoop, HDFS, Hive, Kafka, Spark-Streaming, Tableau, GitHub

### Data Engineer

Fourth Technologies. Dec 2012 - Mar 2015

```text
Designed and deployed enterprise data warehouse solutions using SQL Server and Microsoft Visual Studio. Developed ETL and SSIS solutions integrating data from core banking and enterprise systems.
```

Skills: SQL-Server, SSIS, SSAS-Tabular, Power-BI, Visual-Studio, Oracle, Teradata

## Education

### Osmania University

Bachelor of Science, Computer Applications

```text
Pursued a Bachelor of Science in Computer Applications, gaining foundational knowledge in computing and software development.
```

### Databricks

Databricks Certified Data Engineer – Associate, Data Engineering

```text
Earned the Databricks Certified Data Engineer – Associate certification, validating expertise in data engineering with Databricks.
```

### Amazon Web Services

AWS Certified Solutions Architect – Associate, Cloud Architecture

```text
Earned the AWS Certified Solutions Architect – Associate certification, demonstrating proficiency in designing distributed systems on AWS.
```

## Tech stack

- Amazon Redshift
- Snowflake
- Apache Spark
- AWS Glue
- Apache Flink
- Tableau
- Amazon Quicksight
- Azure RBAC
- Microsoft Azure
- Google Cloud Platform
- Amazon S3
- Google Cloud Storage
- GitHub
- Jenkins
- PySpark
- PostgreSQL
- MongoDB
- Cassandra
- Oracle
- Hadoop
- Azure DevOps
- Python
- Java
- Scala
- Azure Service Bus
- Apache NiFi
- Azure Monitor
- Google Cloud Dataflow
- Amazon Kinesis
- Google Cloud Pub/Sub
- AWS Lambda
- Git
- Google BigQuery
- Amazon EMR
- Amazon Athena
- SQL
- Google Cloud Dataproc
- Delta Lake
- Microsoft Fabric
- Power BI
- Apache Kafka

To contact shivakrishna, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Sanele Ndlela](https://himalayas.app/@sanelendlela): Senior Data Platform Engineer, BMW IT Hub South Africa
- [Fortune Mogoeng](https://himalayas.app/@fortunemogoeng): Senior Data Architect, Embelo
- [Benair Dzinosara](https://himalayas.app/@benairdzinosara): Data Engineer, ITMAX Global
- [Thusani Khwanda](https://himalayas.app/@thusanikhwanda): AWS Data Engineer, Standard Bank (CIB)
- [Dunga Promise](https://himalayas.app/@promzadunga): Cloud Data Engineer, CloudSmiths
- [Kuda Mhlanga](https://himalayas.app/@kcmhlanga): Senior Data Engineer & Architect, Heineken Beverages
- [Ruan Burger](https://himalayas.app/@ruanburger): Data Engineer II, Capitec
- [Misheck Moyo](https://himalayas.app/@misheckmoyo): Data Engineer, DataDive Consulting
- [Claudius Moyo](https://himalayas.app/@claudiusmoyo): Senior AWS Data Engineer / Technical Lead, Unknown
- [Thalente Dlamini](https://himalayas.app/@thalentedlamini): Data Engineer, Derivco (Pty) Ltd
