# Bezawit Abebaw Tekeba

Bezawit Abebaw Tekeba is a remote worker on Himalayas, Machine Learning Research Engineer | Technical Team Lead at SingularityNET, based in Australia.

Source: https://himalayas.app/@bezawitabebawtekeba

```text
Machine Learning Research Engineer at SingularityNET who developed a Predictive Coding Transformer and reduced test perplexity from 56.65 to 7.12.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | Australia |
| Authorized to work in | Australia |
| Salary expectations | 60k+ AUD |
| Job categories | Machine Learning Research Engineer, Machine Learning Research Engineer, Machine Learning Researcher, Technical Team Lead |
| Skills | Machine Learning, Predictive Coding, Neural Generative Coding, Transformer Models, Large Language Models, Recommendation Systems, Multi GPU Training, Distributed Training, Hyperparameter Optimization, Benchmarking, Experimental Research, Natural Language Processing, PyTorch, Jax, FLAX |

## About

```text
At SingularityNET, I researched biologically inspired learning approaches, including predictive coding and Neural Generative Coding, and developed a modular Predictive Coding Transformer with local inference and Hebbian weight updates. I reduced test perplexity from 56.65 to 7.12 on a character-level language model through architectural, initialization, inference, and hyperparameter improvements.

I also built benchmarking pipelines comparing predictive coding with backpropagation-based Transformers, and implemented multi-GPU training for predictive coding models. I contributed reusable PC-Transformer modules and language-model training pipelines to a JAX-based predictive coding library.

At iCog Labs, I developed a hybrid recommendation system and engineered a custom GPT architecture for Amharic NLP. I’m pursuing a Master of Artificial Intelligence and Machine Learning at Adelaide University.
```

## Experience

### Machine Learning Research Engineer | Technical Team Lead

SingularityNET. Jul 2024 - Jul 2026

```text
Researched biologically inspired learning approaches, including predictive coding and Neural Generative Coding, and developed a modular Predictive Coding Transformer. Built benchmarking pipelines and implemented multi-GPU training, reducing test perplexity from 56.65 to 7.12.
```

Skills: PyTorch, Jax, NGC-Learn, Predictive-Coding, Neural-Generative-Coding, Transformers, Multi-GPU-Training, Hyperparameter-Optimization, Bayesian-Optimization, Python

### Machine Learning Intern

iCog Labs. Apr 2024 - Jun 2024

```text
Developed a personalized hybrid recommendation system and researched generative AI models. Engineered and trained a custom GPT architecture for Amharic NLP.
```

Skills: Recommendation-Systems, Collaborative-Filtering, Content-Based-Filtering, Generative-AI, Stable-Diffusion, Pixart, GPT, African-Language-NLP, PyTorch

### Software Engineer Intern

Vintage Technologies. Aug 2022 - Oct 2022

```text
Developed a full-stack task management platform using Laravel and MVC, and implemented an admin dashboard with role-based access control and automated notifications.
```

Skills: Laravel, MVC, Bootstrap, HTML, CSS, JavaScript, PHP, SQL, Fullstack-Development

## Education

### Adelaide University

Master of Artificial Intelligence and Machine Learning, Artificial Intelligence and Machine Learning. 2026 - Present

```text
Currently pursuing a Master of Artificial Intelligence and Machine Learning at Adelaide University, expected to complete in the future.
```

### University of Amsterdam

European Summer School on Information Retrieval, Information Retrieval. 2024 - 2024

```text
Attended the European Summer School on Information Retrieval in 2024, covering deep learning, large language models, and generative information retrieval.
```

### Neuromatch Academy

Deep Learning Summer School, Deep Learning. 2024 - 2024

```text
Completed the Deep Learning Summer School in 2024, including a hands-on project implementing a Wav2Vec model for speech accent recognition.
```

### Oxford Machine Learning

Oxford Machine Learning, Machine Learning. 2024 - 2024

```text
Completed a specialization in representation learning and generative AI in 2024.
```

### University of Gondar

Bachelor of Science, Computer Science. 2019 - 2023

```text
Bachelor of Science in Computer Science from the University of Gondar, completed in 2023.
```

### Coursera

Deep Learning Specialization, Deep Learning

```text
Completed the Deep Learning Specialization, covering neural network optimization, CNNs, RNNs, sequence models, and hyperparameter tuning.
```

### Coursera

Machine Learning Specialization, Machine Learning

```text
Completed the Machine Learning Specialization, covering supervised and unsupervised learning, recommender systems, and reinforcement learning.
```

## Tech stack

- GitHub
- Jupyter
- NumPy
- Pandas
- Laravel
- Bootstrap
- JavaScript
- Python
- PHP
- PyTorch
- scikit-learn
- Transformers
- Linux
- Git
- Docker
- CUDA
- SQL
- Google Colab
- JAX
- Stable Diffusion
- Optuna

To contact Bezawit Abebaw, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Ahlem Ammar](https://himalayas.app/@ahlemammar): Data Scientist, VIVIAClinical Network
- [Ahlem Ammar](https://himalayas.app/@ahlemammar1): Data Scientist, VIVIAClinical Network
- [jack moes](https://himalayas.app/@jackmoes4): Machine Learning Engineer, TechnologyOne
- [Talib Hussain](https://himalayas.app/@talibhussain): Senior Machine Learning Engineer, Pegrecruiting
- [RIYA KEDIA](https://himalayas.app/@riyakedia): Research and Development Intern, C DOT, Ministry of Communications
- [Lucas Rui](https://himalayas.app/@lucasrui): Senior Machine Learning Engineer, Turnto
- [Reddi Manideep](https://himalayas.app/@reddimanideep): Data Science Intern, Edunet Foundation
- [Suleman Qamar](https://himalayas.app/@sulemanqamar): Research Assistant, University of Technology Sydney
- [omar mohamed ahmed](https://himalayas.app/@omarmohamedahmed): AI Engineer, Deakin University (A2I2)
- [Le Tri Luan](https://himalayas.app/@letriluan): Software Engineering Intern, Altera Digital Health
