Skip to main content
Bezawit Abebaw TekebaBT
Looking for a job

Bezawit Abebaw Tekeba

@bezawitabebawtekeba

Machine Learning Research Engineer at SingularityNET who developed a Predictive Coding Transformer and reduced test perplexity from 56.65 to 7.12.

Australia
Message

At SingularityNET, I researched biologically inspired learning approaches, including predictive coding and Neural Generative Coding, and developed a modular Predictive Coding Transformer with local inference and Hebbian weight updates. I reduced test perplexity from 56.65 to 7.12 on a character-level language model through architectural, initialization, inference, and hyperparameter improvements.

I also built benchmarking pipelines comparing predictive coding with backpropagation-based Transformers, and implemented multi-GPU training for predictive coding models. I contributed reusable PC-Transformer modules and language-model training pipelines to a JAX-based predictive coding library.

At iCog Labs, I developed a hybrid recommendation system and engineered a custom GPT architecture for Amharic NLP. I’m pursuing a Master of Artificial Intelligence and Machine Learning at Adelaide University.

Experience

Work history, roles, and key accomplishments

SingularityNET logoSI

Machine Learning Research Engineer | Technical Team Lead

SingularityNET

Jul 2024 - Jul 2026 (2 years)

Researched biologically inspired learning approaches, including predictive coding and Neural Generative Coding, and developed a modular Predictive Coding Transformer. Built benchmarking pipelines and implemented multi-GPU training, reducing test perplexity from 56.65 to 7.12.

PyTorchJax
NGC Learn
Predictive Coding
Neural Generative Coding
Transformers
Multi GPU Training
Hyperparameter Optimization
Bayesian OptimizationPython

Education

Degrees, certifications, and relevant coursework

Adelaide University logoAU

Adelaide University

Master of Artificial Intelligence and Machine Learning, Artificial Intelligence and Machine Learning

2026 -

Currently pursuing a Master of Artificial Intelligence and Machine Learning at Adelaide University, expected to complete in the future.

University of Amsterdam logoUA

University of Amsterdam

European Summer School on Information Retrieval, Information Retrieval

2024 - 2024

Attended the European Summer School on Information Retrieval in 2024, covering deep learning, large language models, and generative information retrieval.

Neuromatch Academy logoNA

Neuromatch Academy

Deep Learning Summer School, Deep Learning

2024 - 2024

Completed the Deep Learning Summer School in 2024, including a hands-on project implementing a Wav2Vec model for speech accent recognition.

OL

Oxford Machine Learning

Oxford Machine Learning, Machine Learning

2024 - 2024

Completed a specialization in representation learning and generative AI in 2024.

University of Gondar logoUG

University of Gondar

Bachelor of Science, Computer Science

2019 - 2023

Bachelor of Science in Computer Science from the University of Gondar, completed in 2023.

Coursera logoCO

Coursera

Deep Learning Specialization, Deep Learning

Completed the Deep Learning Specialization, covering neural network optimization, CNNs, RNNs, sequence models, and hyperparameter tuning.

Coursera logoCO

Coursera

Machine Learning Specialization, Machine Learning

Completed the Machine Learning Specialization, covering supervised and unsupervised learning, recommender systems, and reinforcement learning.

Availability

Looking for a job

Location

Australia

Authorized to work in

Salary expectations

60k+ AUD

Job categories

Machine Learning Research Engineer
Machine Learning Research Engineer
Machine Learning ResearcherTechnical Team Lead

Skills

Machine Learning
Predictive Coding
Neural Generative Coding
Transformer ModelsLarge Language ModelsRecommendation Systems
Multi GPU Training
Distributed Training
Hyperparameter Optimization
Benchmarking
Experimental Research
Natural Language ProcessingPyTorchJax
FLAX

Interested in hiring Bezawit Abebaw?

You can contact Bezawit Abebaw and 600K+ other talented remote workers on Himalayas.

Message Bezawit Abebaw

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan