A project by Ghana NLP to test the machine translation performance of Large Language Models (LLMs) on Ghanaian languages.
Nsanku is an initiative that evaluates how well various open-source language models perform when working with Ghanaian languages. We have evaluated the performance of over 14 open-source and closed models across 43 languages, using at least 300 sentences per language. Paper publication coming soon.
As AI engineers work to bring Ghanaian languages into large language models, it’s essential to have reliable evidence on how existing models perform. Nsanku provides insights that help developers identify which LLMs are most suitable for use in translating content in Ghanaian languages, and which languages currently have stronger or weaker support.
Detailed performance breakdown for each of the 43 evaluated languages.
Click to expand language-specific charts
We welcome contributions from the community! To contribute:
- Run the evaluation using our Google Colab notebook
- Share your results with us
- We'll include your findings in our collective results
Get started with the evaluation notebook:
We are running evaluations of these models:
gpt-4.1claude-sonnet-4-5gemini-2.5-flashdeepseek-v3.1gemma-2-9b-itgemma-2-27b-itgpt-oss-120bkimi-k2-instruct-0905llama-3.1-405b-instructllama-3.3-70b-instructllama-4-maverick-17b-128e-instructmistral-medium-3-instructqwen3-235b-a22bqwq-32bseed-oss-36b-instruct
The project evaluated 43 Ghanaian languages:
| Language | Language | Language | Language |
|---|---|---|---|
| Abron | Gikyode | Dangme | Siwu |
| Anyin | Avatime | Bisa | Bimoba |
| Southern Birifor | Tuwuli | Ntcham | Buli |
| Anufo | Dagbani | Southern Dagaare | Ewe |
| Fante | Ga | Gonja | Farefare |
| Hanga | Konni | Kusaal | Lelemi |
| Sekpele | Mampruli | Deg | Nawuri |
| Chumburung | Nkonya | Delo | Nyagbo |
| Nzema | Esahie | Paasaal | Tumulung Sisaala |
| Selee | Tafi | Tampulma | Twi |
| Vagla | Konkomba | Kasem |
Thanks to our awesome contributors who made it possible:
- Onesimus Addo Appiah
- Mich-Seth Owusu
- Jonathan Asiamah
- Elias Dzobo
- Kelvin Newman
- Edmund O. Benefo
- Gerhardt Datsomor
- John Ayernor
For questions or comments, please email natural.language.processing.gh@gmail.com.
To submit your contributions, send them to michsethowusu@gmail.com.
This is an open community project. We welcome researchers, developers, and language enthusiasts to participate and help advance NLP for Ghanaian languages.