Guy Uses Machine Learning To Help Him Count How Many Times Noku From Wadiwa Wepa Moyo Says “Hesi”

Farai Mudzingwa Avatar

Stumbling upon this pointless but intriguing video made my day yesterday. Usually when we talk about machine learning and programming – it’s rarely this light-hearted.

A student from HIT – Tatenda Mushaya made use of Machine Learning techniques to attempt to figure out how many times Noku from Wadiwa Wepa Moyo says “Hesi”.

If you’ve watched the show, you’ll know why the “Hesi” has become equally iconic and infamous resulting in some of funniest social media reactions;

Social media reactions aside, Tatenda followed the steps below;

  1. Collect images from the internet which can be done using code.
  2. Resize the images
  3. Detect faces use script
  4. Crop the detected face
  5. Pick only Noku’s face
  6. Make Noku encodings
  7. Detect Noku’s face.
  8. find the `Hie` subtitle

You can see the script he created to do this on Github

In the video above, Tatenda explained that the process was complicated because the script was trying to read text on varying backgrounds and as a result he could only pick up 4 Hesi’s.

Fellow programmers, comment below on how Tatenda can make his script better at identifying Noku’s “Hesi’s”.

, ,

9 comments

What’s your take?

Your email address will not be published. Required fields are marked *

  1. Leslie

    Thanks for open sourcing your code bro, by the way this isn’t a “stupid mission”

  2. Imi Vanhu Musadaro

    I would frame this as an audio extraction and detection problem. “Hesi” could possibly be said whilst the subject isn’t within frame or not facing the camera. I’ve only watched one episode, so I can’t speak to the distribution of such events.

    Audio can be trickier to work with though, as most AI tutorials, examples e.t.c focus on computer vision. One option would be to use text recognition to identify locations of the subtitle “Hie” (regardless of the speaker), then extract the audio within the neighbouring areas and process that accordingly, to identify the speaker.

  3. Sam Manokore

    Dude, this is impressive. This is not stupid at all!
    I can see something like this taking off and being useful some day. I home I will remember to hit you up when I find an alternative and more effective way of doing it.

  4. Togara

    He should just use audio to use the algorithm to pick ‘hesi’ from audo.

    1. Nyahwa

      Audio algorithm is a very complex but achievable

  5. DC

    Even if it’s “stupid”, it’s stupidly funny. I quite enjoyed. Things line these lead to interesting use cases. Remember mould gave us penicillin. It was a botched experiment. Kinda stupid I’d say 😁

    1. Farai Mudzingwa

      Very true

  6. evermoreg

    im inspired by this young man. Great work ineed

  7. Maps

    Dude you are a genious🔥