We Need Help with Precise Sample Tagging! Please Help!

We need a bit of help here. We are getting ready to release our first machine learning based wakeword tagger and the model for “Hey, Mycroft”, but we need some help to get the accuracy up.

We’ve got a backlog of samples that need to be verified so we can feed them to the algorithm. This takes zero expertise in software or machine learning. We simply need folks to listen to the audio and tag the samples as “Hey, Mycroft”, “Almost Hey, Mycroft or Duplicate”, and “Not Hey, Mycroft”

Community members can reach in to help here: https://training.mycroft.ai/precise/#/

300 queries takes about 15 minutes. Can you help? Please?


NOTE: This system is up and running again. All systems nominal. Please help! - Feb 21 2018 9:39 AM PST.

NOTE: Our appeal for help needs to be delayed 'cuz we found a bug ( database lockup ). Thanks to everyone who tried! We’ll let you know when it is ready to go again. - Feb 19 2018 5:42 AM PST.


Hi Joshua,

The tagger stops working after 56 tag for me…

I get the same straight off the bat before any are tagged…

Verifying I’m getting this too, will flag internally. Appreciate you guys flagging it, thx.

2 Likes

Hey guys, thanks for helping. This is very alpha stuff and the database appears to lock up after a few dozen items are tagged. We’ll look into it and come back here for help again when we’ve found the bug.

Thank you for trying though. I can’t highlight enough how much we appreciate it.

3 Likes

@DiscoPanda @DarkSide - This system is back up. Thank you so much for your help.

201 tags and no female voice :open_mouth:… Only man will trigger Mycroft :smile:

293rd tag, finally, a female voice :tada::sweat_smile::grin:

1 Like

@DarkSide - That is a hugely important point. We are going to launch a website for capturing wakewords independent of the stack and, when we do, we’d appreciate contributions from women and from children over 13 years of age.

Right now the data is heavily skewed toward adult men.

Looks like we’ve made some progress, but we still need help with this.

@J_Montgomery_Mycroft two questions.

  1. What does the level and coloured bar at the bottom of the screen represent?
  2. It says a valid trigger is “other words then Hey Mycroft”, but I have been marking it as valid if there is any type of background noise as long as I can recognise “hey Mycroft” amongst the noise. Should this be clarified in the instructions?

For some reason my browser seems to be making a request to https://training.mycroft.ai/precise/user/undefined/data, which results in a 500 from the server. I can’t tag any samples. For what it’s worth, I am logged in.

1 Like

Thanks @jrbauer97 - we currently have an outage on that server - the Incident Report is at:

This page doesn’t seem to work for me… I get a “loading circle” to the right of the yellow button, certain elements don’t load (e.g. the Mycroft logo at the top) and clicking the “play” button does nothing.

I have tried in different browsers (Mozilla FIrefox and Chromium), with/without my VPN and after a restart… Nothing.

Confirming I’m getting the same behavior. Last time this happened we bounced the server, let’s see if that does the trick.

goes off to have a robust conversation with the server

actually the server is 200 OKing on that page; I suspect we have a database deadlock again. Not sure how to resolve that one, pinging @Wolfgange who might know more.

Might want to look into this further if it keeps happening.

What did you guys say on Kickstarter? 100,000 words or something like that? That’s a lot of words to be verified by what is likely to be a pretty small number of dedicated users…

Fully agree @gregory.opera, we need to resolve the underlying problem.

1 Like

Hey all! I have browsed the forum and was not certain where to post this question.
Is it possible to train our own wake words with precise beyond changing the phenome in the web interface? If so is there a procedure for doing so? “Hey Mycroft, Train a new wake word”:wink:
I located the following https://github.com/MycroftAI/mycroft-precise-python-experiments and noticed that there is a “train_keyword.py” script. Does this create a model that we can just drop in somewhere. For reference I am using picroft.
Thanks

Great, thanks for the transparency, @KathyReid!

1 Like