Brokentooth.io / 04 Models / Teaching a Device to Listen

Teaching a Device to Listen

Wake-word training, evaluation, and the inconvenient realities of real microphones.

Recognising a short phrase sounds like a small enough job. Then the microphone moves, somebody turns on a television, and the tidy evaluation result starts looking less authoritative.

The wake-word work associated with Soma explores training and evaluating those triggers. The repository holds scripts, configuration and supporting documentation; the heavier datasets and model assets are handled separately.

The microphone gets a vote

A synthetic validation set can tell me something about a model under those conditions. It cannot stand in for every room, speaker, distance or background noise the detector might encounter.

The questions that matter include missed triggers and false alarms, microphone placement and the threshold chosen for operation. Improving one result can come with a cost elsewhere. A detector that responds enthusiastically to everything is not especially good at listening.

Those are evaluation questions, not problems that disappear when a training run finishes. The useful evidence is a dated test with its conditions and limitations intact.

The experiments are ongoing. I am keeping numerical accuracy and latency claims out of this overview rather than presenting a clean-looking figure that quietly changes meaning between synthetic audio and a real microphone.