Show HN: Earshot – old smartphone can listen to smoke alarm, doorbell or doghttps://tryearshot.net/index.html
TLDR: I’m building Earshot - the sound detection app that can detect (ideally) any sound described by text. The neural model under the hood is a CLAP-style model (CLIP for audio): basically during the training you force the model make inner text and audio representations to match. And then you can use such model as 0-shot audio classifier. For POC I used LAION’s clap-htsat model but it turned out to be quite "heavy" so I’ve trained a smaller one by myself. As for text encoder I used model from the EfficientAT family; for audio I used jhu-clsp/ettin-encoder-32m. The training was performe…
