Ultrasound-based Movement Sensing, Gesture-, and Context-recognition
Concept
Contexts(environmental sound, user motion, where the user is in, and who is near the user) are embedded in the recorded sound all together.
System
An activity and context recognition method where the user carries a neck-worn receiver comprising a microphone, and small speakers on his/her wrists that generates ultrasounds. The system recognize gestures on the basis of the volume of the received sound and the Doppler effect. We combine the gesture recognition by using ultrasound and conventional MFCC-based environmental-context recognition to recognize complex contexts from the recorded sound. Our system also recognizes the place where the user is in and the people who are near the user by ID signals generated from speakers placed in rooms and on people.