アクティブ音響センシングを用いたジェスチャ認識手法

本研究では，対象物に音響信号を流し，その伝播応答から対象物の状態を識別する，アクティブ音響センシングを人体に適用した手法を提案する．ユーザは身体にコンタクトスピーカとコンタクトマイクを装着する．スピーカから超音波を発信し，体を伝播した超音波をマイクで取得する．身体の姿勢や動作，力の入れ具合によって超音波の伝播特性が変化し，ユーザの姿勢，ジェスチャ，力の入れ具合等が単一のセンサで取得できる． ユーザは身体にコンタクトスピーカとコンタクトマイクを装着し，コンタクトスピーカから超音波周波数のスイープ信号を繰り返し発信する．コンタクトマイクでは，身体を伝播してきた超音波を取得し，高速フーリエ変換を計算する．スピーカからの音は超音波であるので，空中に伝播した音は人には聞こえない．

Gesture Recognition Method Utilizing Ultrasonic Active Acoustic Sensing

We propose a method for gesture recognition that utilizes active acoustic sensing, which transmits acoustic signals to a target, and recognizes the target’s state by analyzing the response. In this study, the user wore a contact speaker that transmitted ultrasonic sweep signals to the user’s body and a contact microphone that detected the ultra- sound propagated through the body. The propagation characteristics of the ultrasound changed depending on the user’s movements. We utilized these changes to recognize the user’s gestures. One of the important novelty features of our method is that the user’s gestures can be acquired not only from the physical movement but also from the user’s internal state, such as muscle activity, since ultrasound is transmitted via both the user’s internal body and body surface. More- over, our method is not adversely affected by audible-range sounds generated by the environment and body movements because we utilize ultrasound. We implemented a device that uses active acoustic sensing to effectively transmit/detect the ultrasound to/from the body and investigated the performance of the proposed method in 21 contexts with 10 sub- jects. The evaluation results confirmed that the precision and recall are 93.1 % and 91.6 %, respectively when we set 10 % of the data as training data and the rest as testing data in the same data set. When we used the data set for training and the other data set for testing in the same day, the precision and recall are 51.6 % and 51.3 %, respectively