An Asymmetrical Acoustic Field Detection System for Daily Tooth Brushing Monitoring

In this paper, we propose a tooth brushing monitoring system based on acoustic inputs through an asymmetrical sound-field detector. This detector consists of a throat microphone and a Bluetooth earphone equipped on the user's neck and ear, respectively. This system can capture unique acoustic signals generated by the movement of the toothbrush on the surfaces of teeth via the detector. The throat microphone captures the brushing sound travelling through gums, bones, and muscles, which forms unique patterns with less attenuation than the sound travelling through the air. The Bluetooth earphone captures the brushing sound through the air. The tooth surface is divided into 16 parts for detection. By adopting machine learning models with the input of acoustic features from both time and frequency domains, we build a high accuracy detector to distinguish the brushing events happened at each of the 16 parts of the tooth surface. We employ Support Vector Machine (SVM), Hidden Markov Model (HMM), K-Means, C4.5 and Random Forest (RF) to evaluate the performance of our detection system. Experiments show that the RF model performs the best and achieves an average accuracy of 85.69\%. Based on the pre- trained model, we develop an Android-based APP to monitor the user's daily tooth brushing time and help the user form a good habit of tooth brushing.

[1]  Engin Erzin,et al.  Source and Filter Estimation for Throat-Microphone Speech Enhancement , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[2]  E. Inada,et al.  Quantitative evaluation of toothbrush and arm-joint motion during tooth brushing , 2014, Clinical Oral Investigations.

[3]  Keesam Jeong,et al.  Tooth brushing Pattern Classification using Three-Axis Accelerometer and Magnetic Sensor for Smart Toothbrush , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Wang Yi,et al.  AutoDietary: A Wearable Acoustic Sensor System for Food Intake Recognition in Daily Life , 2016, IEEE Sensors Journal.

[5]  Siriwan Suebnukarn,et al.  Use of Haptic Feedback to Train Correct Application of Force in Endodontic Surgery , 2017, IUI.

[6]  Yeji Kim,et al.  DenTeach: A Device for Fostering Children's Good Tooth-brushing Habits , 2016, IDC.

[7]  Takuya Maekawa,et al.  Evaluating tooth brushing performance with smartphone sound data , 2015, UbiComp.

[8]  Rosalind W. Picard,et al.  Motion-tolerant magnetic earring sensor and wireless earpiece for wearable photoplethysmography , 2010, IEEE Transactions on Information Technology in Biomedicine.

[9]  Kyeong-Seop Kim,et al.  Quantitative assessment of toothbrushing education efficacy using smart toothbrush , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[10]  Kyeong-Seop Kim,et al.  Toothbrushing Region Detection Using Three-Axis Accelerometer and Magnetic Sensor , 2012, IEEE Transactions on Biomedical Engineering.

[11]  Carlos Tejada,et al.  Bitey: an exploration of tooth click gestures for hands-free user interface control , 2016, MobileHCI.

[12]  Runze Li,et al.  DAYA: a system for monitoring and enhancing children's oral hygiene , 2014, CHI Extended Abstracts.

[13]  Ohtsuki Tomoaki,et al.  User Identification Based on Toothbrushing Information Using Three-Axis Accelerometer , 2015 .

[14]  Wang Yi,et al.  Pervasive eating habits monitoring and recognition through a wearable acoustic sensor , 2014, PervasiveHealth.

[15]  Lei Yang,et al.  AudioGest: enabling fine-grained hand gesture detection by decoding echo signal , 2016, UbiComp.

[16]  Kentaro Takemura,et al.  Haptic-enabled Active Bone-Conducted Sound Sensing , 2015, UIST.

[17]  Miguel Bruns Alonso,et al.  Brush and learn: transforming tooth brushing behavior through interactive materiality, a design exploration , 2014, TEI '14.

[18]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[19]  Stefan Schneegaß,et al.  SkullConduct: Biometric User Identification on Eyewear Computers Using Bone Conduction Through the Skull , 2016, CHI.

[20]  Pei-Yu Chi,et al.  Playful toothbrush: ubicomp technology for teaching tooth brushing to kindergarten children , 2008, CHI.

[21]  Shan Lin,et al.  Toothbrushing Monitoring using Wrist Watch , 2016, SenSys.