Algorithms for the detection of chewing behavior in dietary monitoring applications

The detection of food consumption is key to the implementation of successful behavior modification in support of dietary monitoring and therapy, for example, during the course of controlling obesity, diabetes, or cardiovascular disease. Since the vast majority of humans consume food via mastication (chewing), we have designed an algorithm that automatically detects chewing behaviors in surveillance video of a person eating. Our algorithm first detects the mouth region, then computes the spatiotemporal frequency spectrum of a small perioral region (including the mouth). Spectral data are analyzed to determine the presence of periodic motion that characterizes chewing. A classifier is then applied to discriminate different types of chewing behaviors. Our algorithm was tested on seven volunteers, whose behaviors included chewing with mouth open, chewing with mouth closed, talking, static face presentation (control case), and moving face presentation. Early test results show that the chewing behaviors induce a temporal frequency peak at 0.5Hz to 2.5Hz, which is readily detected using a distance-based classifier. Computational cost is analyzed for implementation on embedded processing nodes, for example, in a healthcare sensor network. Complexity analysis emphasizes the relationship between the work and space estimates of the algorithm, and its estimated error. It is shown that chewing detection is possible within a computationally efficient, accurate, and subject-independent framework.

[1]  P. G. Dellow,et al.  Evidence for central timing of rhythmical mastication , 1971, The Journal of physiology.

[2]  Y. Kawamura,et al.  Properties of tongue and jaw movements elicited by stimulation of the orbital gyrus in the cat. , 1973, Archives of oral biology.

[3]  Guixin Zhang,et al.  Projections of two separate cortical areas for rhythmical jaw movements in the rat , 1990, Brain Research Bulletin.

[4]  S. Rossignol,et al.  Spinal pattern generation , 1994, Current Opinion in Neurobiology.

[5]  K. Hiiemae Mammalian mastication : a review of the activity of the jaw muscles and the movements they produce in chewing , 1978 .

[6]  S. W. Ranson,et al.  Corticifugal pathways for mastication, lapping and other motor functions in the cat , 1933 .

[7]  Y. Nakamura,et al.  Masticatory rhythm in intracellular potential of trigeminal motoneurons induced by stimulation of orbital cortex and amygdala in cats , 1978, Brain Research.

[8]  A. Iriki,et al.  Role of corticobulbar projection neurons in cortically induced rhythmical masticatory jaw-opening movement in the guinea pig. , 1986, Journal of neurophysiology.

[9]  K. Matsuo,et al.  The Relationship between Oral Status and the Progress of Dementia at Senile Hospital. , 1991 .

[10]  F. Bremer Physiologie nerveuse de la mastication chez le chat et le lapin. Reflexes de mastication. Reponses masticatrices corticales et centre cortical du gout , 1923 .

[11]  J. P. Lund,et al.  Mastication in the rabbit: a description of movement and muscle activity. , 1989, Journal of neurophysiology.

[12]  Y. Kawamura,et al.  Analysis of jaw movements from the cortical jaw motor area and amygdala. , 1960, The Japanese journal of physiology.

[13]  Thomas Berkefeld,et al.  Age-related changes in primary somatosensory cortex of rats: evidence for parallel degenerative and plastic-adaptive processes , 2002, Neuroscience & Biobehavioral Reviews.

[14]  L. J. Goldberg,et al.  Intracellular recording in trigeminal motoneurons of the anesthetized guinea pig during rhythmic jaw movements , 1978, Experimental Neurology.

[15]  K. Takada,et al.  Coordination of cortically induced rhythmic jaw and tongue movements in the rabbit. , 1993, Journal of neurophysiology.

[16]  K. Olsson,et al.  Modulation of transmission in rostral trigeminal sensory nuclei during chewing. , 1986, Journal of neurophysiology.

[17]  Abdelsalam Helal,et al.  Observing Walking Behavior of Humans Using Distributed Phenomenon Detection and Tracking Mechanisms , 2008, 2008 International Symposium on Applications and the Internet.

[18]  S. H. Chandler,et al.  Brain-stem perturbations during cortically evoked rhythmical jaw movements: effects of activation of brain-stem loci on jaw muscle cycle characteristics , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Yoshio Nakamura,et al.  Generation of masticatory rhythm in the brainstem , 1995, Neuroscience Research.

[20]  Y. Nakamura,et al.  Cortically induced masticatory rhythm and its modification by tonic peripheral inputs in immolbilized cats. , 1976, The Bulletin of Tokyo Medical and Dental University.

[21]  O. Pompeiano,et al.  Mechanisms of muscle spindle ex- citation. , 1967, Archives italiennes de biologie.

[22]  Paul Lukowicz,et al.  Analysis of Chewing Sounds for Dietary Monitoring , 2005, UbiComp.

[23]  S. H. Chandler,et al.  The effects of brain stem transections on the neuronal networks responsible for rhythmical jaw muscle activity in the guinea pig , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  S. H. Chandler,et al.  Relationship between jaw movements and trigeminal motoneuron membrane-potential fluctuations during cortically induced rhythmical jaw movements in the guinea pig. , 1982, Journal of neurophysiology.

[25]  J. Feldman,et al.  Generation of respiratory rhythm and pattern in mammals: insights from developmental studies , 1995, Current Opinion in Neurobiology.

[26]  O. Vogt,et al.  Die vergleichend-architektonische und die vergleichend-reizphysiologische Felderung der Großhirnrinde unter besonderer Berücksichtigung der menschlichen , 1926, Naturwissenschaften.

[27]  K. Olsson,et al.  The importance of reflexes and their control during jaw movement , 1983, Trends in Neurosciences.

[28]  Y Sasaki,et al.  Effect of mastication on regional cerebral blood flow in humans examined by positron-emission tomography with ¹⁵O-labelled water and magnetic resonance imaging. , 1997, Archives of oral biology.

[29]  D. Cook,et al.  Smart Home-Based Health Platform for Behavioral Monitoring and Alteration of Diabetes Patients , 2009, Journal of diabetes science and technology.

[30]  P. G. Dellow,et al.  The influence of interactive stimuli on rhythmical masticatory movements in rabbits. , 1971, Archives of oral biology.

[31]  S. H. Chandler,et al.  The effects of a glycine antagonist (strychnine) on cortically induced rhythmical jaw movements in the anesthetized guinea pig , 1985, Brain Research.

[32]  J. V. van Willigen,et al.  Phasic and rhythmic responses of the oral musculature to mechanical stimulation of the rat palate. , 1984, Archives of oral biology.

[33]  M. Onozuka,et al.  Mapping Brain Region Activity during Chewing: A Functional Magnetic Resonance Imaging Study , 2002, Journal of dental research.

[34]  K. Sasamoto,et al.  Two types of rhythmical jaw movements evoked by stimulation of the rat cortex. , 1990, Shika Kiso Igakkai zasshi = Japanese journal of oral biology.

[35]  A. Iriki,et al.  Localization of central rhythm generator involved in cortically induced rhythmical masticatory jaw-opening movement in the guinea pig. , 1986, Journal of neurophysiology.

[36]  J. V. van Willigen,et al.  Peripheral influences on the central pattern-rhythm generator for tongue movements in the rat. , 1985, Archives of oral biology.

[37]  N. Hashimoto,et al.  Induction of rhythmic jaw movements by stimulation of the mesencephalic reticular formation in the guinea pig , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  S. H. Chandler,et al.  The effects of orofacial sensory input on spontaneously occurring and apomorphine-induced rhythmical jaw movements in the anesthetized guinea pig , 1985, Neuroscience Letters.

[39]  K. Olsson,et al.  Analysis of rhythmical jaw movements produced by electrical stimulation of motor-sensory cortex of rabbits. , 1984, Journal of neurophysiology.

[40]  S. Rossignol,et al.  Interactions between the jaw-opening reflex and mastication. , 1981, Canadian journal of physiology and pharmacology.

[41]  T. Sumi Some properties of cortically-evoked swallowing and chewing in rabbits. , 1969, Brain research.

[42]  A. Thexton Oral reflexes elicited by mechanical stimulation of palatal mucosa in the cat. , 1973, Archives of oral biology.