Toward Flexible and Efficient Home Context Sensing: Capability Evaluation and Verification of Image-Based Cognitive APIs †

Cognitive Application Program Interface (API) is an API of emerging artificial intelligence (AI)-based cloud services, which extracts various contextual information from non-numerical multimedia data including image and audio. Our interest is to apply image-based cognitive APIs to implement flexible and efficient context sensing services in a smart home. In the existing approach with machine learning by us, with the complexity of recognition object and the number of the defined contexts increases by users, it still requires directly manually labeling a moderate scale of data for training and continually try to calling multiple cognitive APIs for feature extraction. In this paper, we propose a novel method that uses a small scale of labeled data to evaluate the capability of cognitive APIs in advance, before training features of the APIs with machine learning, for the flexible and efficient home context sensing. In the proposed method, we exploit document similarity measures and the concepts (i.e., internal cohesion and external isolation) integrate into clustering results, to see how the capability of different cognitive APIs for recognizing each context. By selecting the cognitive APIs that relatively adapt to the defined contexts and data based on the evaluation results, we have achieved the flexible integration and efficient process of cognitive APIs for home context sensing.

[1]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[2]  Ke Xu,et al.  Toward software defined smart home , 2016, IEEE Communications Magazine.

[3]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[4]  Masahide Nakamura,et al.  Evaluating Feasibility of Image-Based Cognitive APIs for Home Context Sensing , 2018, 2018 International Conference on Signal Processing and Information Security (ICSPIS).

[5]  G. W. Milligan,et al.  An algorithm for generating artificial test clusters , 1985 .

[6]  Yaowadee Temtanapat,et al.  Sound Tooth: Mobile Oral Health Exam Recording Using Individual Voice Recognition , 2019, 2019 4th International Conference on Information Technology (InCIT).

[7]  Feng Liu,et al.  A distributed and efficient system architecture for smart home , 2016, Int. J. Sens. Networks.

[8]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[9]  Anna-Lan Huang,et al.  Similarity Measures for Text Document Clustering , 2008 .

[10]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[11]  Kire Trivodaliev,et al.  Enabling internet of things for smart homes through fog computing , 2017, 2017 25th Telecommunication Forum (TELFOR).

[12]  安本 慶一,et al.  A Monitoring Support System for Elderly Person Living Alone through Activity Sensing in Living Space , 2013 .

[13]  Masahide Nakamura,et al.  Integrating Multiple Models Using Image-as-Documents Approach for Recognizing Fine-Grained Home Contexts † , 2020, Sensors.

[14]  L. Muflikhah,et al.  Document Clustering Using Concept Space and Cosine Similarity Measurement , 2009, 2009 International Conference on Computer Technology and Development.

[15]  G. W. Milligan,et al.  A monte carlo study of thirty internal criterion measures for cluster analysis , 1981 .

[16]  William Stafford Noble,et al.  Support vector machine , 2013 .

[17]  G. W. Milligan,et al.  An examination of the effect of six types of error perturbation on fifteen clustering algorithms , 1980 .

[18]  Thomas Roelleke,et al.  TF-IDF uncovered: a study of theories and probabilities , 2008, SIGIR '08.

[19]  Aidong Zhang,et al.  WaveCluster: A Multi-Resolution Clustering Approach for Very Large Spatial Databases , 1998, VLDB.

[20]  Kristen Grauman,et al.  Image Recognition , 2009, Encyclopedia of Biometrics.

[21]  Leila Etaati,et al.  Azure Machine Learning Studio , 2019, Machine Learning with Microsoft Technologies.

[22]  Dino Isa,et al.  An enhanced Support Vector Machine classification framework by using Euclidean distance function for text document categorization , 2011, Applied Intelligence.

[23]  M. J. van der Laan,et al.  A new partitioning around medoids algorithm , 2003 .

[24]  Kostas Vassilakis,et al.  Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture , 2019, Designs.

[25]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[26]  Kuwahara Daiki,et al.  Facial Fattening Simulation Based on Skull Bone , 2014 .

[27]  Karl N. Levitt,et al.  Is Anybody Home? Inferring Activity From Smart Home Network Traffic , 2016, 2016 IEEE Security and Privacy Workshops (SPW).

[28]  Iván Pau,et al.  The Elderly’s Independent Living in Smart Homes: A Characterization of Activities and Sensing Infrastructure Survey to Facilitate Services Development , 2015, Sensors.

[29]  Masahide Nakamura,et al.  Toward Affordable and Practical Home Context Recognition: -Framework and Implementation with Image-based Cognitive API- , 2019, Int. J. Networked Distributed Comput..

[30]  Rung-Ching Chen,et al.  Combining Voice and Image Recognition for Smart Home Security System , 2018 .

[31]  Eric B. Baum,et al.  Supervised Learning of Probability Distributions by Neural Networks , 1987, NIPS.

[32]  Anupam Singh,et al.  Network-Based Applications of Multimedia Big Data Computing in IoT Environment , 2020 .

[33]  Dhananjay Kumar,et al.  Introduction to Multimedia Big Data Computing for IoT , 2019, Intelligent Systems Reference Library.

[34]  Wil M. P. van der Aalst,et al.  Mining Local Process Models with Constraints Efficiently: Applications to the Analysis of Smart Home Data , 2018, 2018 14th International Conference on Intelligent Environments (IE).

[35]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Jun Ye,et al.  Cosine similarity measures for intuitionistic fuzzy sets and their applications , 2011, Math. Comput. Model..

[37]  Tan-Hsu Tan,et al.  Unobtrusive Activity Recognition of Elderly People Living Alone Using Anonymous Binary Sensors and DCNN , 2019, IEEE Journal of Biomedical and Health Informatics.

[38]  Kiyoshi Yasuda,et al.  Capturing Activities of Daily Living for Elderly at Home Based on Environment Change and Speech Dialog , 2017, HCI.

[39]  Mohammad Arif Ul Alam Context-aware multi-inhabitant functional and physiological health assessment in smart home environment , 2017, PerCom Workshops.

[40]  R. M. Cormack,et al.  A Review of Classification , 1971 .

[41]  Pierre Geurts,et al.  Supervised learning with decision tree-based methods in computational and systems biology. , 2009, Molecular bioSystems.

[42]  B. B. Zaidan,et al.  Smart Home-based IoT for Real-time and Secure Remote Health Monitoring of Triage and Priority System using Body Sensors: Multi-driven Systematic Review , 2019, Journal of Medical Systems.