Internet of multimedia things: Vision and challenges

Internet of Things (IoT) systems cannot successfully realize the notion of ubiquitous connectivity of everything if they are not capable to truly include 'multimedia things'. However, the current research and development activities in the field do not mandate the features of multimedia objects, thus leaving a gap to benefit from multimedia content based services and applications. In this paper, we analyze this issue by contemplating the concept of IoT and drawing an inspiration towards the perspective vision of 'Internet of Multimedia Things' (IoMT). Therein, we introduce IoMT as a novel paradigm in which smart heterogeneous multimedia things can interact and cooperate with one another and with other things connected to the Internet to facilitate multimedia based services and applications that are globally available to the users. Some applications and use-cases for IoMT are presented to reflect the possibilities enabled by this new paradigm. An IoMT architecture is then presented which is segregated into four distinct stages; (i) multimedia sensing, (ii) reporting and addressability, (iii) multimedia-aware cloud, and (iv) multi-agent systems. Instead of proposing specific technical solutions for each individual stage of the presented architecture, we survey the already existing technologies, providing a synthesis for the realization of the vision of IoMT. Subsequently, various requirements and challenges as well as the feasibility of existing solutions for each stage of proposed IoMT architecture are comprehensively discussed.

[1]  Gabriel Montenegro,et al.  IPv6 over Low-Power Wireless Personal Area Networks (6LoWPANs): Overview, Assumptions, Problem Statement, and Goals , 2007, RFC.

[2]  Roy Friedman,et al.  On Power and Throughput Tradeoffs of WiFi and Bluetooth in Smartphones , 2011, IEEE Transactions on Mobile Computing.

[3]  Ted Morris,et al.  Advanced Portable Wireless Measurement and Observation Station , 2005 .

[4]  Agostino Poggi,et al.  Multiagent Systems , 2006, Intelligenza Artificiale.

[5]  George Pallis,et al.  Insight and perspectives for content delivery networks , 2006, CACM.

[6]  Bhaskar Krishnamachari,et al.  Performance evaluation of the IEEE 802.15.4 MAC for low-rate low-power wireless networks , 2004, IEEE International Conference on Performance, Computing, and Communications, 2004.

[7]  Rita Cucchiara,et al.  Intelligent Video Surveillance as a Service , 2013, Intelligent Multimedia Surveillance.

[8]  Christos Bouras,et al.  Performance evaluation of routing protocols for multimedia transmission over mobile ad hoc networks , 2011, 2011 4th Joint IFIP Wireless and Mobile Networking Conference (WMNC 2011).

[9]  Kannan Ramchandran,et al.  PRISM: A Video Coding Paradigm With Motion Estimation at the Decoder , 2007, IEEE Transactions on Image Processing.

[10]  Antonio F. Gómez-Skarmeta,et al.  Glowbal IP: An adaptive and transparent IPv6 integration in the Internet of Things , 2012, Mob. Inf. Syst..

[11]  Thomas Magedanz,et al.  A self-adaptive service provisioning framework for 3G+/4G mobile applications , 2004, IEEE Wireless Communications.

[12]  Gary J. Sullivan,et al.  High efficiency video coding: the next frontier in video compression [Standards in a Nutshell] , 2013, IEEE Signal Processing Magazine.

[13]  Olivier Hersent,et al.  The Internet of Things: Key Applications and Protocols , 2011 .

[14]  Julie A. Adams,et al.  Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence , 2001, AI Mag..

[15]  Dimitris A. Pados,et al.  Decoding of framewise compressed-sensed video via interframe total variation minimization , 2013, J. Electronic Imaging.

[16]  Arkady B. Zaslavsky,et al.  Sensing as a Service and Big Data , 2013, ArXiv.

[17]  Antonio Puliafito,et al.  Cloud4sens: a cloud-based architecture for sensor controlling and monitoring , 2015, IEEE Communications Magazine.

[18]  Bo Yan,et al.  Design and implementation of a sensor-based wireless camera system for continuous monitoring in assistive environments , 2010, Personal and Ubiquitous Computing.

[19]  Pascal Thubert,et al.  Compression Format for IPv6 Datagrams over IEEE 802.15.4-Based Networks , 2011, RFC.

[20]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[21]  Jean-Philippe Vasseur,et al.  Interconnecting Smart Objects with IP: The Next Internet , 2010 .

[22]  Antonio Puliafito,et al.  A utility paradigm for IoT: The sensing Cloud , 2015, Pervasive Mob. Comput..

[23]  Jamal N. Al-Karaki,et al.  Wireless Multimedia Sensor Networks: Current Trends and Future Directions , 2010, Sensors.

[24]  Godred Fairhurst,et al.  The Lightweight User Datagram Protocol (UDP-Lite) , 2004, RFC.

[25]  Christian Timmerer,et al.  Digital item adaptation: overview of standardization and research activities , 2005, IEEE Transactions on Multimedia.

[26]  Neil M. White,et al.  Energy-Aware Simulation for Wireless Sensor Networks , 2009, 2009 6th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[27]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[28]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[29]  Richard P. Martin,et al.  Enabling Internet-of-Things services in the MobilityFirst Future Internet Architecture , 2012, 2012 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[30]  Shunsuke Kamijo,et al.  Smart camera network system for use in railway stations , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[31]  Nicola Bui,et al.  Internet of Things Architecture - IoT-A , 2013 .

[32]  Ajaykumar T. Shah.  MEDIA CLOUD : WHEN MEDIA REVOLUTION MEETS RISE OF CLOUD COMPUTING , 2014 .

[33]  Sheldon Leader.  TELECOMMUNICATIONS HANDBOOK FOR TRANSPORTATION PROFESSIONALS: THE BASICS OF TELECOMMUNICATIONS , 2004 .

[34]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[35]  马华东.  Internet of Things： Objectives and Scientific Challenges , 2011 .

[36]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[37]  Deanna Needell,et al.  Near-Optimal Compressed Sensing Guarantees for Total Variation Minimization , 2012, IEEE Transactions on Image Processing.

[38]  Mihaela van der Schaar,et al.  Multimedia Over IP and Wireless Networks: Compression, Networking, and Systems , 2012 .

[39]  Gail-Joon Ahn,et al.  Security and Privacy Challenges in Cloud Computing Environments , 2010, IEEE Security & Privacy.

[40]  Marko Hölbl,et al.  A novel user authentication and key agreement scheme for heterogeneous ad hoc wireless sensor networks, based on the Internet of Things notion , 2014, Ad Hoc Networks.

[41]  Philip Levis,et al.  RPL: IPv6 Routing Protocol for Low-Power and Lossy Networks , 2012, RFC.

[42]  Luming Tan,et al.  Future internet: The Internet of Things , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[43]  Zhongfei Zhang,et al.  Multimedia Data Mining , 2010, Data Mining and Knowledge Discovery Handbook.

[44]  Samuel Cheng,et al.  Compressive image sampling with side information , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[45]  Detlev Marpe,et al.  Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders , 2013, 2013 Picture Coding Symposium (PCS).

[46]  Zhigeng Pan.  Technologies for E-Learning and Digital Entertainment, First International Conference, Edutainment 2006, Hangzhou, China, April 16-19, 2006, Proceedings , 2006, Edutainment.

[47]  Trac D. Tran,et al.  Distributed Compressed Video Sensing , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[48]  Naixue Xiong,et al.  Context-Aware Middleware for Multimedia Services in Heterogeneous Networks , 2010, IEEE Intelligent Systems.

[49]  Chong Luo,et al.  Multimedia Cloud Computing , 2011, IEEE Signal Processing Magazine.

[50]  Ming-Ting Sun,et al.  Digital Video Transcoding , 2005 .

[51]  E.J. Candes.  Compressive Sampling , 2022 .

[52]  Sabrina Sicari,et al.  SeDAP: Secure Data Aggregation Protocol in Privacy Aware Wireless Sensor Networks , 2010, S-CUBE.

[53]  Srinivasan Seshan,et al.  Flexible multimedia content retrieval using InfoNames , 2010, SIGCOMM '10.

[54]  Ian F. Akyildiz,et al.  Wireless sensor and actor networks: research challenges , 2004, Ad Hoc Networks.

[55]  Alessandro Bassi,et al.  From today's INTRAnet of things to a future INTERnet of things: a wireless- and mobility-related view , 2010, IEEE Wireless Communications.

[56]  Antonio Puliafito,et al.  Device-Centric Sensing: An Alternative to Data-Centric Approaches , 2017, IEEE Systems Journal.

[57]  Dario Pompili,et al.  Communication and Coordination in Wireless Sensor and Actor Networks , 2007, IEEE Transactions on Mobile Computing.

[58]  Serbulent Tozlu.  Feasibility of Wi-Fi enabled sensors for Internet of Things , 2011, 2011 7th International Wireless Communications and Mobile Computing Conference.

[59]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[60]  Claudio Soriente,et al.  Collaborative authentication in unattended WSNs , 2009, WiSec '09.

[61]  Kristofer S. J. Pister,et al.  TSMP: TIME SYNCHRONIZED MESH PROTOCOL , 2008 .

[62]  Konstantinos N. Plataniotis,et al.  High-Accuracy Total Variation for Compressed Video Sensing , 2013, ArXiv.

[63]  Kalevi Kilkki,et al.  Quality of Experience in Communications Ecosystem , 2008, J. Univers. Comput. Sci..

[64]  Aura Ganz,et al.  Multimedia Wireless Networks: Technologies, Standards and QoS , 2003 .

[65]  Dominique Barthel,et al.  Routing Metrics Used for Path Calculation in Low-Power and Lossy Networks , 2012, RFC.

[66]  Kwang Mong Sim,et al.  Agent-Based Service Composition in Cloud Computing , 2010, FGIT-GDC/CA.

[67]  Imrich Chlamtac,et al.  BIONETS: Bio-Inspired Networking for Pervasive Communication Environments , 2007, IEEE Transactions on Vehicular Technology.

[68]  Maxim P. Sharabayko,et al.  Intra compression efficiency in VP9 and HEVC , 2013 .

[69]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[70]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[71]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[72]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[73]  Ming Li,et al.  Motion-Aware Decoding of Compressed-Sensed Video , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[74]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[75]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[76]  Yonggang Wen,et al.  Toward Optimal Deployment of Cloud-Assisted Video Distribution Services , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[77]  B. B. P. Rao,et al.  Cloud computing for Internet of Things & sensing based applications , 2012, 2012 Sixth International Conference on Sensing Technology (ICST).

[78]  Tommaso Melodia,et al.  Compressed-Sensing-Enabled Video Streaming for Wireless Multimedia Sensor Networks , 2012, IEEE Transactions on Mobile Computing.

[79]  Kwang Mong Sim,et al.  Agent-Based Cloud Computing , 2012, IEEE Transactions on Services Computing.

[80]  Fabrice Theoleyre,et al.  Efficient topology construction for RPL over IEEE 802.15.4 in wireless sensor networks , 2014, Ad Hoc Networks.

[81]  Tsung-Han Lee,et al.  RSSI-based IPv6 routing metrics for RPL in low-power and lossy networks , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[82]  Charu C. Aggarwal,et al.  The Internet of Things: A Survey from the Data-Centric Perspective , 2013, Managing and Mining Sensor Data.

[83]  Carsten Bormann,et al.  The Constrained Application Protocol (CoAP) , 2014, RFC.

[84]  Rui Zhang,et al.  Wyner-Ziv coding of motion video , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[85]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[86]  Ning Luo.  A Wireless Traffic Surveillance System Using Video Analytics , 2011 .

[87]  Javier de Diego,et al.  Proceedings oh the International Congress of Mathematicians: Madrid, August 22-30,2006 : invited lectures , 2006 .

[88]  Stefano Tubaro,et al.  Distributed Video Coding: Trends and Perspectives , 2009, EURASIP J. Image Video Process..