Low-Cost Four-Dimensional Experience Theater Using Home Appliances

Multi-sensorial effect or four-dimensional (4-D) effect is considered in the niche arena of film playing but has become a growing business quickly. Installation of 4-D effects are typically expensive, and 4-D films are most often presented in custom-built theaters at special venues. This paper proposes a novel integration of existing video service platform and commercial smart home solution to generate 4-D effects for any non-4-D film (i.e., a 3-D or a 2-D film). Specifically, we describe how the designer can use home appliances to create the effects for a 4-D experience theater at home. Instead of using an expensive and special 4-D movie effect system, we use a low-cost off-the-shelf IoT platform for a smart home to create the 4-D movie effects for any non-4-D film. Therefore, the viewer can enjoy 4-D movies at home without special equipment other than home appliances. In our solution, an IoT device-management system called IoTtalk is utilized to integrate the video service system and the smart home system. Since these systems may be located in distant places, the delays for video streaming and triggering of 4-D effects must be synchronized. We have conducted measurements to indicate that in our design, the synchronization issue can be ignored without affecting the user experience.

[1]  Yi-Bing Lin,et al.  IoTtalk-RC: Sensors As Universal Remote Control for Aftermarket Home Appliances , 2017, IEEE Internet of Things Journal.

[2]  Gabriel-Miro Muntean,et al.  Perceived Synchronization of Mulsemedia Services , 2015, IEEE Transactions on Multimedia.

[3]  Yi-Bing Lin,et al.  CampusTalk: IoT Devices and Their Interesting Features on Campus Applications , 2018, IEEE Access.

[4]  Yevgeniya Sulema,et al.  Mulsemedia vs. Multimedia: State of the art and future trends , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[5]  Yang-Sheng Chen,et al.  AoEs: enhancing teleportation experience in immersive environment with mid-air haptics , 2017, SIGGRAPH Emerging Technologies.

[6]  Gabriel-Miro Muntean,et al.  Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media Delivery , 2015, IEEE Transactions on Multimedia.

[7]  Yi-Bing Lin,et al.  EasyConnect: A Management System for IoT Devices and Its Applications for Interactive Design and Art , 2015, IEEE Internet of Things Journal.

[8]  Phone Lin,et al.  IoTtalk: A Management Platform for Reconfigurable Sensor Devices , 2017, IEEE Internet of Things Journal.

[9]  Yi-Bing Lin,et al.  ArduTalk: An Arduino Network Application Development Platform Based on IoTtalk , 2019, IEEE Systems Journal.

[10]  Bohyung Han,et al.  Motion Effects Synthesis for 4D Films , 2016, IEEE Transactions on Visualization and Computer Graphics.

[11]  George Ghinea,et al.  Perceived Synchronization of Olfactory Multimedia , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.