Interdomain I/O Optimization in Virtualized Sensor Networks

In virtualized sensor networks, virtual machines (VMs) share the same hardware for sensing service consolidation and saving power. For those VMs that reside in the same hardware, frequent interdomain data transfers are invoked for data analytics, and sensor collaboration and actuation. Traditional ways of interdomain communications are based on virtual network interfaces of bilateral VMs for data sending and receiving. Since these network communications use TCP/IP (Transmission Control Protocol/Internet Protocol) stacks, they result in lengthy communication paths and frequent kernel interactions, which deteriorate the I/O (Input/Output) performance of involved VMs. In this paper, we propose an optimized interdomain communication approach based on shared memory to improve the interdomain communication performance of multiple VMs residing in the same sensor hardware. In our approach, the sending data are shared in memory pages maintained by the hypervisor, and the data are not transferred through the virtual network interface via a TCP/IP stack. To avoid security trapping, the shared data are mapped in the user space of each VM involved in the communication, therefore reducing tedious system calls and frequent kernel context switches. In implementation, the shared memory is created by a customized shared-device kernel module that has bidirectional event channels between both communicating VMs. For performance optimization, we use state flags in a circular buffer to reduce wait-and-notify operations and system calls during communications. Experimental results show that our proposed approach can provide five times higher throughput and 2.5 times less latency than traditional TCP/IP communication via a virtual network interface.

[1]  Jin-Soo Kim,et al.  Inter-domain socket communications supporting high performance and full binary compatibility on Xen , 2008, VEE '08.

[2]  Denis V. Silakov The use of hardware virtualization in the context of information security , 2012, Programming and Computer Software.

[3]  Jose Renato Santos,et al.  Redesigning xen's memory sharing mechanism for safe and efficient I/O virtualization , 2010 .

[4]  Mongkol Ekpanyapong,et al.  On-Chip Message Passing Sub-System for Embedded Inter-Domain Communication , 2016, IEEE Computer Architecture Letters.

[5]  José Martins,et al.  TZ- VirtIO: Enabling Standardized Inter-Partition Communication in a Trustzone-Assisted Hypervisor , 2018, 2018 IEEE 27th International Symposium on Industrial Electronics (ISIE).

[6]  Ryan Shea,et al.  MemNet: Enhancing Throughput and Energy Efficiency for Hybrid Workloads via Para-virtualized Memory Sharing , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[7]  Qi Zhang,et al.  Shared-Memory Optimizations for Inter-Virtual-Machine Communication , 2016, ACM Comput. Surv..

[8]  Qi Zhang,et al.  Shared Memory Optimization in Virtualized Cloud , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[9]  Guangjie Han,et al.  An Efficient Virtual Machine Consolidation Scheme for Multimedia Cloud Computing , 2016, Sensors.

[10]  Óscar Oballe-Peinado,et al.  Smart Capture Modules for Direct Sensor-to-FPGA Interfaces , 2015, Sensors.

[11]  Ruhui Ma,et al.  When I/O Interrupt Becomes System Bottleneck: Efficiency and Scalability Enhancement for SR-IOV Network Virtualization , 2019, IEEE Transactions on Cloud Computing.

[12]  Daniel Raho,et al.  Lightweight and Generic RDMA Engine Para-Virtualization for the KVM Hypervisor , 2017, 2017 International Conference on High Performance Computing & Simulation (HPCS).

[13]  Li Zhou,et al.  VRAA: virtualized resource auction and allocation based on incentive and penalty , 2012, Cluster Computing.

[14]  Matteo Cesana,et al.  Joint Application Admission Control and Network Slicing in Virtual Sensor Networks , 2018, IEEE Internet of Things Journal.

[15]  Qi Zhang,et al.  Workload Adaptive Shared Memory Management for High Performance Network I/O in Virtualized Cloud , 2016, IEEE Transactions on Computers.

[16]  Peter E. Strazdins,et al.  An Energy-Efficient Asymmetric Multi-Processor for HPC Virtualization , 2018, 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

[17]  Yuan Luo,et al.  Virtualization I/O optimization based on shared memory , 2013, 2013 IEEE International Conference on Big Data.

[18]  Yong Tang,et al.  A novel disk I/O scheduling framework of virtualized storage system , 2018, Cluster Computing.

[19]  Feng Wang,et al.  On Multiple Virtual NICs in Cloud Computing: Performance Bottleneck and Enhancement , 2018, IEEE Systems Journal.

[20]  Nectarios Koziris,et al.  Xen2MX: High-performance communication in virtualized environments , 2014, J. Syst. Softw..

[21]  Thomas R. Gross,et al.  A Hybrid I/O Virtualization Framework for RDMA-capable Network Interfaces , 2015, VEE.

[22]  Vlado Stankovski,et al.  Monitoring self-adaptive applications within edge computing frameworks: A state-of-the-art review , 2018, J. Syst. Softw..

[23]  Hai Jin,et al.  Poris: A Scheduler for Parallel Soft Real-Time Applications in Virtualized Environments , 2016, IEEE Transactions on Parallel and Distributed Systems.

[24]  Hai Jin,et al.  Improving disk I/O performance in a virtualized system , 2013, J. Comput. Syst. Sci..

[25]  Yang Wang,et al.  Raccoon: A Novel Network I/O Allocation Framework for Workload-Aware VM Scheduling in Virtual Environments , 2017, IEEE Transactions on Parallel and Distributed Systems.

[26]  Miao Yu,et al.  Dancing with Giants: Wimpy Kernels for On-Demand Isolated I/O , 2014, 2014 IEEE Symposium on Security and Privacy.

[27]  Weisong Shi,et al.  Energy efficiency comparison of hypervisors , 2017, 2016 Seventh International Green and Sustainable Computing Conference (IGSC).

[28]  Brian Kocoloski,et al.  XEMEM: Efficient Shared Memory for Composed Applications on Multi-OS/R Exascale Systems , 2015, HPDC.

[29]  Yang Wang,et al.  Naplus: a software distributed shared memory for virtual clusters in the cloud , 2017, Softw. Pract. Exp..

[30]  Jian Wang,et al.  XenLoop: a transparent high performance inter-VM network loopback , 2008, HPDC '08.

[31]  Torsten Hoefler,et al.  Cache-Oblivious MPI All-to-All Communications Based on Morton Order , 2018, IEEE Transactions on Parallel and Distributed Systems.

[32]  Jaesoo Yoo,et al.  Security Enhancement of Wireless Sensor Networks Using Signal Intervals , 2017, Sensors.

[33]  Qi Zhang,et al.  Residency Aware Inter-VM Communication in Virtualized Cloud: Performance Measurement and Analysis , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[34]  Pierre Manneback,et al.  Optimizing Xen inter-domain data transfer , 2014, 2014 International Conference on High Performance Computing & Simulation (HPCS).

[35]  Garth R. Goodson,et al.  Fido: Fast Inter-Virtual-Machine Communication for Enterprise Appliances , 2009, USENIX ATC.

[36]  Alan L. Cox,et al.  Optimizing network virtualization in Xen , 2006 .

[37]  Olav N. Østerbø,et al.  RF Energy Harvesting and Information Transmission Based on NOMA for Wireless Powered IoT Relay Systems , 2018, Sensors.

[38]  Gerhard P. Hancke,et al.  Overlay Virtualized Wireless Sensor Networks for Application in Industrial Internet of Things: A Review , 2018, Sensors.

[39]  Ramana Rao Kompella,et al.  Protocol Responsibility Offloading to Improve TCP Throughput in Virtualized Environments , 2013, ACM Trans. Comput. Syst..

[40]  Shuji Tanaka,et al.  Electrical Design and Evaluation of Asynchronous Serial Bus Communication Network of 48 Sensor Platform LSIs with Single-Ended I/O for Integrated MEMS-LSI Sensors , 2018, Sensors.

[41]  Umesh Deshpande,et al.  Traffic-sensitive Live Migration of Virtual Machines , 2017, Future Gener. Comput. Syst..

[42]  Yongji Wang,et al.  CIVSched: A Communication-Aware Inter-VM Scheduling Technique for Decreased Network Latency between Co-Located VMs , 2014, IEEE Transactions on Cloud Computing.

[43]  Zoltán Ádám Mann,et al.  Resource Optimization Across the Cloud Stack , 2018, IEEE Transactions on Parallel and Distributed Systems.

[44]  Taisook Han,et al.  CAFE: A Virtualization-Based Approach to Protecting Sensitive Cloud Application Logic Confidentiality , 2015, AsiaCCS.

[45]  Dhabaleswar K. Panda,et al.  MVAPICH2 over OpenStack with SR-IOV: An Efficient Approach to Build HPC Clouds , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[46]  Tommaso Cucinotta,et al.  Challenges in real-time virtualization and predictable cloud computing , 2014, J. Syst. Archit..

[47]  Congfeng Jiang,et al.  Resource Allocation in Contending Virtualized Environments through Stochastic Virtual Machine Performance Modeling and Feedback , 2013, J. Inf. Sci. Eng..

[48]  Yuebin Bai,et al.  A high performance inter-domain communication approach for virtual machines , 2013, J. Syst. Softw..

[49]  Hai Jin,et al.  AdaptIDC: Adaptive inter-domain communication in virtualized environments , 2013, Comput. Electr. Eng..

[50]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[51]  Ling Liu,et al.  Efficient Shared Memory Orchestration towards Demand Driven Memory Slicing , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[52]  J. Javier Gutiérrez,et al.  Enabling Data-Centric Distribution Technology for Partitioned Embedded Systems , 2016, IEEE Transactions on Parallel and Distributed Systems.

[53]  Qi Zhang,et al.  iBalloon: Efficient VM Memory Balancing as a Service , 2016, 2016 IEEE International Conference on Web Services (ICWS).

[54]  Chi-Sheng Shih,et al.  Making Sensor Node Virtual Machines Work for Real-World Applications , 2019, IEEE Embedded Systems Letters.