Medical QoS provision based on reinforcement learning in ultrasound streaming over 3.5G wireless systems

The design of an efficient mobile healthcare system using 3.5G and 4G wireless networks is a challenging problem especially for bandwidth demanding telemedical applications. In this paper, we focus on the concept of medical quality of service (m-QoS) applied to a typical bandwidth demanding m-health application. Based on this concept, we propose a novel multiobjective rate-control mechanism for the optimized delivery of diagnostically acceptable ultrasound video images over 3.5G wireless networks. The performance of the proposed algorithm has been evaluated via both simulations and experimental studies. The proposed optimal rate control algorithm achieved performance improvements that are compatible with the medical QoS requirements.

[1]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM.

[2]  R. Istepanian,et al.  Clinical trials and evaluation of a mobile, robotic tele-ultrasound system , 2005, Journal of telemedicine and telecare.

[3]  Antti Toskala,et al.  HSDPA/HSUPA for UMTS: High Speed Radio Access for Mobile Communications , 2006 .

[4]  Jyrki Huusko,et al.  Content adaptive network aware joint optimization of wireless video transmission , 2007, IEEE Communications Magazine.

[5]  A. W. Rix,et al.  Objective perceptual quality measurement of 3G video services , 2004 .

[6]  Naixue Xiong,et al.  Comparative Analysis of Quality of Service and Memory Usage for Adaptive Failure Detectors in Healthcare Systems Naixue Xiong, MIEEE, Athanasios V. Vasilakos, MIEEE, Laurence T. Yang, MIEEE, Lingyang Song, MIEEE, Yi Pan, SMIEEE, Rajgopal Kannan, MIEEE, and Yingshu Li, MIEEE , 2009 .

[7]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[8]  Yoo-Sok Saw.  Rate-Quality Optimized Video Coding , 1998 .

[9]  Pamela C. Cosman,et al.  End-to-end differentiation of congestion and wireless losses , 2003, TNET.

[10]  Maria G. Martini.  Wireless broadband multimedia health services: Current status and emerging concepts , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[11]  Ian F. Akyildiz,et al.  RCS: a rate control scheme for real-time traffic in networks with high bandwidth-delay products and high bit error rates , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[12]  S. Haykin,et al.  A Q-learning-based dynamic channel assignment technique for mobile communication systems , 1999 .

[13]  Avideh Zakhor,et al.  Rate control for streaming video over wireless , 2004, IEEE INFOCOM 2004.

[14]  Emil Jovanov,et al.  Guest Editorial Introduction to the Special Section on M-Health: Beyond Seamless Mobility and Global Wireless Health-Care Connectivity , 2004, IEEE Transactions on Information Technology in Biomedicine.

[15]  IstepanianR. S.H.,et al.  Guest Editorial Introduction to the Special Section on M-Health , 2004 .

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Hari Balakrishnan,et al.  Explicit Loss Notification and Wireless Web Performance , 2006 .

[18]  E. Turhan Tunali,et al.  Adaptive available bandwidth estimation for internet video streaming , 2006, Signal Process. Image Commun..

[19]  Mosa Ali Abu-Rgheff,et al.  3G wireless communications for mobile robotic tele-ultrasonography systems , 2006, IEEE Communications Magazine.

[20]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[21]  Antonio Ortega,et al.  Rate control for robust video transmission over burst-error wireless channels , 1999, IEEE J. Sel. Areas Commun..

[22]  Chung-Ju Chang,et al.  Q-learning-based multirate transmission control scheme for RRM in multimedia WCDMA systems , 2004, IEEE Transactions on Vehicular Technology.

[23]  King Ngi Ngan,et al.  Recent advances in rate control for video coding , 2007, Signal Process. Image Commun..

[24]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[25]  Matteo Mazzotti,et al.  Robust Multilayer Control for Enhanced Wireless Telemedical Video Streaming , 2010, IEEE Transactions on Mobile Computing.

[26]  Naixue Xiong,et al.  Comparative analysis of quality of service and memory usage for adaptive failure detectors in healthcare systems , 2009, IEEE Journal on Selected Areas in Communications.

[27]  Stuart E. Dreyfus,et al.  Applied Dynamic Programming , 1965 .

[28]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[29]  R. Istepanian,et al.  M-Health: Emerging Mobile Health Systems , 2006 .

[30]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[31]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[32]  Antti Toskala,et al.  WCDMA for UMTS: Radio Access for Third Generation Mobile Communications , 2000 .

[33]  Takeshi Yoshimura,et al.  Real-time video transport optimization using streaming agent over 3G wireless networks , 2005, IEEE Transactions on Multimedia.

[34]  Abdul Hamid Sadka.  Compressed Video Communications , 2002 .

[35]  M.G. Martini,et al.  Quality Driven Wireless Video Transmission for Medical Applications , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  Ian Postlethwaite,et al.  Simulated annealing for multiobjective control system design , 1997 .

[37]  Fan Yang,et al.  End-to-end TCP-friendly streaming protocol and bit allocation for scalable video over wireless Internet , 2004, IEEE Journal on Selected Areas in Communications.

[38]  Abbas Jamalipour,et al.  The Wireless Mobile Internet: Architectures, Protocols and Services , 2003 .

[39]  Nitin H. Vaidya,et al.  Discriminating congestion losses from wireless losses using inter-arrival times at the receiver , 1999, Proceedings 1999 IEEE Symposium on Application-Specific Systems and Software Engineering and Technology. ASSET'99 (Cat. No.PR00122).

[40]  Antti Toskala,et al.  Wcdma for Umts , 2002 .