Optimising Quality-of-Control for Data-Intensive Multiprocessor Image-Based Control Systems Considering Workload Variations

Image-Based Control (IBC) systems have a long sample period. Sensing in these systems consists of compute-intensive image processing algorithms whose response times are dependent on image workload. IBC systems are typically designed for the worst-case workload that results in a long sample period and hence suboptimal quality-of-control (QoC). This worst-case based design is further considered for mapping of controller tasks and allocating platform resources, resulting in significant resource over-provisioning. Our design philosophy is to sample as fast as possible to optimise QoC for a given platform allocation, and for this, we present a structured design flow. Workload variations determine how fast we can sample and we model this dynamic behaviour using the concept of workload scenarios. Our choice of scenario-aware dataflow as the formal model for our application enables us to: i) model dynamic behaviour, analyse timing, and optimally map application tasks to the platform for maximising the effective utilisation of allocated resources, ii) relate throughput of the dataflow graph to the sample period, and thus combine dataflow analysis and mapping with control design parameters and QoC to identify system scenarios, and iii) to efficiently implement a run-time mechanism that manages necessary dynamic reconfiguration between system scenarios. Our results show that our design approach outperforms the worst-case based design with respect to optimising QoC and maximising effective resource utilisation.

[1]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.

[2]  S. Stuijk Predictable mapping of streaming applications on multiprocessors , 2007 .

[3]  Ryo Kurazume,et al.  Robust visual servoing for object manipulation with large time-delays of visual information , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  E.A. Lee,et al.  Synchronous data flow , 1987, Proceedings of the IEEE.

[5]  Naoki Oda,et al.  Vision-based Motion Control for Robotic Systems , 2009 .

[6]  Kees G. W. Goossens,et al.  Composable Platform-Aware Embedded Control Systems on a Multi-core Architecture , 2015, 2015 Euromicro Conference on Digital System Design.

[7]  Warren E. Dixon,et al.  Compensating for time-varying input and state delays inherent to image-based control systems , 2016, 2016 American Control Conference (ACC).

[8]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[9]  Edward A. Lee,et al.  Software Synthesis from Dataflow Graphs , 1996 .

[10]  Karolin Papst,et al.  Stability Theory Of Switched Dynamical Systems , 2016 .

[11]  Naresh K. Sinha,et al.  Modern Control Systems , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Jos Elfring,et al.  Effective World Modeling: Multisensor Data Fusion Methodology for Automated Driving , 2016, Sensors.

[13]  Twan Basten,et al.  Robustness analysis of multiprocessor schedules , 2014, 2014 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (SAMOS XIV).

[14]  Sander Stuijk,et al.  Reconfigurable pipelined sensing for image-based control , 2016, 2016 11th IEEE Symposium on Industrial Embedded Systems (SIES).

[15]  Sander Stuijk,et al.  A scenario-aware data flow model for combined long-run average and worst-case performance analysis , 2006, Fourth ACM and IEEE International Conference on Formal Methods and Models for Co-Design, 2006. MEMOCODE '06. Proceedings..

[16]  Jitendra Malik,et al.  A Comparative Study of Vision-Based Lateral Control Strategies for Autonomous Highway Driving , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[17]  Yoichi Hori,et al.  Multirate Estimation and Control of Body Slip Angle for Electric Vehicles Based on Onboard Vision System , 2014, IEEE Transactions on Industrial Electronics.

[18]  Gigel Macesanu,et al.  A Time-Delay Control Approach for a Stereo Vision Based Human-Machine Interaction System , 2014, J. Intell. Robotic Syst..

[19]  Ajinkya Bhave,et al.  Performance bounds on state-feedback controllers with network delay , 2008, 2008 47th IEEE Conference on Decision and Control.

[20]  E. Malis Survey of vision-based robot control , 2002 .

[21]  Marcelo H. Ang,et al.  Perception, Planning, Control, and Coordination for Autonomous Vehicles , 2017 .

[22]  Pratyusha Davuluri An Introduction to Electron Microscopy , 2018 .

[23]  Robert Shorten,et al.  On common quadratic Lyapunov functions for stable discrete‐time LTI systems , 2004 .

[24]  Peter I. Corke,et al.  Robotics, Vision and Control - Fundamental Algorithms in MATLAB® , 2011, Springer Tracts in Advanced Robotics.

[25]  W. Wolovich State-space and multivariable theory , 1972 .

[26]  van Horssen,et al.  Data-intensive feedback control : switched systems analysis and design , 2018 .

[27]  Jitendra Malik,et al.  A Comparative Study of Vision-Based Lateral Control Strategies for Autonomous Highway Driving , 1999, Int. J. Robotics Res..

[28]  Henk Corporaal,et al.  System-scenario-based design of dynamic embedded systems , 2009, TODE.

[29]  B Tsatsa,et al.  [Introduction to electron microscopy]. , 1972, Hellenika stomatologika chronika. Hellenic stomatological annals.