Formal system design for intelligent artifacts

This work deals with conceptual and software aspects (i.e. algorithms and structure) of intelligent systems interacting with the real-world. Typical domains for such systems are robotics as well as personal digital- and driver assistance. In decades of research on intelligent systems, a large number of system structures or architectures for intelligent artifacts have been proposed and implemented. However, no established and broadly accepted hypothesis for such a system structure has emerged because no common language or common understanding of the space of architectures exists. This in turn makes scientific discourse about architectures difficult. In this thesis we aim to improve the process and tools for describing, constructing and evolving the architecture and software of large-scale systems for intelligent artifacts. At the heart of this improvement is the proposed formalism 'Systematica 2D', suitable for both flexible description of system architectures as well as for functional design of the resulting system integration process. We motivate the approach and relate it to other formal descriptions by means of a new formalization measure. The new language is shown to find a good compromise between cognitive description, high flexibility and easy implementation. We present ways to map resulting designs to the most popular infrastructure paradigms and derive mathematically provable benefits for the system construction process: incremental composition, graceful degradation, subsystem separation and global deadlock-free operation. Finally, the powers of the formalism for architecture categorization and comparison are explored. It is analytically shown that there is a direct relation between sensor / behavior spaces (a descriptive design property) and the interfaces and connections of units (a functional design property). Without lack of generality, examples and results are obtained from two specific, recent and state-of-the-art large-scale systems: ALIS3 [Goerick 2009] and AutoSys [Schmuedderich 2010]. Experimental results show that a) modeling a wide variety of systems as Systematica 2D designs is possible, b) implementing systems according to such a design is dramatically faster and produces inherent, provable system properties and c) different systems can be related and classified based on the designs.

[1]  Giulio Sandini,et al.  Object-based Visual Attention: a Model for a Behaving Robot , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[2]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[3]  Peyman Oreizy,et al.  xADL: enabling architecture-centric tool integration with XML , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[4]  Volker Willert,et al.  A stochastic dynamical system for optical flow estimation , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Volker Willert,et al.  Direct Surface Fitting , 2010, VISAPP.

[6]  Qi Gao,et al.  A generative perspective on MRFs in low-level vision , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[8]  Yoav Shoham,et al.  Agent-Oriented Programming , 1992, Artif. Intell..

[9]  Salvatore Greco,et al.  Evolutionary Multi-Criterion Optimization , 2011, Lecture Notes in Computer Science.

[10]  Inna Mikhailova,et al.  Expectation-driven autonomous learning and interaction system , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[11]  Jannik Fritsch,et al.  Cross-module learnin ga s a first step towards a cognitive system concept , 2008 .

[12]  Deb Roy October,et al.  A Mechanistic Model of Three Facets of Meaning , 2007 .

[13]  Martin Heckmann,et al.  Teaching a humanoid robot: Headset-free speech interaction for audio-visual association learning , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[14]  Nick Hawes,et al.  BALT & CAST: Middleware for Cognitive Robotics , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[15]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[16]  Andrea Roli,et al.  Brooks - A robust layered control system for a mobile robot , 2013 .

[17]  Christian Goerick,et al.  Artificial neural networks in real-time car detection and tracking applications , 1996, Pattern Recognit. Lett..

[18]  Gerhard Sagerer,et al.  Understanding Social Robots , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[19]  Walter Mann,et al.  Correction to "Specification and Analysis of System Architecture Using Rapide" , 1995, IEEE Trans. Software Eng..

[20]  Martin Heckmann,et al.  Interactive online multimodal association for internal concept building in humanoids , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[21]  Christian Goerick,et al.  A language for formal design of embedded intelligence research systems , 2011, Robotics Auton. Syst..

[22]  Joseph Sifakis,et al.  Composition for component-based modeling , 2002, Sci. Comput. Program..

[23]  Heiko Wersing,et al.  System approach for multi-purpose representations of traffic scene elements , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[24]  Inna Mikhailova,et al.  Organizing multimodal perception for autonomous learning and interactive systems , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[25]  R. Born,et al.  Integrating motion and depth via parallel pathways , 2008, Nature Neuroscience.

[26]  Jannik Fritsch,et al.  A Hierarchical System Integration Approach with Application to Visual Scene Exploration for Driver Assistance , 2009, ICVS.

[27]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[28]  Christian Goerick,et al.  Towards an Understanding of Hierarchical Architectures , 2011, IEEE Transactions on Autonomous Mental Development.

[29]  Christian Goerick,et al.  Researching and developing a real-time infrastructure for intelligent systems - Evolution of an integrated approach , 2008, Robotics Auton. Syst..

[30]  Heiko Wersing,et al.  Towards incremental hierarchical behavior generation for humanoids , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[31]  Nick Hawes,et al.  Engineering intelligent information-processing systems with CAST , 2010, Adv. Eng. Informatics.

[32]  Mark Dunn,et al.  Visually Guided Whole Body Interaction , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[33]  Giulio Sandini,et al.  A Survey of Artificial Cognitive Systems: Implications for the Autonomous Development of Mental Capabilities in Computational Agents , 2007, IEEE Transactions on Evolutionary Computation.

[34]  Aaron Sloman,et al.  Architectures, Architecture-Schemas, And The New Science of Mind. 1 , 2008 .

[35]  G. Sandini,et al.  The iCub cognitive architecture: Interactive development in a humanoid robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[36]  R. Brooks,et al.  The cog project: building a humanoid robot , 1999 .

[37]  Sonia Chernova,et al.  From Deliberative to Routine Behaviors: A Cognitively Inspired Action-Selection Mechanism for Routine Behavior Capture , 2007, Adapt. Behav..

[38]  Luc Van Gool,et al.  Dynamic 3D Scene Analysis from a Moving Vehicle , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Francisco José Ortiz Zaragoza,et al.  V3CMM: a 3-view component meta-model for model-driven robotic software development , 2010 .

[40]  Jannik Fritsch,et al.  Adaptive multi-cue fusion for robust detection of unmarked inner-city streets , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[41]  Karsten Berns,et al.  Development of complex robotic systems using the behavior-based control architecture iB2C , 2010, Robotics Auton. Syst..

[42]  Jared Jackson Microsoft robotics studio: A technical introduction , 2007, IEEE Robotics & Automation Magazine.

[43]  Christian Bauckhage,et al.  An XML based framework for cognitive vision architectures , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[44]  Heiko Wersing,et al.  Learning Optimized Features for Hierarchical Models of Invariant Object Recognition , 2003, Neural Computation.

[45]  M. Kleinehagenbrock,et al.  Towards a human-like vision system for Driver Assistance , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[46]  Christian Igel,et al.  Steady-State Selection and Efficient Covariance Matrix Update in the Multi-objective CMA-ES , 2007, EMO.

[47]  E. Gat On Three-Layer Architectures , 1997 .

[48]  Matthias Scheutz,et al.  RADIC: a generic component for the integration of existing reactive and deliberative layers , 2006, AAMAS '06.

[49]  Mark Steedman,et al.  Exploration and Planning in a Three-Level Cognitive Architecture , 2008 .

[50]  David Herrero Pérez,et al.  Programming multirobot applications using the ThinkingCap-II Java framework , 2010, Adv. Eng. Informatics.

[51]  Richard F. Paige,et al.  Process-centered review of object oriented software development methodologies , 2008, CSUR.

[52]  Richard N. Taylor,et al.  A framework for classifying and comparing architecture description languages , 1997, ESEC '97/FSE-5.

[53]  Takashi Suehiro,et al.  A Software Platform for Component Based RT-System Development: OpenRTM-Aist , 2008, SIMPAR.

[54]  Nick Hawes Architectures by Design: The Iterative Development of an Integrated Intelligent Agent , 2009, SGAI Conf..

[55]  Christian Heipke,et al.  EVALUATION OF AUTOMATIC ROAD EXTRACTION , 2007 .

[56]  Gregory D. Abowd,et al.  Formalizing style to understand descriptions of software architecture , 1995, TSEM.

[57]  Ben Dushnik,et al.  Partially Ordered Sets , 1941 .

[58]  Austen Clark,et al.  Feature-placing and proto-objects , 2004 .

[59]  Inna Mikhailova,et al.  Coupling of mental concepts to a reactive system: incremental approach in system design , 2008 .

[60]  Sebastian Wrede,et al.  An Integration Framework for Developing Interactive Robots , 2005, PPSDR@ICRA.