Engineer-Computer Interaction for Structural Monitoring

An increased availability of information technology (IT) is currently influencing decisions to monitor structures more frequently. IT is invariably used to interpret structural behaviour from monitoring data. However, engineers remain frustrated with IT results. Engineers work with incomplete knowledge, problem specific characteristics, and context dependency. Although such conditions require interactivity and multiple solutions, most structural monitoring software provides automatic data-analysis with one interpretation. The aim of this thesis is to determine appropriate computer support for engineers to consider multiple-interpretations so that they can converge upon better explanations of current structural behaviour. This is done through the presentation of an interactive space of solutions to which engineers can add contextual information and delete irrelevant knowledge as necessary. In order to do this successfully, compatible human-computer interaction (HCI) for engineers is needed with suitable visualisations of data and behavioural interpretations. The main contribution of this thesis is Engineer-Computer Interaction (ECI) which is a new sub-domain of HCI specifically tailored to engineers. ECI provides a generic blueprint which i) uses an information classification schema, ii) integrates standard engineer characteristics and working procedures into the software, and iii) provides a modular approach to task decomposition; for the development of software. A software toolkit for structural monitoring Structural Monitoring Tool Kit (SMTK) has been developed according to the ECI blueprint in order to illustrate ECI utility. SMTK was empirically evaluated through standard HCI techniques to illustrate its compatibility with engineers when performing structural monitoring data interpretation. Results show that engineers prefer software which has been developed following ECI than existing software because ECI software is tailored to their needs. A second prototype is suggested for in-service prediction to illustrate ECI generality. Finally, areas for future work have been highlighted. In conclusion, ECI is useful for the design and development of software for structural monitoring and has the potential to be applied to other engineering tasks. The ECI extensible foundation leads to revealing comparison between structural monitoring and other tasks such as analysis.

[1]  David E. Kieras,et al.  An Approach to the Formal Analysis of User Complexity , 1999, Int. J. Man Mach. Stud..

[2]  David B. Leake Abduction, experience, and goals: a model of everyday abductive explanation , 1995, J. Exp. Theor. Artif. Intell..

[3]  Ian F. C. Smith,et al.  Constraint solving and preference activation for interactive design , 1998, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[4]  Allen Newell,et al.  GPS, a program that simulates human thought , 1995 .

[5]  C. Lottaz Collaborative design using solution spaces , 2000 .

[6]  Ian F. C. Smith Abductive engineering support , 1997 .

[7]  Samuel Vurpillot Analyse automatisée des systèmes de mesure de déformation pour l"auscultation des structures , 1999 .

[8]  Paolo Salvaneschi,et al.  Monitoring and Diagnosis of Monuments through Artificial Intelligence , 1994 .

[9]  Ben Shneiderman,et al.  Assessing users' subjective satisfaction with the Information System forYouth Services (ISYS) , 1998 .

[10]  West Balcones,et al.  Design space navigation as a collaborative aid , 1993 .

[11]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[12]  Donald L. Shirer,et al.  Programs for Statistics and Data Analysis , 1999, Computing in Science & Engineering.

[13]  Bernard Sufrin Formal Specification of a Display-Oriented Text Editor , 1982, Sci. Comput. Program..

[14]  Jakob Nielsen,et al.  Scenarios in discount usability engineering , 1995 .

[15]  S. French,et al.  Decision Theory: An Introduction to the Mathematics of Rationality. , 1988 .

[16]  Joseph A. Goguen,et al.  Algebraic semantics of imperative programs , 1996, Foundations of computing series.

[17]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[18]  John Adkins Richardson,et al.  Visual Explanations: Images and Quantities, Evidence and Narrative , 1999 .

[19]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[20]  P. Johnson-Laird Mental models , 1989 .

[21]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[22]  Katsumi Tadamura Multi-functional visualization system for structure analysis , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[23]  W. J. Spencer Fundamental Structural Analysis , 1988 .

[24]  Markus Stolze Visual Critiquing in Domain Oriented Design Environments: Showing the Right Thing at the Right Place , 1994 .

[25]  Ian E. Smith,et al.  Augmented Reality Applications to Structural Monitoring , 1998, AI in Structural Engineering.

[26]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[27]  David C. Brown,et al.  A Preliminary Investigation of Design Simplification by Analogy , 1998, AID.

[28]  Paolo Salvaneschi,et al.  Applying AI to Structural Safety Monitoring and Evaluation , 1996, IEEE Expert.

[29]  Clare-Marie Karat,et al.  Comparison of empirical testing and walkthrough methods in user interface evaluation , 1992, CHI.

[30]  Simon French,et al.  Uncertainty and Imprecision: Modelling and Analysis , 1995 .

[31]  Daniele Inaudi,et al.  Vertical Deflection of a Pre-Stressed Concrete Bridge Obtained Using Deformation Sensors and Inclinometer Measurements , 1998 .

[32]  Tim Smithers,et al.  Towards a Knowledge Level Theory of Design Process , 1998, AID.

[33]  Gerhard Fischer,et al.  Turning breakdowns into opportunities for creativity , 1994, Knowl. Based Syst..

[34]  Daniele Inaudi,et al.  Quasi-static strain monitoring during the "push" phase of a box-girder bridge using fiber Bragg grating sensors , 1998, Optical Fibre Sensors.

[35]  Jp Davis,et al.  Monitoring Instrumentation Fault Diagnosis and Data Interpretation , 1995 .

[36]  Jakob Nielsen,et al.  The Anti-Mac interface , 1996, CACM.

[37]  Steven J. Fenves,et al.  Knowledge-Based Assistance for Finite-Element Modeling , 1996, IEEE Expert.

[38]  Richard J. Doyle,et al.  MESA: an interactive modeling and simulation environment for intelligent systems automation , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[39]  Kenneth F. Dunker,et al.  WHY AMERICA'S BRIDGES ARE CRUMBLING , 1993 .

[40]  Daniele Inaudi,et al.  Structural monitoring by curvature analysis using interferometric fiber optic sensors , 1998 .

[41]  Poul Henning Kirkegaard,et al.  Comparison of Vibration-Based Damage Assessment Techniques , 1995 .

[42]  Bruno Feijó,et al.  An agent-based paradigm for building intelligent CAD systems , 1997, Artif. Intell. Eng..

[43]  Peter Wegner,et al.  Why interaction is more powerful than algorithms , 1997, CACM.

[44]  Blake Ives,et al.  An empirical study of the impact of user involvement on system usage and information satisfaction , 1986, CACM.

[45]  B. Raphael,et al.  A probabilistic search algorithm for finding optimally directed solutions , 2000 .

[46]  Walter F. Tichy,et al.  Should Computer Scientists Experiment More? , 1998, Computer.

[47]  John C. Kunz,et al.  Collaborative desktop engineering , 1998, AI in Structural Engineering.

[48]  Anthony E. Armenàkas,et al.  Classical Structural Analysis: A Modern Approach , 1988 .

[49]  Brian Falkenhainer,et al.  Compositional Modeling: Finding the Right Model for the Job , 1991, Artif. Intell..

[50]  R. Stalker,et al.  Structural Monitoring Support through Augmented Reality , 1998 .

[51]  Barry G. Silverman,et al.  Expert Critics in Engineering Design: Lessons Learned and Research Needs , 1992, AI Mag..

[52]  K. A. Stroud,et al.  Engineering Mathematics , 2020, Nature.

[53]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[54]  Andrew B. Whinston,et al.  Foundations of Decision Support Systems , 1981 .

[55]  George Casaday Taking software design seriously: practical techniques for human-computer interaction design , 1991 .

[56]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[57]  José L. Encarnação,et al.  Graphics and Visualization: The Essential Features for the Classification of Systems , 1993, ICCG.

[58]  John S. Gero,et al.  Knowledge-Based Design Systems , 1989 .

[59]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[60]  Ashok K. Goel,et al.  Explanatory Interface in Interactive Design Environments , 1996 .

[61]  A. Parasuraman,et al.  Delivering quality service : balancing customer perceptions and expectations , 1990 .

[62]  John R. Josephson,et al.  Abductive inference : computation, philosophy, technology , 1994 .

[63]  John S. Gero,et al.  Design Prototypes: A Knowledge Representation Schema for Design , 1990, AI Mag..

[64]  Chong Ho Yu,et al.  Abduction? Deduction? Induction? Is There a Logic of Exploratory Data Analysis?. , 1994 .

[65]  Ian E. Smith,et al.  Structural Monitoring: Decision-Support through Multiple Data Interpretations , 1998, AI in Structural Engineering.

[66]  David C. Brown,et al.  Design Problem Solving: Knowledge Structures and Control Strategies , 1989 .

[67]  Donald R. Cooper,et al.  Business Research Methods , 1980 .

[68]  J. S. Briggs,et al.  Designing the user interface: strategies for effective human-computer interaction: by Ben Schneiderman. Published by Addison-Wesley. 463pp. £17.95 , 1987 .

[69]  Martin C. Maguire,et al.  Evaluating User-Computer Interaction: A Framework , 1993, Int. J. Man Mach. Stud..

[70]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[71]  Norman Wiseman,et al.  An Introductory Guide to Scientific Visualization , 1992, Springer Berlin Heidelberg.

[72]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach , 1982 .

[73]  Kenneth D. Forbus Qualitative Process Theory , 1984, Artificial Intelligence.

[74]  Jennifer Preece,et al.  A taxonomy for combining software engineering and human-computer interaction measurement approaches: towards a common framework , 1994, Int. J. Hum. Comput. Stud..

[75]  Edwin Henry Gaylord,et al.  Structural Engineering Handbook , 1968 .

[76]  Harold W. Thimbleby,et al.  User interface design , 1990, ACM Press Frontier Series.

[77]  J. Michael Spivey,et al.  Understanding Z : A specification language and its formal semantics , 1985, Cambridge tracts in theoretical computer science.

[78]  J. Grudin,et al.  Design Models for Computer-Human Interfaces , 1996, Computer.

[79]  Clare-Marie Karat,et al.  A comparison of user interface evaluation methods , 1994 .

[80]  Paolo Salvaneschi,et al.  An expert system for the diagnosis and rehabilitation of building structures , 1989 .

[81]  L. Zadeh The role of fuzzy logic in the management of uncertainty in expert systems , 1983 .

[82]  S. Timoshenko,et al.  Theory of elasticity , 1975 .

[83]  Ian F. C. Smith,et al.  Knowledge representation for preliminary stages of engineering tasks , 1994, Knowl. Based Syst..

[84]  V. Clark,et al.  Computer-aided multivariate analysis , 1991 .

[85]  Sheng-Fen Chien,et al.  Design space navigation : an annotated bibliography , 1996 .

[86]  Ian E. Smith,et al.  Finding the right model for bridge diagnosis , 1998, AI in Structural Engineering.

[87]  John Karat,et al.  Software Evaluation Methodologies , 1988 .

[88]  Rae A. Earnshaw,et al.  Visualization: Using Computer Graphics to Explore Data and Present Information , 1995 .

[89]  David P. Billington,et al.  The Tower and the Bridge: The New Art of Structural Engineering , 1985 .

[90]  Ian F. C. Smith,et al.  Decision support through multiple models and probabilistic search , 2000 .

[91]  Kristian J. Hammond,et al.  Representing and Using Procedural Knowledge to Build Geometry Proofs , 1993, AAAI.

[92]  H. Margolis Visual explanations: Images and quantities, evidence and narrative , 1998 .

[93]  C. J. Moore,et al.  Decision support for conceptual bridge design , 1997, Artif. Intell. Eng..

[94]  Ian F. C. Smith,et al.  Computational control for active structures , 2000 .

[95]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[96]  Urs Hirschberg,et al.  INTEGRATION OF DIGITAL PHOTOGRAMMETRY AND CAAD: CONSTRAINT-BASED MODELLING AND SEMI-AUTOMATIC MEASUREMENT , 1995 .

[97]  Poul Henning Kirkegaard,et al.  Vibration Based Damage Assessment of a Civil Engineering Structures using a Neural Networks , 1994 .

[98]  T. H. G. Megson Strength of materials for civil engineers , 1980 .

[99]  Tim Finin,et al.  General User Modelling: a Facility to Support Intelligent Interaction , 1988, SGCH.

[100]  Daniele Inaudi,et al.  Mathematical model for the determination of the vertical displacement from internal horizontal measurements of a bridge , 1996, Smart Structures.

[101]  Ian F. C. Smith,et al.  Creating design objects from cases for interactive spatial composition , 1996 .

[102]  Marcus Wigan,et al.  Knowledge based systems in civil engineering , 1989 .

[103]  Mauro Facchini Optical techniques applied to the study of building materials and to the inspection of civil structures , 1995 .

[104]  Robert Johnson,et al.  Structural Analysis , 2020, Multiphysics Modeling with Application to Biomedical Engineering.

[105]  David C. Brown,et al.  NLG - Natural Language Graphics , 1977, IJCAI.

[106]  B. Schneiderman,et al.  Designing the User Interface. Strategies for Effective Human-Computer Interaction , 1992 .

[107]  Richard L. Branham Scientific data analysis - an introduction to overdetermined systems , 1990 .

[108]  Ian F.C. Smith Interactive design - time to bite the bullet , 1996 .

[109]  Sylvie Boulanger Preliminary bridge design navigation tool for novices , 1997 .

[110]  Daniele Inaudi Fiber optic sensor network for the monitoring of civil engineering structures , 1997 .

[111]  Phil Barnard,et al.  Bridging between basic theories and the artifacts of human-computer interaction , 1991 .

[112]  Alan J. Dix,et al.  Formal methods for interactive systems , 1991, Computers and people series.

[113]  Eugene J. O'Brien,et al.  Bridge deck analysis , 1999 .

[114]  Leo Joskowicz,et al.  Efficient Compositional Modeling for Generating Causal Explanations , 1996, Artif. Intell..

[115]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[116]  Ian F. C. Smith,et al.  Performance-based Structural Engineering , 1999 .

[117]  Rae A. Earnshaw,et al.  Animation and scientific visualization : tools and applications , 1993 .

[118]  Grady Booch,et al.  Object-Oriented Analysis and Design with Applications , 1990 .

[119]  Ian F. C. Smith,et al.  Performance Enhancement of Active Structures During Service Lives , 2002 .

[120]  David R. Barstow,et al.  Exploring artificial intelligence : survey talks from the National Conferences on Artificial Intelligence , 1988 .

[121]  C. L. Dym,et al.  The role of symbolic representation in engineering design education , 1993 .

[122]  Marc Ayel,et al.  Mutants in the KBS Testing Process , 1995, EUROVAV.