Statistical Risk Estimation for Communication System Design

Spacecraft is complex systems that involve different subsystems and multiple relationships among them. For these reasons, the design of a spacecraft is an evolutionary process that starts from requirements and evolves over time across different design phases. During this process, a lot of changes can happen. They can affect mass and power at component, subsystem, and system levels. Each spacecraft has to respect the overall constraints in terms of mass and power: for this reason, it is important to be sure that the design does not exceed these limitations. Current practice in the system model primarily deals with this problem by allocating margins on individual components and on individual subsystems. However, a statistical characterization of the fluctuations in mass and power of the overall system (i.e., the spacecraft) is missing. This lack of an adequate statistical characterization would result in a risky spacecraft design that might not fit the mission constraints and requirements, or in a conservative design that might not fully utilize the available resources. Due to the complexity of the problem and due to the different expertise and knowledge required to develop a complete risk model for a spacecraft design, this research is focused on risk estimation for a specific spacecraft subsystem, the communication subsystem. The current research aims to be a “proof of concept” of a risk-based design optimization approach, which can then be further expanded to the design of other subsystems as well as to the whole spacecraft. The objective of this paper is to develop a mathematical approach to quantify the likelihood that the major design drivers of mass and power of a space communication system would meet the spacecraft and mission requirements and constraints through the mission design lifecycle. Using this approach the communication system designers will be able to evaluate and compare different communication architectures in a risk tradeoff prospective. The results described in the presentation include a baseline communication system design tool, and a statistical characterization of the design risks through a combination of historical mission data and expert opinion contributions. An application example of the communication system of a university spacecraft is presented.

[1]  L. Meshkat,et al.  A Holistic Approach for Risk Management During Design , 2007, 2007 IEEE Aerospace Conference.

[2]  L. Breiman,et al.  Variable Kernel Estimates of Multivariate Densities , 1977 .

[3]  D. Dubois,et al.  Possibility theory and data fusion in poorly informed environments , 1994 .

[4]  William F. Wright,et al.  Effects of situation familiarity and financial incentives on use of the anchoring and adjustment heuristic for probability assessment , 1989 .

[5]  A. Gelfand,et al.  Modeling Expert Opinion Arising as a Partial Probabilistic Specification , 1995 .

[6]  Arnold Neumaier,et al.  Autonomous robust design optimisation with potential clouds , 2009 .

[7]  Robert E. Machol,et al.  System engineering handbook , 1965 .

[8]  Simon French,et al.  Encyclopedia of quantitative risk analysis and assessment , 2008 .

[9]  R. Cooke.  Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[10]  Robert T. Clemen,et al.  Copula Models for Aggregating Expert Opinions , 1996, Oper. Res..

[11]  David W. Miller,et al.  Mit castor satellite: Design, implementation, and testing of the communication system ☆ , 2012 .

[12]  Jim Taylor,et al.  Cassini Orbiter/Huygens Probe Telecommunications , 2002 .

[13]  Natalia Alexandrov,et al.  Multidisciplinary design optimization : state of the art , 1997 .

[14]  Jian Zhou,et al.  Approach of Expert Opinion Acquisition Based on Cloud Model and Evidence Theory , 2009, 2009 International Conference on Management and Service Science.

[15]  M.E. Davis,et al.  Space based radar technology challenges , 2005, 2005 IEEE Aerospace Conference.

[16]  J. Koehler.  The base rate fallacy reconsidered: Descriptive, normative, and methodological challenges , 1996, Behavioral and Brain Sciences.

[17]  James R. Wertz,et al.  Space Mission Analysis and Design , 1992 .

[18]  C. Quesenberry,et al.  A nonparametric estimate of a multivariate density function , 1965 .

[19]  Kar-Ming Cheung,et al.  Statistical Link Analysis — A Risk Analysis Perspective , 2011 .

[20]  Anthony O'Hagan,et al.  Eliciting expert beliefs in substantial practical applications , 1998 .

[21]  John Quigley,et al.  Expert judgement combination using moment methods , 2008, Reliab. Eng. Syst. Saf..

[22]  David R. Cox,et al.  Edgeworth and Saddle‐Point Approximations with Statistical Applications , 1979 .

[23]  William A. Imbriale,et al.  Spaceborne Antennas for Planetary Exploration: Imbriale/Spaceborne , 2006 .

[24]  Keith Warfield,et al.  The JPL cost risk analysis approach that incorporates engineering realism , 2006 .

[25]  Kar-Ming Cheung,et al.  Risk analysis for nondeterministic mission planning and sequencing , 2005, 2005 IEEE Aerospace Conference.

[26]  R.C. Schulze,et al.  The New Horizons high gain antenna: reflector design for a spin-stabilized bus at cryogenic temperatures , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[27]  Martin S. Feather,et al.  Optimizing spacecraft design optimization engine development: progress and plans , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[28]  Martin Sweeting,et al.  Very-Small-Satellite Design for Distributed Space Missions , 2007 .

[29]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[30]  Edward J. Dudewicz,et al.  Modern Mathematical Statistics , 1988 .

[31]  D. A. Seaver,et al.  Eliciting subjective probability distributions on continuous variables , 1978 .

[32]  Robert L. Winkler,et al.  Combining Probability Distributions From Experts in Risk Analysis , 1999 .

[33]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[34]  Kar-Ming Cheung,et al.  Mars Global Surveyor Telecommunications , 2001 .

[35]  Rania Hassan,et al.  DISCRETE DESIGN OPTIMIZATION UNDER UNCERTAINTY: A GENERALIZED POPULATION-BASED SAMPLING GENETIC ALGORITHM , 2004 .

[36]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[37]  Keith E. Wilson,et al.  Comparative study of optical and rf communication systems for a Mars mission , 1996, Photonics West.

[38]  Merriam Webster.  Merriam-Webster's Collegiate Dictionary , 2016 .

[39]  Alessandra Babuscia,et al.  Statistical Risk Estimation for Communication System Design: Results of the HETE-2 Test Case , 2014 .

[40]  Stephan R. Sain,et al.  Multi-dimensional Density Estimation , 2004 .

[41]  Charles F. Lillie,et al.  Parametric cost estimation for space science missions , 2008, Astronomical Telescopes + Instrumentation.

[42]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[43]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[44]  Joseph H. Yuen,et al.  Deep Space Telecommunications Systems Engineering , 2013 .

[45]  Gudela Grote.  Uncertainty Management at the Core of System Design , 2003 .

[46]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[47]  Edwin B. Dean.  Parametric Cost Analysis: A Design Function , 1989 .

[48]  Charles D. Brown.  Elements of Spacecraft Design , 2002 .

[49]  Jon C. Helton,et al.  Challenge Problems : Uncertainty in System Response Given Uncertain Parameters ( DRAFT : November 29 , 2001 ) , 2001 .

[50]  Steven L. Cornford,et al.  Risk based decision tool for space exploration missions , 2003 .

[51]  Arnold Neumaier,et al.  Uncertainty modeling in autonomous robust spacecraft system design , 2007 .

[52]  Ali Mosleh,et al.  A critique of current practice for the use of expert opinions in probabilistic risk assessment , 1988 .

[53]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[54]  J. H. Yuen.  Deep space telecommunication systems engineering , 1983 .

[55]  Xiaoping Du,et al.  Efficient Uncertainty Analysis Methods for Multidisciplinary Robust Design , 2002 .

[56]  Rania Hassan,et al.  ARCHITECTING A COMMUNICATION SATELLITE PRODUCT LINE , 2004 .

[57]  Bradford W. Parkinson,et al.  System Design under Uncertainty: Evolutionary Optimization of the Gravity Probe-B Spacecraft , 1994, PPSN.

[58]  T Haftka Raphael,et al.  Multidisciplinary aerospace design optimization: survey of recent developments , 1996 .

[59]  Vincent Goulet,et al.  expert: Modeling Without Data Using Expert Opinion , 2009 .

[60]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[61]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[62]  G. Apostolakis.  The concept of probability in safety assessments of technological systems. , 1990, Science.

[63]  Allan S Detsky,et al.  Everyone's a little bit biased (even physicians). , 2008, JAMA.

[64]  Harry F. Martz,et al.  A Statistical Model for Combining Biased Expert Opinions , 1984, IEEE Transactions on Reliability.

[65]  Jairus Hihn,et al.  Parametric Cost Modeling of Space Missions Using the Develop New Projects (DNP) Implementation Process , 1999 .

[66]  Nicholas Frank Pidgeon,et al.  The conjunction fallacy: The case for the existence of competing heuristic strategies , 1997 .

[67]  Alessandra Babuscia,et al.  A Quantitative Approach to Perform Expert Elicitation for Space Communication System Design and Risk Analysis: Methodology and Experimental Results , 2011 .

[68]  Paolo Giorgini,et al.  Using Risk Analysis to Evaluate Design Alternatives , 2006, AOSE.

[69]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[70]  David W. Miller,et al.  Multi-Objective, Multidisciplinary Design Optimization Methodology for Distributed Satellite Systems , 2004 .

[71]  Panos Y. Papalambros,et al.  Principles of Optimal Design: Author Index , 2000 .

[72]  C. E. Gilchriest.  Spacecraft mass trade-offs versus radio-frequency power and antenna size at 8 GHz and 32 GHz , 1987 .

[73]  Marshall B. Jones,et al.  2.1.1 Isoperformance: Analysis and Design of Complex Systems with Known or Desired Outcomes , 2004 .

[74]  Richard A. Davis,et al.  Remarks on Some Nonparametric Estimates of a Density Function , 2011 .

[75]  Robert C. Blattberg,et al.  Database Models And Managerial Intuition: 50% Model + 50% Manager , 1990 .

[76]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[77]  Olivier L. de Weck,et al.  Staged Deployment of Communications Satellite Constellations in Low Earth Orbit , 2004, J. Aerosp. Comput. Inf. Commun..

[78]  Alessandra Babuscia,et al.  Statistical Rick Estimation for Communication System Design --- A Preliminary Look , 2012 .

[79]  Arnold Neumaier,et al.  Potential Based Clouds in Robust Design Optimization , 2009 .

[80]  David Lindley,et al.  Reliability (and Fault Tree) Analysis Using Expert Opinions , 1986 .

[81]  Harold Sackman,et al.  Delphi critique : expert opinion, forecasting, and group process , 1975 .

[82]  John Shawe-Taylor,et al.  A Framework for Probability Density Estimation , 2007, AISTATS.

[83]  Martin S. Feather,et al.  Optimizing the design of end-to-end spacecraft systems using risk as a currency , 2002, Proceedings, IEEE Aerospace Conference.

[84]  Merriam-Webster.  Merriam-Webster's Collegiate Dictionary , 1998 .

[85]  De Weck,et al.  Multivariable isoperformance methodology for precision opto-mechanical systems , 2002 .

[86]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[87]  Raymond J. Sedwick,et al.  Application of Multidisciplinary Design Optimization Techniques to Distributed Satellite Systems , 2000 .

[88]  Dimitris Bertsimas,et al.  Nonconvex Robust Optimization for Problems with Constraints , 2010, INFORMS J. Comput..

[89]  W. M. Bolstad.  Introduction to Bayesian Statistics , 2004 .

[90]  Arnold Neumaier,et al.  Handling Uncertainty in Higher Dimensions with Potential Clouds towards Robust Design Optimization , 2008, SMPS.

[91]  Irem Y. Tumer,et al.  The Risk in Early Design (RED) Method: Likelihood and Consequence Formulations , 2006, DAC 2006.

[92]  Cyrus D. Jilla,et al.  Multidisciplinary Design Optimization Methodology for the Conceptual Design of Distributed Satellite Systems , 2002 .

[93]  M. C. Jones,et al.  E. Fix and J.L. Hodges (1951): An Important Contribution to Nonparametric Discriminant Analysis and Density Estimation: Commentary on Fix and Hodges (1951) , 1989 .

[94]  S. Burkhart,et al.  Microtechnology in telecommunications for spacecraft cost and mass reduction , 1995 .

[95]  David A. Bearden,et al.  A complexity-based risk assessment of low-cost planetary missions: when is a mission too fast and too cheap? , 2003 .

[96]  Osman Balci.  Validation, verification, and testing techniques throughout the life cycle of a simulation study , 1994, WSC '94.

[97]  Donald S. Remer,et al.  Long-range planning cost model for support of future space missions by the deep space network , 1992 .

[98]  Hany H. Ammar,et al.  Model-based performance risk analysis , 2005, IEEE Transactions on Software Engineering.

[99]  A. Dasgupta.  Asymptotic Theory of Statistics and Probability , 2008 .

[100]  R. S. Bokulic,et al.  Telecommunications system technologies for the near spacecraft , 1996 .

[101]  W. A. Imbriale,et al.  Spaceborne antennas for planetary exploration , 2006 .

[102]  G. William Walster,et al.  A comparative study of differences in subjective likelihood estimates made by individuals, interacting groups, Delphi groups, and nominal groups☆ , 1973 .

[103]  USRA NASA Ames,et al.  DESIGN TEAMS , COMPLEX SYSTEMS AND UNCERTAINTY , 2007 .

[104]  Harold I. Jacobson.  THE MAXIMUM VARIANCE OF RESTRICTED UNIMODAL DISTRIBUTIONS , 1969 .

[105]  E. Wood,et al.  Automated Design of Spacecraft Telecommunication Subsystems Using Evolutionary Computational Techniques , 2007, 2007 IEEE Aerospace Conference.

[106]  David W. Miller,et al.  Assessing the performance of a heuristic simulated annealing algorithm for the design of distributed satellite systems , 2001 .

[107]  Seth D. Guikema,et al.  Programmatic Risk Analysis for Critical Engineering Systems Under Tight Resource Constraints , 2003, Oper. Res..

[108]  M. C. Jones,et al.  A Brief Survey of Bandwidth Selection for Density Estimation , 1996 .

[109]  A. O'Hagan,et al.  Statistical Methods for Eliciting Probability Distributions , 2005 .

[110]  D. Reudink.  Maximum Power Transmission in Mass-Limited Radio Systems , 1982, IEEE Trans. Commun..

[111]  Karen Willcox,et al.  Stochastic Process Decision Methods for Complex-Cyber-Physical Systems , 2011 .

[112]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[113]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .