Autonomy in use for space situation awareness

Advancements in artificial intelligence, information communication, and systems design are potential for autonomous systems emerging for space situation awareness (SSA) architectures. Examples of architecture designs are autonomy in motion (AIM) for dynamic data assessment systems (e.g., robotics) and autonomy at rest (AAR) for static data collection systems (e.g., surveillance). However, there is a need for data architectures which are tailored to the SSA missions, which necessitates autonomy in use (AIU). AIU requires pragmatic use of message passing and data flow architectures, contextual and theoretic modeling, and user and information fusion. Information fusion provides methods for data aggregation, correlation, and temporal assessment and awareness. Together, AIU accesses the dynamic data for autonomy in change (AIC), information fusion from AAR in order to make AIM real-time decisions. The paper discusses issues for space situation awareness directions focusing on autonomy in use.

[1]  Erik Blasch,et al.  A Markov game model for space threat prediction , 2008, SPIE Defense + Commercial Sensing.

[2]  Erik Blasch,et al.  Combining Convolutional and Recurrent Neural Networks for Human Skin Detection , 2017, IEEE Signal Processing Letters.

[3]  David Frederic Crouse,et al.  On measurement-based light-time corrections for bistatic orbital debris tracking , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Erik Blasch,et al.  Characterizing the semantic information loss between geospatial sensors and geospatial information systems (GIS) , 2011, Defense + Commercial Sensing.

[5]  Genshe Chen,et al.  On effectiveness of routing algorithms for satellite communication networks , 2013, Defense, Security, and Sensing.

[6]  S. Plano,et al.  DFIG level 5 (user refinement) issues supporting situational assessment reasoning , 2005, 2005 7th International Conference on Information Fusion.

[7]  Erik Blasch,et al.  Track splitting technique for the contact lens problem , 2011, 14th International Conference on Information Fusion.

[8]  Genshe Chen,et al.  Joint transmission power control in transponded SATCOM systems , 2016, MILCOM 2016 - 2016 IEEE Military Communications Conference.

[9]  Hui-Min Huang,et al.  Autonomy Levels for Unmanned Systems (ALFUS) Framework Volume I: Terminology Version 2.0 , 2004 .

[10]  Erik Blasch,et al.  Description of the Choquet Integral for tactical knowledge representation , 2010, 2010 13th International Conference on Information Fusion.

[11]  Erik Blasch,et al.  Methods of AI for Multimodal Sensing and Action for Complex Situations , 2019, AI Mag..

[12]  Erik Blasch,et al.  Context-Enhanced Information Fusion: Boosting Real-World Performance with Domain Knowledge , 2016 .

[13]  Erik Blasch,et al.  Context-driven moving vehicle detection in wide area motion imagery , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Li Bai,et al.  Multiple source data fusion via sparse representation for robust visual tracking , 2011, 14th International Conference on Information Fusion.

[15]  Erik Blasch,et al.  User information fusion decision making analysis with the C-OODA model , 2011, 14th International Conference on Information Fusion.

[16]  Erik Blasch,et al.  Moving object detection for vehicle tracking in Wide Area Motion Imagery using 4D filtering , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[17]  Erik Blasch,et al.  Multi-entity Bayesian network for the handling of uncertainties in SATCOM links , 2015, Defense + Security Symposium.

[18]  Erik Blasch,et al.  Sensor management for collision alert in orbital object tracking , 2011, Defense + Commercial Sensing.

[19]  Gang Wang,et al.  Distributed QoS awareness in satellite communication network with optimal routing (QuASOR) , 2014, 2014 IEEE/AIAA 33rd Digital Avionics Systems Conference (DASC).

[20]  Roberto Furfaro,et al.  Dynamic Sensor Tasking for Space Situational Awareness via Reinforcement Learning , 2016 .

[21]  Daniel E. Hastings,et al.  The Space Weather Threat to Situational Awareness, Communications, and Positioning Systems , 2015, IEEE Transactions on Plasma Science.

[22]  Chun Yang,et al.  Optimal Placement of Heterogeneous Sensors for Targets with Gaussian Priors , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Lauro Snidaro,et al.  Context-Enhanced Information Fusion , 2016, Advances in Computer Vision and Pattern Recognition.

[24]  Eloi Bosse,et al.  High-Level Information Fusion Management and System Design , 2012 .

[25]  Erik Blasch,et al.  Game theoretic power allocation and waveform selection for satellite communications , 2015, Defense + Security Symposium.

[26]  Gang Wang,et al.  Network survivability oriented Markov games (NSOMG) in wideband satellite communications , 2014, 2014 IEEE/AIAA 33rd Digital Avionics Systems Conference (DASC).

[27]  Aubrey B. Poore,et al.  Multiple Hypothesis Tracking (MHT) for Space Surveillance: Results and Simulation Studies , 2013 .

[28]  Erik Blasch,et al.  Three-dimensional receiver operating characteristic (ROC) trajectory concepts for the evaluation of target recognition algorithms faced with the unknown target detection problem , 1999, Defense, Security, and Sensing.

[29]  Zheng Liu,et al.  Multispectral Image Fusion and Colorization , 2018 .

[30]  Erik Blasch,et al.  Revisiting the JDL model for information exploitation , 2013, Proceedings of the 16th International Conference on Information Fusion.

[31]  Shaolei Ren,et al.  Game Theory for Cyber Security and Privacy , 2017, ACM Comput. Surv..

[32]  Alexandru Takacs,et al.  Microwave Power Harvesting for Satellite Health Monitoring , 2014, IEEE Transactions on Microwave Theory and Techniques.

[33]  Erik Blasch,et al.  Uncertainty Considerations for Ontological Decision-Making Support in Avionics Analytics , 2018, 2018 IEEE/AIAA 37th Digital Avionics Systems Conference (DASC).

[34]  Manfred Tscheligi,et al.  Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience , 2014, AutomotiveUI.

[35]  Paulo Cesar G. da Costa,et al.  Determining model correctness for situations of belief fusion , 2013, Proceedings of the 16th International Conference on Information Fusion.

[36]  Erik Blasch,et al.  Issues and Challenges in Situation Assessment (Level 2 Fusion) , 2006, J. Adv. Inf. Fusion.

[37]  Erik Blasch,et al.  Unmanned vehicles come of age: The DARPA grand challenge , 2006, Computer.

[38]  James S. Albus,et al.  4-D/RCS reference model architecture for unmanned ground vehicles , 1999, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[39]  Erik Blasch,et al.  Using maximum consistency context for multiple target association in wide area traffic scenes , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[40]  Erik Blasch,et al.  Uncertainty representation, quantification and evaluation for data and information fusion , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[41]  Erik Blasch,et al.  Towards unbiased evaluation of uncertainty reasoning: The URREF ontology , 2012, 2012 15th International Conference on Information Fusion.

[42]  Genshe Chen,et al.  A trust-based sensor allocation algorithm in cooperative space search problems , 2011, Defense + Commercial Sensing.

[43]  Dan Shen,et al.  Adaptive Markov Game Theoretic Data Fusion Approach for Cyber Network Defense , 2007, MILCOM 2007 - IEEE Military Communications Conference.

[44]  Erik Blasch,et al.  Predicted radar/optical feature fusion gains for target identification , 2010, Proceedings of the IEEE 2010 National Aerospace & Electronics Conference.

[45]  Mark L. Pugh,et al.  Big data for space situation awareness , 2017, Defense + Security.

[46]  Haibin Ling,et al.  A Container-Based Elastic Cloud Architecture for Pseudo Real-Time Exploitation of Wide Area Motion Imagery (WAMI) Stream , 2016, Journal of Signal Processing Systems.

[47]  Zhonghai Wang,et al.  Spatial context for moving vehicle detection in wide area motion imagery with multiple kernel learning , 2013, Defense, Security, and Sensing.

[48]  David Crouse,et al.  Basic tracking using nonlinear 3D monostatic and bistatic measurements in refractive environments , 2014, IEEE Aerospace and Electronic Systems Magazine.

[49]  Genshe Chen,et al.  Context aided video-to-text information fusion , 2014, 17th International Conference on Information Fusion (FUSION).

[50]  E. Blasch,et al.  Sensor Management Fusion Using Operating Conditions , 2008, 2008 IEEE National Aerospace and Electronics Conference.

[51]  Li Bai,et al.  Evaluation of visual tracking in extremely low frame rate wide area motion imagery , 2011, 14th International Conference on Information Fusion.

[52]  C. Yang,et al.  Pose angular-aiding for maneuvering target tracking , 2005, 2005 7th International Conference on Information Fusion.

[53]  Jing Peng,et al.  Regularized Difference Criterion for Computing Discriminants for Dimensionality Reduction , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[54]  Erik Blasch,et al.  Diffusion-based cooperative space object tracking , 2019 .

[55]  Zheng Liu,et al.  Statistical comparison of image fusion algorithms: Recommendations , 2017, Inf. Fusion.

[56]  James S. Albus,et al.  4D/RCS: a reference model architecture for intelligent unmanned ground vehicles , 2002, SPIE Defense + Commercial Sensing.

[57]  Erik Blasch,et al.  Level 5: user refinement to aid the fusion process , 2003, SPIE Defense + Commercial Sensing.

[58]  Alan N. Steinberg,et al.  Context-sensitive data fusion using structural equation modeling , 2009, 2009 12th International Conference on Information Fusion.

[59]  Brett D. Nener,et al.  Multi-Sensor Space Debris Tracking for Space Situational Awareness With Labeled Random Finite Sets , 2019, IEEE Access.

[60]  Zheng Liu,et al.  Deep Learning Measures of Effectiveness , 2018, NAECON 2018 - IEEE National Aerospace and Electronics Conference.

[61]  Li Bai,et al.  Efficient Minimum Error Bounded Particle Resampling L1 Tracker With Occlusion Detection , 2013, IEEE Transactions on Image Processing.

[62]  Gang Wang,et al.  Performance evaluation of SATCOM link in the presence of radio frequency interference , 2016, 2016 IEEE Aerospace Conference.

[63]  Erik Blasch,et al.  Pursuit-evasion games with information uncertainties for elusive orbital maneuver and space object tracking , 2015, Defense + Security Symposium.

[64]  Genshe Chen,et al.  Cooperative space object tracking using space-based optical sensors via consensus-based filters , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[65]  Erik Blasch,et al.  Game theoretic sensor management for target tracking , 2010, Defense + Commercial Sensing.

[66]  Erik Blasch,et al.  Orbital satellite pursuit-evasion game-theoretical control , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[67]  Genshe Chen,et al.  A low-cost, near-real-time two-UAS-based UWB emitter monitoring system , 2015, IEEE Aerospace and Electronic Systems Magazine.

[68]  Zhonghai Wang,et al.  Ground jammer localization with two satellites based on the fusion of multiple parameters , 2011, Defense + Commercial Sensing.

[69]  Gang Wang,et al.  High-throughput, cyber-secure multiuser superposition covert avionics system , 2018, IEEE Aerospace and Electronic Systems Magazine.

[70]  Erik Blasch,et al.  Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[71]  Erik Blasch,et al.  Adaptive context assessment and context management , 2014, 17th International Conference on Information Fusion (FUSION).

[72]  Khanh Pham,et al.  Space collision threat mitigation , 2014, Defense + Security Symposium.

[73]  Erik Blasch,et al.  Decisions-to-Data using Level 5 information fusion , 2014, Defense + Security Symposium.

[74]  Erik Blasch,et al.  Random-point-based filters: analysis and comparison in target tracking , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[75]  Allen M. Waxman,et al.  Neural image fusion of remotely sensed electro-optical and synthetic aperture radar data for forest classification , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[76]  John D. Childs,et al.  A review of space robotics technologies for on-orbit servicing , 2015 .

[77]  Erik Blasch,et al.  Sensor, User, Mission (SUM) Resource Management and Their Interaction with Level 2/3 Fusion , 2006, 2006 9th International Conference on Information Fusion.

[78]  Genshe Chen,et al.  Cooperative space object tracking via multiple space-based visible sensors with communication loss , 2014, 2014 IEEE Aerospace Conference.

[79]  John L. Crassidis,et al.  Space Object Shape Characterization and Tracking Using Light Curve and Angles Data , 2014 .

[80]  Sang Peter Chin.  Game-theoretic homological sensor resource management for SSA , 2009, Defense + Commercial Sensing.

[81]  Florentin Smarandache,et al.  Advances and Applications of DSmT for Information Fusion (Collected Works) , 2004 .

[82]  Jason L. Speyer,et al.  Health Monitoring of a Satellite System , 2013 .

[83]  Erik Blasch,et al.  Micro-Doppler radar classification of humans and animals in an operational environment , 2018, Expert Syst. Appl..

[84]  Erik Blasch,et al.  Covariance Estimation and Gaussianity Assessment for State and Measurement Noise , 2020 .

[85]  Lauro Snidaro,et al.  Integration of contextual information for tracking refinement , 2011, 14th International Conference on Information Fusion.

[86]  Genshe Chen,et al.  Multi-Pursuer Multi-Evader Pursuit-Evasion Games with Jamming Confrontation , 2007, J. Aerosp. Comput. Inf. Commun..

[87]  Genshe Chen,et al.  Information fusion in a cloud computing era: A systems-level perspective , 2014, IEEE Aerospace and Electronic Systems Magazine.

[88]  Tian Xin,et al.  Secure spectrum-efficient frequency hopping for return link of protected tactical satellite communications , 2016 .

[89]  Genshe Chen,et al.  A probabilistic situational awareness and reasoning methodology for satellite communications resource management , 2015, 2015 IEEE Aerospace Conference.

[90]  Erik Blasch,et al.  Probabilistic graphical models for multi-source fusion from text sources , 2015, 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA).

[91]  Alan N. Steinberg,et al.  Adaptive context exploitation , 2013, Defense, Security, and Sensing.

[92]  E. Blasch,et al.  Assembling a distributed fused information-based human-computer cognitive decision making tool , 2000, IEEE Aerospace and Electronic Systems Magazine.

[93]  Erik Blasch,et al.  Fusion of Tracks with Road Constraints , 2008, J. Adv. Inf. Fusion.

[94]  Erik Blasch,et al.  Enhanced air operations using JView for an air-ground fused situation awareness udop , 2013, 2013 IEEE/AIAA 32nd Digital Avionics Systems Conference (DASC).

[95]  Genshe Chen,et al.  A real-time orbit SATellites Uncertainty propagation and visualization system using graphics computing unit and multi-threading processing , 2015, 2015 IEEE/AIAA 34th Digital Avionics Systems Conference (DASC).

[96]  F. Markley,et al.  Unscented Filtering for Spacecraft Attitude Estimation , 2003 .

[97]  Erik Blasch,et al.  Overview of contextual tracking approaches in information fusion , 2013, Defense, Security, and Sensing.

[98]  Genshe Chen,et al.  Vehicle detection in wide area aerial surveillance using Temporal Context , 2013, Proceedings of the 16th International Conference on Information Fusion.

[99]  Gang Wang,et al.  Hybrid onboard and ground based digital channelizer beam-forming for SATCOM interference mitigation and protection , 2016, SPIE Defense + Security.

[100]  Erik Blasch,et al.  Comparison of several space target tracking filters , 2009, Defense + Commercial Sensing.

[101]  D. Rodrik.  Industrial Policy for the Twenty-First Century , 2004 .

[102]  E. Blasch,et al.  Ten Methods to Fuse GMTI and HRRR Measurements for Joint Tracking and Identification , 2004 .

[103]  Genshe Chen,et al.  DDDAS for space applications , 2018, Defense + Security.

[104]  Erik Blasch,et al.  Review of game theory applications for situation awareness , 2015, Defense + Security Symposium.

[105]  John L. Crassidis,et al.  Fundamentals of Spacecraft Attitude Determination and Control , 2014 .

[106]  Erik Blasch,et al.  Pursuit-evasion orbital game for satellite interception and collision avoidance , 2011, Defense + Commercial Sensing.

[107]  Erik Blasch,et al.  Data association through fusion of target track and identification sets , 2000, Proceedings of the Third International Conference on Information Fusion.

[108]  Erik Blasch,et al.  Applying Aerospace Technologies to Current Issues Using Systems Engineering: 3rd AESS chapter summit , 2013 .

[109]  Ba-Ngu Vo,et al.  Challenges of multi-target tracking for space situational awareness , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[110]  Manoranjan Majji,et al.  Analytic characterization of measurement uncertainty and initial orbit determination on orbital element representations , 2014 .

[111]  Erik Blasch,et al.  Multi-agent Modeling and Analysis for Space Situation Awareness , 2009 .

[112]  Chun Yang,et al.  Kalman Filtering with Nonlinear State Constraints , 2009 .

[113]  Genshe Chen,et al.  Exploration of blockchain-enabled decentralized capability-based access control strategy for space situation awareness , 2018, Optical Engineering.

[114]  Erik Blasch,et al.  Mobile positioning via fusion of mixed signals of opportunity , 2014, IEEE Aerospace and Electronic Systems Magazine.

[115]  Gee Wah Ng,et al.  High-level Information Fusion: An Overview , 2013, J. Adv. Inf. Fusion.

[116]  Erik Blasch,et al.  QuEST for Information Fusion in Multimedia Reports , 2014, Int. J. Monit. Surveillance Technol. Res..

[117]  Erik Blasch,et al.  Uncertainty evaluation of data and information fusion within the context of the decision loop , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[118]  A. Ash,et al.  Findings from the UK and Canadian Space Situational Awareness (SSA) Experimentation during the Relocation of SKYNET 5A Satellite , 2016 .

[119]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[120]  James Llinas,et al.  High Level Information Fusion (HLIF): Survey of models, issues, and grand challenges , 2012, IEEE Aerospace and Electronic Systems Magazine.

[121]  Barry Smith,et al.  The Space Object Ontology , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[122]  Genshe Chen,et al.  A joint manifold leaning-based framework for heterogeneous upstream data fusion , 2018, Journal of Algorithms & Computational Technology.

[123]  Jose B. Cruz,et al.  Game Theoretic Approach to Threat Prediction and Situation Awareness , 2006, 2006 9th International Conference on Information Fusion.

[124]  Erik Blasch,et al.  URREF reliability versus credibility in information fusion (STANAG 2511) , 2013, Proceedings of the 16th International Conference on Information Fusion.

[125]  I. Kadar,et al.  Resource management coordination with level 2/3 fusion issues and challenges [Panel Report] , 2008, IEEE Aerospace and Electronic Systems Magazine.

[126]  Genshe Chen,et al.  Scalable sentiment classification for Big Data analysis using Naïve Bayes Classifier , 2013, 2013 IEEE International Conference on Big Data.

[127]  Genshe Chen,et al.  Tracking evasive objects via a search allocation game , 2010, Proceedings of the 2010 American Control Conference.

[128]  Erik Blasch,et al.  Performance Measures of Covariance and Information Matrices in Resource Management for Target State Estimation , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[129]  Phillip Jeff. Durst,et al.  Levels of autonomy and autonomous system performance assessment for intelligent unmanned systems , 2014 .

[130]  Erik Blasch,et al.  Services oriented architecture (SOA)-based persistent ISR simulation system , 2010, Defense + Commercial Sensing.

[131]  Roberto Furfaro,et al.  Space Object classification using deep Convolutional Neural Networks , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[132]  Erik Blasch,et al.  GRoup IMM Tracking utilizing Track and Identification Fusion , 2001 .

[133]  Erik Blasch,et al.  Jamming/anti-jamming game with a cognitive jammer in space communication , 2012, Defense + Commercial Sensing.

[134]  Erik Blasch,et al.  Cyber security with radio frequency interferences mitigation study for satellite systems , 2016, SPIE Defense + Security.

[135]  Genshe Chen,et al.  Prediction of compression-induced image interpretability degradation , 2018 .

[136]  Erik Blasch,et al.  Automatic Association of Chats and Video Tracks for Activity Learning and Recognition in Aerial Video Surveillance , 2014, Sensors.

[137]  Erik Blasch,et al.  Mitigation of weather on channel propagation for satellite communications , 2016, SPIE Defense + Security.

[138]  Erik Blasch,et al.  Measures of effectiveness for high-level fusion , 2010, 2010 13th International Conference on Information Fusion.

[139]  Genshe Chen,et al.  An adaptive process-based cloud infrastructure for space situational awareness applications , 2014, Defense + Security Symposium.

[140]  K. D. Pham,et al.  Space Object Classification Using Fused Features of Time Series Data , 2017 .

[141]  Erik Blasch,et al.  Models in frequency-hopping-based proactive jamming mitigation for space communication networks , 2012, Defense + Commercial Sensing.