New layers in JMARS for displaying enhanced stereo and disparity images of Mastcam

The Mastcam multispectral imagers onboard the Mars rover Curiosity have been collecting data since 2012. There are two imagers onboard the rover. The left imager has a wide field of view, but three times lower resolution than that of the right, which is just the opposite. Left and right images can be combined to generate stereo and disparity images. However, the resolution of the stereo images using conventional ways is at the same resolution of the left. Ideally, it will be more interesting to science fans and rover operators if one can generate stereo images with the same resolution of the right imager, as the resolution will be three times better. Recently, we have developed some algorithms that can fuse left and right images to create left images with the same resolution of the right. Consequently, high resolution stereo images can be generated. Moreover, disparity images can also be generated. In this document, we will summarize the development of new JMARS layers that display the enhanced left images using pansharpening and deep learning algorithms, high resolution stereo images, and high resolution disparity maps. The details of the workflow will be described. Some demonstration examples will be given as well.

[1]  Chiman Kwan,et al.  Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images , 2019 .

[2]  Chiman Kwan,et al.  Resolution enhancement for hyperspectral images: A super-resolution and fusion approach , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  B. Ayhan,et al.  New Layer in JMARS , 2014 .

[4]  B. Ayhan,et al.  On The Use of a Linear Spectral Unmixing Technique For Concentration Estimation of APXS Spectrum , 2015 .

[5]  Chiman Kwan,et al.  Perceptually lossless compression of Mastcam images with error recovery , 2019, Defense + Commercial Sensing.

[6]  Chiman Kwan,et al.  A comparative study of conventional and deep learning approaches for demosaicing Mastcam images , 2019, Defense + Commercial Sensing.

[7]  Chiman Kwan,et al.  Compression Algorithm Selection for Multispectral Mastcam Images , 2019 .

[8]  Hairong Qi,et al.  Enhancement of JMARS , 2012 .

[9]  Chiman Kwan,et al.  Mastcam image enhancement using estimated point spread functions , 2017, 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON).

[10]  Chiman Kwan,et al.  Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Chiman Kwan,et al.  Perceptually Lossless Compression for Mastcam Images , 2018, 2018 9th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON).

[12]  Chiman Kwan,et al.  Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions , 2019, Sensors.

[13]  Chiman Kwan,et al.  Stereo Image and Depth Map Generation for Images with Different Views and Resolutions , 2018, 2018 9th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON).

[14]  Chiman Kwan,et al.  Enhancing Mastcam Images for Mars Rover Mission , 2017, ISNN.

[15]  Chiman Kwan,et al.  A Novel Utilization of Image Registration Techniques to Process Mastcam Images in Mars Rover With Applications to Image Fusion, Pixel Clustering, and Anomaly Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Chiman Kwan,et al.  Demosaicing enhancement using pixel-level fusion , 2018, Signal Image Video Process..

[17]  Jocelyn Chanussot,et al.  A critical comparison of pansharpening algorithms , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[18]  Hairong Qi,et al.  Revisiting the preprocessing procedures for elemental concentration estimation based on chemcam libs on mars rover , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[19]  Chiman Kwan,et al.  Enhancing Stereo Image Formation and Depth Map Estimation for Mastcam Images , 2018, 2018 9th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON).

[20]  Chiman Kwan,et al.  Hyperspectral image super-resolution: a hybrid color mapping approach , 2016 .

[21]  Chiman Kwan,et al.  Pansharpening of Mastcam images , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).