Optimizing cognitive analysis sensitivity of photospheres using cube maps

Image cognition is a fast developing field of modern technology. Considerably accurate, well trained algorithms have already been developed and exposed as public APIs for automated analysis of conventional photographs. However, in recent past, the photography field has shifted from conventional photography, embracing new concepts such as 360 surround photography or photospheres. With the advent of latest consumer level technologies such as Virtual Reality, the importance of photospheres has grown even wider as it could provide an immersive, real-life like experience to the viewer. However, the well trained image cognition implementations available today do not perform well on 360 surround photos due to the distortions in them caused by high field of view. This paper presents a unique, innovative approach, inspired from well-known concept, cube maps, to significantly improve compatibility of image cognition systems with 360 surround photography. We have obtained 2–3 fold increase in sensitivity of conventional image cognition algorithms on analyzing photospheres. Through the proposed framework, existing technologies such as Image Cognitive Analysis, Automated Surveillance and Content based indexing technologies can be made available for 360-imagery at an affordable cost.

[1]  Marco Zennaro,et al.  Large-scale privacy protection in Google Street View , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Rendering 3D Tessellations with Conformal Curvilinear Perspective , 2013 .

[3]  Leonard McMillan,et al.  Multi‐Perspective Modelling, Rendering and Imaging , 2008, SIGGRAPH Asia '08.

[4]  Jonathan T. Barron,et al.  Jump: virtual reality video , 2016, ACM Trans. Graph..

[5]  Krista A. Ehinger,et al.  Recognizing scene viewpoint using panoramic place representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jigyasa Sharma,et al.  Microsoft Cognitive Services , 2018 .

[7]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, CVPR.

[8]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[9]  Rei Kawakami,et al.  Microsoft Cognitive Services , 2018 .

[10]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Brendan Iribe Oculus Rift를 이용한 체감형 게임 구현 , 2014 .