An Inverse Perspective Mapping Approach using Monocular Camera of Pepper Humanoid Robot to Determine the Position of Other Moving Robot in Plane

This article presents a method to know the position of object or moving robot in the plane while the camera is moving dynamically. An Inverse Perspective mapping (IPM) approach has been embedded in a monocular camera on Head of Pepper Humanoid Robot (Softbank Robotics) for real time position determination of other object or robot in plane. While the Pepper head is moving, it is difficult to determine position or distance to objects in front of the robot with any different degree of certainity. By applying IPM, a linear relationship between the IPM frame and world frame becomes the key element to know the position of object while the head is static but when the head orientation changes the IPM is modified to adapt the linear relationship between both frames. So, the proposed method is based on the extraction of accurate bird’s-eye view. The method includes the Image Acquistion, IPM Filtering, Detection Phase, Region of Interest Selection and Pixel remapping.

[1]  Ming-Shi Wang,et al.  A Vision Based Top-View Transformation Model for a Vehicle Parking Assistant , 2012, Sensors.

[2]  Miguel Oliveira,et al.  Multimodal inverse perspective mapping , 2015, Inf. Fusion.

[3]  Muaz A. Niazi,et al.  Technical Problems With "Programmable self-assembly in a thousand-robot swarm" , 2014, ArXiv.

[4]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[5]  Yoshiko Kojima,et al.  Automatic lane-level map generation for advanced driver assistance systems using low-cost sensors , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Sibel Yenikaya,et al.  Keeping the vehicle on the road: A survey on on-road lane detection systems , 2013, CSUR.

[7]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[8]  Enrique Marcial-Simon.  Collision warning system and method for collision warning , 2016 .

[9]  Dacheng Tao,et al.  Person Re-Identification Over Camera Networks Using Multi-Task Distance Metric Learning , 2014, IEEE Transactions on Image Processing.

[10]  Robert Laganiere,et al.  Compositing a bird ' s eye view mosaic , 2000 .

[11]  Séverin Lemaignan,et al.  Artificial cognition for social human-robot interaction: An implementation , 2017, Artif. Intell..

[12]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods , 2000 .

[13]  Helder Araújo,et al.  Calibration of Smooth Camera Models , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[15]  D E Maurino,et al.  Beyond Aviation Human Factors: Safety in High Technology Systems , 1995 .

[16]  Radhika Nagpal,et al.  Programmable self-assembly in a thousand-robot swarm , 2014, Science.

[17]  Renato Zaccaria,et al.  Path Following for Unicycle Robots With an Arbitrary Path Curvature , 2011, IEEE Transactions on Robotics.

[18]  S. Hiremath,et al.  Laser range finder model for autonomous navigation of a robot in a maize field using a particle filter , 2014 .

[19]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[20]  Matteo Munaro,et al.  OpenPTrack: Open source multi-camera calibration and people tracking for RGB-D camera networks , 2016, Robotics Auton. Syst..

[21]  Jinyong Jeong,et al.  Adaptive Inverse Perspective Mapping for lane map generation with SLAM , 2016, 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[22]  Edward Jones,et al.  Distance determination for an automobile environment using Inverse Perspective Mapping in OpenCV , 2010 .

[23]  Tong Boon Tang,et al.  Vehicle Detection Techniques for Collision Avoidance Systems: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[24]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.