BandoAR: Real-Time Text Based Detection System Using Augmented Reality for Media Translator Banjar Language to Indonesian with Smartphone

Language is one of the fundamental factors that distinguish humans from animals. Language allows individuals to live together, help solve problems and position themselves as cultured beings. Language is a communication medium that aims to understand each particular ethnicity and nation. Language comprehension allows increased awareness and value of closeness between individuals in an area. However, a large number of languages seem to be the cause of difficulties and misunderstandings about the meaning of certain words. This research provides alternative solutions for solving these problems. This solution can provide convenience in the process of understanding the meaning of language words, especially Banjar Language, by recommending an application called “BandoAR”. BandoAR is a translator application from Banjar Language to Indonesian. This application can work as a real-time application without requiring input media such as text that must be typed using a good camera quality and has autofocus characteristics on the camera. This study emphasizes the process of detecting and tracer texts that exist in the Banjar community. This research is intended to see how Augmented Reality technology can be applied in the text without markers and has different font sizes, backgrounds, and distances. The results show that software for Android smartphones, as a media translator in real time, can be used in almost every type of smartphone. Based on internal trials and the results of 160 respondents, this application can attract users’ interest, can be applied in real life, and as an effort to preserve Banjar Language culture.

[1]  Ismail Haritaoglu.  Scene text extraction and translation for handheld devices , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Matthew Turk,et al.  TranslatAR: A mobile augmented reality translator , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[3]  Nam Ik Cho,et al.  Fast and simple text replacement algorithm for text-based augmented reality , 2016, 2016 Visual Communications and Image Processing (VCIP).

[4]  Ahmad Afif Supianto,et al.  Design and Implementation of Bekantan Educational Game (BEG) as a Banjar Language Learning Media , 2019, Int. J. Interact. Mob. Technol..

[5]  Karen D'Angelo Bromley.  Language Arts: Exploring Connections , 1988 .

[6]  Yasuhiko Watanabe,et al.  Translation camera on mobile phone , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[7]  Masaaki Nagata,et al.  Portable Translator Capable of Recognizing Characters on Signboard and Menu Captured by its Built-in Camera , 2005, ACL.

[8]  Chang Hong Lin,et al.  Mobile augmented reality as a Chinese menu translator , 2015, 2015 IEEE International Conference on Consumer Electronics - Taiwan.

[9]  Kohei Arai,et al.  VIRTUAL REALITY GAME CONTROLLED WITH USER'S HEAD AND BODY MOVEMENT DETECTION USING SMARTPHONE SENSORS , 2015 .

[10]  Ajai Kumar,et al.  Speech enabled integrated AR-based multimodal language translation , 2016, 2016 Conference on Advances in Signal Processing (CASP).

[11]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[12]  Ying Zhang,et al.  Towards Automatic Sign Translation , 2001, HLT.

[13]  マイケル サリバン.  Language, an analysis , 1968 .