Design of visual communication based on deep learning approaches

Aiming at the problem of object recognition caused by small object scale, multi-interaction (occlusion), and strong hiding characteristics in the scene analysis task, an object-region-enhanced network based on deep learning was proposed. The network integrated two core modules designed for the task: object area enhancement strategy and black-hole-filling strategy. The former directly corresponded the object region with high semantic confidence to the local region of the specific category channel of the convolutional feature image. Weighted features were used to improve contextual relationships, and difficult object regions were identified. The latter avoided the mistake of identifying some difficult areas as additional background classes by masking additional background classes. The results showed that the modular design scheme improved the overall parsing performance of the model by replacing the modules, and the two strategies were applied to other existing scenario parsing networks. A unified framework is proposed for handling scene resolution tasks. Benefiting from the modular design approach, the proposed algorithm improves overall performance by replacing convolution or detection modules. Object enhancement and black hole filling are applied to other systems to improve the system’s ability to parse objects. Object area enhancement methods are used to recall objects that are not recognized in a standard split network. Black hole fill techniques can be used to resolve pixels that are incorrectly categorized into additional background classes that do not exist. Therefore, a variety of contextual semantic fusion strategies have certain reference value in the theoretical level of computer vision. More critically, this method has certain reference significance for the design and development of robust and practical application systems.

[1]  Yi-Ping Hung,et al.  Vision-Based Positioning for Internet-of-Vehicles , 2017, IEEE Transactions on Intelligent Transportation Systems.

[2]  Christian Baden,et al.  Putting the Image Back Into the Frame: Modeling the Linkage Between Visual Communication and Frame-Processing Theory , 2015 .

[3]  Alan M. MacEachren,et al.  How to Assess Visual Communication of Uncertainty? A Systematic Review of Geospatial Uncertainty Visualisation User Studies , 2014 .

[4]  Nei Kato,et al.  Routing or Computing? The Paradigm Shift Towards Intelligent Computer Network Packet Transmission Based on Deep Learning , 2017, IEEE Transactions on Computers.

[5]  Xiaochun Cao,et al.  Visual Object Tracking With Partition Loss Schemes , 2017, IEEE Transactions on Intelligent Transportation Systems.

[6]  Hansi Senaratne,et al.  Urban Mobility Analysis With Mobile Network Data: A Visual Analytics Approach , 2018, IEEE Transactions on Intelligent Transportation Systems.

[7]  Majid Mirmehdi,et al.  Visual Monitoring of Driver and Passenger Control Panel Interactions , 2017, IEEE Transactions on Intelligent Transportation Systems.

[8]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[9]  Kim Nichols,et al.  Comparing Two Inquiry Professional Development Interventions in Science on Primary Students’ Questioning and Other Inquiry Behaviours , 2017 .

[10]  Ross Maciejewski,et al.  Visual Analytics of Mobility and Transportation: State of the Art and Further Research Directions , 2017, IEEE Transactions on Intelligent Transportation Systems.

[11]  Sung Wook Baik,et al.  Embedded deep vision in smart cameras for multi-view objects representation and retrieval , 2017, Comput. Electr. Eng..

[12]  Meghan Kelly,et al.  Visual communication design as a form of public pedagogy , 2015 .

[13]  Sung Wook Baik,et al.  Early fire detection using convolutional neural networks during surveillance for effective disaster management , 2017, Neurocomputing.

[14]  Christoph F. Mecklenbräuker,et al.  Increased Traffic Flow Through Node-Based Bottleneck Prediction and V2X Communication , 2017, IEEE Transactions on Intelligent Transportation Systems.

[15]  Colin J. Akerman,et al.  Random synaptic feedback weights support error backpropagation for deep learning , 2016, Nature Communications.

[16]  Rama Vasudevan,et al.  Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations. , 2017, ACS nano.

[17]  Nei Kato,et al.  State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems , 2017, IEEE Communications Surveys & Tutorials.

[18]  Hyunju Lee,et al.  Cognitive Activity-Based Design Methodology for Novice Visual Communication Designers , 2016 .

[19]  D. Machin,et al.  A discourse–design approach to multimodality: the visual communication of neoliberal management discourse , 2016 .

[20]  Xiaofei He,et al.  Real-Time Object Tracking on a Drone With Multi-Inertial Sensing Data , 2018, IEEE Transactions on Intelligent Transportation Systems.

[21]  Xiaobo Qu,et al.  On the Impact of Cooperative Autonomous Vehicles in Improving Freeway Merging: A Modified Intelligent Driver Model-Based Approach , 2017, IEEE Transactions on Intelligent Transportation Systems.

[22]  Tetsuya Ogata,et al.  Audio-visual speech recognition using deep learning , 2014, Applied Intelligence.

[23]  Nina Linder,et al.  Point-of-care mobile digital microscopy and deep learning for the detection of soil-transmitted helminths and Schistosoma haematobium , 2017, Global health action.

[24]  Kaspar Delhey,et al.  Conservation implications of anthropogenic impacts on visual communication and camouflage , 2016, Conservation biology : the journal of the Society for Conservation Biology.

[25]  J. E. Lloyd,et al.  Flash signal evolution in Photinus fireflies: Character displacement and signal exploitation in a visual communication system , 2015, Evolution; international journal of organic evolution.

[26]  Santiago,et al.  A CATALOG OF VISUAL-LIKE MORPHOLOGIES IN THE 5 CANDELS FIELDS USING DEEP LEARNING , 2015, 1509.05429.

[27]  Maria Riveiro,et al.  Anomaly Detection for Road Traffic: A Visual Analytics Framework , 2017, IEEE Transactions on Intelligent Transportation Systems.

[28]  Alandeom W. Oliveira,et al.  Student Visual Communication of Evolution , 2017 .

[29]  Peter Corcoran,et al.  Deep Learning for Consumer Devices and Services: Pushing the limits for machine learning, artificial intelligence, and computer vision. , 2017, IEEE Consumer Electronics Magazine.