Q-Art Code: Generating Scanning-robust Art-style QR Codes by Deformable Convolution

Quick Response (QR) code is a popular form of matrix barcodes that are widely used to tag online links on print media (e.g., posters, leaflets, and books). However, standard QR codes typically appear as noise-like black/white squares (named modules) which seriously disrupt the attractiveness of their carriers. In this paper, we propose StyleCode-Net, a method to generate novel art-style QR codes which can better match the entire style of their carriers to improve the visual quality. For endowing QR codes with artistic elements, a big challenge is that the scanning-robustness must be preserved after transforming colors and textures. To address these issues, we propose a module-based deformable convolutional mechanism (MDCM) and a dynamic target mechanism (DTM) in StyleCode-Net. MDCM can extract the features of black and white modules of QR codes respectively. Then, the extracted features are fed to DTM to balance the scanning-robustness and the style representation. Extensive subjective and objective experiments show that our art-style QR codes have reached the state-of-the-art level in both visual quality and scanning-robustness, and these codes have the potential to replace standard QR codes in real-world applications.

[1]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[2]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[3]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[4]  Jing Liao,et al.  Stylized Aesthetic QR Code , 2018, IEEE Transactions on Multimedia.

[5]  Hao Su,et al.  ArtCoder: An End-to-end Method for Generating Scanning-robust Stylized QR Codes , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Alexander Kmentt.  2017 , 2018, The Treaty Prohibiting Nuclear Weapons.

[7]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Nenghai Yu,et al.  Stereoscopic Neural Style Transfer , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Gang Hua,et al.  Visual attribute transfer through deep image analogy , 2017, ACM Trans. Graph..

[10]  Shuicheng Yan,et al.  Neural Style Transfer via Meta Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Ji Wan,et al.  Unpaired Photo-to-manga Translation Based on The Methodology of Manga Drawing , 2020, ArXiv.

[13]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Mark W. Schmidt,et al.  Fast Patch-based Style Transfer of Arbitrary Style , 2016, ArXiv.

[15]  Nenghai Yu,et al.  Coherent Online Video Style Transfer , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  GeorgeA. Silver.  Switzerland , 1989, The Lancet.

[17]  Bing Zhou,et al.  ART-UP: A Novel Method for Generating Scanning-robust Aesthetic QR codes , 2018, ArXiv.

[18]  Niloy J. Mitra,et al.  Halftone QR codes , 2013, ACM Trans. Graph..

[19]  Hao Wang,et al.  Real-Time Neural Style Transfer for Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Chuan Li,et al.  Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jing Liao,et al.  Arbitrary Style Transfer with Deep Feature Reshuffle , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Jianguo Xiao,et al.  A Common Framework for Interactive Texture Transfer , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Ming-Hsuan Yang,et al.  Universal Style Transfer via Feature Transforms , 2017, NIPS.

[24]  Nenghai Yu,et al.  StyleBank: An Explicit Representation for Neural Image Style Transfer , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Wenbin Cai,et al.  Separating Style and Content for Generalized Style Transfer , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Serge J. Belongie,et al.  Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Zunlei Feng,et al.  Stroke Controllable Fast Style Transfer with Adaptive Receptive Fields , 2018, ECCV.

[28]  Min-Chun Hu,et al.  Efficient QR Code Beautification With High Quality Visual Content , 2015, IEEE Transactions on Multimedia.