How much are we exposed to alcohol in electronic media? Development of the Alcoholic Beverage Identification Deep Learning Algorithm (ABIDLA).

BACKGROUND Evidence demonstrates that seeing alcoholic beverages in electronic media increases alcohol initiation and frequent and excessive drinking, particularly among young people. To efficiently assess this exposure, the aim was to develop the Alcoholic Beverage Identification Deep Learning Algorithm (ABIDLA) to automatically identify beer, wine and champagne/sparkling wine from images. METHODS Using a specifically developed software, three coders annotated 57,186 images downloaded from Google. Supplemented by 10,000 images from ImageNet, images were split randomly into training data (70 %), validation data (10 %) and testing data (20 %). For retest reliability, a fourth coder re-annotated a random subset of 2004 images. Algorithms were trained using two state-of-the-art convolutional neural networks, Resnet (with different depths) and Densenet-121. RESULTS With a correct classification (accuracy) of 73.75 % when using six beverage categories (beer glass, beer bottle, beer can, wine, champagne, and other images), 84.09 % with three (beer, wine/champagne, others) and 85.22 % with two (beer/wine/champagne, others), Densenet-121 slightly outperformed all Resnet models. The highest accuracy was obtained for wine (78.91 %) followed by beer can (77.43 %) and beer cup (73.56 %). Interrater reliability was almost perfect between the coders and the expert (Kappa = .903) and substantial between Densenet-121 and the coders (Kappa = .681). CONCLUSIONS Free from any response or coding burden and with a relatively high accuracy, the ABIDLA offers the possibility to screen all kinds of electronic media for images of alcohol. Providing more comprehensive evidence on exposure to alcoholic beverages is important because exposure instigates alcohol initiation and frequent and excessive drinking.

[1]  Tome Eftimov,et al.  Mixed deep learning and natural language processing method for fake-food image recognition and standardization to help automated dietary assessment , 2018, Public Health Nutrition.

[2]  Rick B. van Baaren,et al.  Alcohol portrayal on television affects actual drinking behaviour. , 2009, Alcohol and alcoholism.

[3]  G. Meerkerk,et al.  Alcohol Marketing and Underage Drinking: Which Subgroups Are Most Susceptible to Alcohol Advertisements? , 2019, Substance use & misuse.

[4]  T. Lobstein,et al.  The commercial use of digital media to market alcohol products: a narrative review , 2017, Addiction.

[5]  Kathryn Angus,et al.  Impact of alcohol advertising and media exposure on adolescent alcohol use: a systematic review of longitudinal studies. , 2009, Alcohol and alcoholism.

[6]  C. Meurk,et al.  Emerging social media ‘platform’ approaches to alcohol marketing: a comparative analysis of the activity of the top 20 Australian alcohol brands on Facebook (2012-2014) , 2018 .

[7]  J. Grube,et al.  The Myriad Influences of Alcohol Advertising on Adolescent Drinking , 2017, Current Addiction Reports.

[8]  C. Ni Mhurchu,et al.  Quantifying the Nature and Extent of Children’s Real-time Exposure to Alcohol Marketing in Their Everyday Lives Using Wearable Cameras: Children’s Exposure via a Range of Media in a Range of Key Places , 2018, Alcohol and alcoholism.

[9]  R. Laranjeira,et al.  Exposure of adolescents and young adults to alcohol advertising in Brazil , 2010 .

[10]  M. Morgenstern,et al.  Favourite alcohol advertisements and binge drinking among adolescents: a cross-cultural cohort study. , 2014, Addiction.

[11]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[13]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[14]  Bastian Leibe,et al.  Visual Object Recognition , 2011, Visual Object Recognition.

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  J. Leonardi-Bee,et al.  Adolescents’ exposure to tobacco and alcohol content in YouTube music videos , 2015, Addiction.

[17]  L. Bègue,et al.  How alcohol advertising and sponsorship works: Effects through indirect measures , 2019, Drug and alcohol review.

[18]  James D Sargent,et al.  Exposure to alcohol advertising and teen drinking. , 2011, Preventive medicine.

[19]  R. Engels,et al.  Alcohol portrayals in movies, music videos and soap operas and alcohol use of young people: current status and future challenges. , 2012, Alcohol and alcoholism.

[20]  L. Bègue,et al.  Dynamic Exposure to Alcohol Advertising in a Sports Context Influences Implicit Attitudes. , 2016, Alcoholism, clinical and experimental research.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  R. Wiers,et al.  Effects of a low dose of alcohol on cognitive biases and craving in heavy drinkers , 2007, Psychopharmacology.

[23]  Kamaljit I. Lakhtaria,et al.  Deep Learning: Architectures and Applications , 2019 .

[24]  Changjun Jiang,et al.  Semantic enhanced deep learning for image classification , 2018, Concurr. Comput. Pract. Exp..

[25]  K. Jackson,et al.  Internet Alcohol Marketing and Underage Alcohol Use , 2016, Pediatrics.

[26]  M. Moreno,et al.  Social Media and Alcohol: Summary of Research, Intervention Ideas and Future Study Directions , 2016 .

[27]  S. Casswell,et al.  Intoxigenic digital spaces? Youth, social networking sites and alcohol marketing. , 2010, Drug and alcohol review.

[28]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  T. Lobstein,et al.  Alcohol marketing and youth alcohol consumption: a systematic review of longitudinal studies published since 2008 , 2017, Addiction.

[31]  Emmanuel Kuntsche,et al.  Do we act upon what we see? Direct effects of alcohol cues in movies on young adults' alcohol drinking. , 2011, Alcohol and alcoholism.

[32]  Rebecca L. Monk,et al.  Mobile technologies and spatially structured real-time marketing , 2017 .

[33]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[34]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[35]  R. Murray,et al.  Quantifying tobacco and alcohol imagery in Netflix and Amazon Prime instant video original programming accessed from the UK: a content analysis , 2019, BMJ Open.

[36]  R. Wiers,et al.  Handbook of implicit cognition and addiction , 2006 .

[37]  M. Stoolmiller,et al.  Movie exposure to smoking cues and adolescent smoking onset: a test for mediation through peer affiliations. , 2007, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[38]  S. Jones Commentary on Morgenstern et al. (2014): As channels for alcohol marketing continue to increase, so will alcohol marketing receptivity and youth drinking. , 2014, Addiction.

[39]  T. Chikritzhs,et al.  Adolescents’ exposure to paid alcohol advertising on television and their alcohol use: exploring associations during a 13‐year period , 2017, Addiction.

[40]  J. Britton,et al.  Alcohol imagery and branding, and age classification of films popular in the UK. , 2011, International journal of epidemiology.

[41]  Jason B. Colditz,et al.  Portrayal of Alcohol Brands Popular Among Underage Youth on YouTube: A Content Analysis. , 2017, Journal of studies on alcohol and drugs.

[42]  D. Foxcroft,et al.  The effect of alcohol advertising, marketing and portrayal on drinking behaviour in young people: systematic review of prospective cohort studies , 2009, BMC public health.

[43]  James Nicholls,et al.  Everyday, everywhere: alcohol marketing and social media--current trends. , 2012, Alcohol and alcoholism.