IoT+Small Data: Transforming in-store shopping analytics & services

We espouse a vision of small data-based immersive retail analytics, where a combination of sensor data, from personal wearable-devices and store-deployed sensors & IoT devices, is used to create real-time, individualized services for in-store shoppers. Key challenges include (a) appropriate joint mining of sensor & wearable data to capture a shopper's product-level interactions, and (b) judicious triggering of power-hungry wearable sensors (e.g., camera) to capture only relevant portions of a shopper's in-store activities. To explore the feasibility of our vision, we conducted experiments with 5 smartwatch-wearing users who interacted with objects placed on cupboard racks in our lab (to crudely mimic corresponding grocery store interactions). Initial results show significant promise: 94% accuracy in identifying an item-picking gesture, 85% accuracy in identifying the shelf-location from where the item was picked and 61% accuracy in identifying the exact item picked (via analysis of the smartwatch camera data).

[1]  Parth H. Pathak,et al.  Analyzing Shopper's Behavior through WiFi Signals , 2015, WPA@MobiSys.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Vigneshwaran Subbaraju,et al.  Energy-Efficient Continuous Activity Recognition on Mobile Phones: An Activity-Adaptive Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[4]  Paramvir Bahl,et al.  Glimpse: Continuous, Real-Time Object Recognition on Mobile Devices , 2015, SenSys.

[5]  Vigneshwaran Subbaraju,et al.  Using infrastructure-provided context filters for efficient fine-grained activity sensing , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[6]  Sang Jeong Lee,et al.  Understanding customer malling behavior in an urban shopping mall using smartphones , 2013, UbiComp.

[7]  Vigneshwaran Subbaraju,et al.  Accommodating user diversity for in-store shopping behavior recognition , 2014, SEMWEB.

[8]  Lei Yang,et al.  ShopMiner: Mining Customer Shopping Behavior in Physical Clothing Stores with COTS RFID Devices , 2015, SenSys.

[9]  Swati Rallapalli,et al.  Enabling physical analytics in retail stores using smart glasses , 2014, MobiCom.

[10]  Andreas Möller,et al.  MobiMed: comparing object identification techniques on smartphones , 2012, NordiCHI.

[11]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[12]  Keiji Yanai,et al.  FoodCam: A real-time food recognition system on a smartphone , 2015, Multimedia Tools and Applications.