Multiple Instance Learning for bags with Ordered instances

Multiple Instance Learning (MIL) algorithms are designed for problems where labels are available for groups of instances, commonly referred to as bags. In this paper, we consider a new MIL problem setting where instances in a bag are not exchangeable, and a bijection exists between every pair of bags. We propose a neural network based MIL algorithm (MILOrd) that leverages the existence of such a bijection when learning to discriminate bags. MILOrd has an input node for each instance in the bag, an output node that captures the bag level prediction, and a hidden layer that captures the output from an instance level classifier for each instance in the bag. The bag level prediction is obtained by combining these hidden layer values using a function that models the importance of each instance, unlike the traditional schemes where each instance is considered equal. We demonstrate the utility of the proposed algorithm on the problem of burned area mapping using yearly bags composed of multispectral reflectance data for different time steps in the year. Our experiments show that MILOrd outperforms traditional MIL schemes that don’t account for the presence of a bijection.

[1]  Misha Denil,et al.  From Group to Individual Labels Using Deep Features , 2015, KDD.

[2]  John Fox,et al.  The Knowledge Engineering Review , 1984, The Knowledge Engineering Review.

[3]  Zhi-Hua Zhou,et al.  Multi-instance learning by treating instances as non-I.I.D. samples , 2008, ICML '09.

[4]  Marco Loog,et al.  On classification with bags, groups and sets , 2014, Pattern Recognit. Lett..

[5]  Alexander J. Smola,et al.  Estimating labels from label proportions , 2008, ICML '08.

[6]  Ivor W. Tsang,et al.  Improving Web Image Search by Bag-Based Reranking , 2011, IEEE Transactions on Image Processing.

[7]  Bernhard Pfahringer,et al.  A Two-Level Learning Method for Generalized Multi-instance Problems , 2003, ECML.

[8]  Eduardo Paz Ferreira,et al.  Portugal , 2014 .

[9]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[10]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[11]  Dock Bumpers,et al.  Volume 2 , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..

[12]  Qi Zhang,et al.  EM-DD: An Improved Multiple-Instance Learning Technique , 2001, NIPS.

[13]  Yixin Chen,et al.  MILES: Multiple-Instance Learning via Embedded Instance Selection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Tarek Sayed,et al.  Multiple Instance Learning by Discriminative Training of Markov Networks , 2013, UAI.

[15]  R. Colwell Remote sensing of the environment , 1980, Nature.

[16]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[17]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[18]  Mark Craven,et al.  Supervised versus multiple instance learning: an empirical comparison , 2005, ICML.

[19]  Jun Wang,et al.  Solving the Multiple-Instance Problem: A Lazy Learning Approach , 2000, ICML.

[20]  Bernt Schiele,et al.  Weakly Supervised Recognition of Daily Life Activities with Wearable Sensors , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.