Cluster based block processing for gigantic images: Dimension and size

Processing gigantic images with normal image processing techniques can be time consuming and difficult. Here gigantic mean with respect to dimension (Giga Pixels) or memory size (Giga Bytes). These images can be sometimes too large to load into the memory or they can be loaded, but then takes more time for processing. To overcome this problem, we proposed a method, Cluster Based Block Processing, to process large images by splitting the image according to their dimension or size and process it on different machine in the Hadoop cluster using Map-Reduce for effective processing. Representative results of comprehensive experiments on gigantic images are selected to validate the capacity of our proposed method over the traditional methods. Our results show that the proposed method is 20× faster than existing traditional methods.

[1]  Kilian Q. Weinberger,et al.  Reliable tags using image similarity: mining specificity and expertise from large-scale multimedia databases , 2009, WSMC '09.

[2]  Bin Wu,et al.  Map/Reduce in CBIR application , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[3]  Jason Lawrence,et al.  HIPI : A Hadoop Image Processing Interface for Image-based MapReduce Tasks , 2011 .

[4]  Javier Montero,et al.  A hierarchical segmentation for image processing , 2010, IEEE Congress on Evolutionary Computation.

[5]  Navarun Gupta,et al.  Seven V's of Big Data understanding Big Data to extract value , 2014, Proceedings of the 2014 Zone 1 Conference of the American Society for Engineering Education.

[6]  Xiaochun Cao,et al.  A Hierarchical Distributed Processing Framework for Big Image Data , 2016, IEEE Transactions on Big Data.

[7]  Hongzhao Chen,et al.  The on-line viewing system of the distributed gigapixel image , 2016, 2016 Sixth International Conference on Information Science and Technology (ICIST).

[8]  Priyanka Jain,et al.  Content Based Image Retrieval on Hadoop Framework , 2015, 2015 IEEE International Congress on Big Data.