ApproxCT: Approximate Clustering Techniques for Energy Efficient Computer Vision in Cyber-Physical Systems

The emerging trends in miniaturization of Internet of Things (IoT) have highly empowered the Cyber-Physical Systems (CPS) for many social applications especially, medical imaging in healthcare. The medical imaging usually involves big data processing and it is expedient to realize its clustering after data acquisition. However, the state-of-the-art clustering techniques are compute intensive and tend to reduce the processing capability of battery-driven or energy harvested IoT based embedded devices (e.g., edge and fogs). Thus, there is a desire to perform energy efficient implementation of the machine learning based clustering techniques. Since, the clustering techniques are inherently resilient to noise and thus, their resilience can be exploited for energy efficiency using approximate computing. In this paper, we proposed approximate versions of the widely used K-Means and Mean Shift clustering techniques using the state-of-the-art low power approximate adders (IMPACT). The trade-off between power consumption and the output quality is exploited using five well-known pattern recognition datasets. The experiments reveal that K-Means algorithm exhibits more error resilience towards approximation with a maximum of 10% - 25% power savings.

[1]  Khin Mi Mi Aung,et al.  Building a large-scale object-based active storage platform for data analytics in the internet of things , 2016, The Journal of Supercomputing.

[2]  Muhammad Shafique,et al.  Statistical error analysis for low power approximate adders , 2017, 2017 54th ACM/EDAC/IEEE Design Automation Conference (DAC).

[3]  Rakesh Kumar,et al.  On reconfiguration-oriented approximate adder design and its application , 2013, 2013 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[4]  Debasis Chaudhuri,et al.  Seed Point Selection Algorithm in Clustering of Image Data , 2018 .

[5]  Farzad Samie,et al.  IoT technologies for embedded computing: A survey , 2016, 2016 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[6]  Faiq Khalid,et al.  ApproxCS: Near-Sensor Approximate Compressed Sensing for IoT-Healthcare Systems , 2018 .

[7]  Debasis Chaudhuri,et al.  A Novel Objective Function Based Clustering with Optimal Number of Clusters , 2018 .

[8]  Muhammad Shafique,et al.  Intelligent Security Measures for Smart Cyber Physical Systems , 2018, 2018 21st Euromicro Conference on Digital System Design (DSD).

[9]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Shoab A. Khan,et al.  Multiprocessor architecture for real-time applications using mean shift clustering , 2017, Journal of Real-Time Image Processing.

[11]  O. R. Vincent,et al.  A self-adaptive k-means classifier for business incentive in a fashion design environment , 2018 .

[12]  Andreas Krause,et al.  Approximate K-Means++ in Sublinear Time , 2016, AAAI.

[13]  Kaushik Roy,et al.  Managing the Quality vs. Efficiency Trade-off Using Dynamic Effort Scaling , 2013, TECS.

[14]  Muhammad Shafique,et al.  Invited: Cross-layer approximate computing: From logic to architectures , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[15]  Wei Zheng,et al.  Self-paced Learning for K-means Clustering Algorithm , 2020, Pattern Recognit. Lett..

[16]  Yanhui Guo,et al.  An effective color image segmentation approach using neutrosophic adaptive mean shift clustering , 2018 .

[17]  C. Schmid,et al.  Hamming Embedding and Weak Geometry Consistency for Large Scale Image Search - extended version , 2008 .

[18]  Kaushik Roy,et al.  Analysis and characterization of inherent application resilience for approximate computing , 2013, 2013 50th ACM/EDAC/IEEE Design Automation Conference (DAC).

[19]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Stephen Gould,et al.  Decomposing a scene into geometric and semantically consistent regions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  Thing Li Contributions to Mean Shift filtering and segmentation : Application to MRI ischemic data , 2012 .

[22]  Sherif Sakr,et al.  Big Data Systems Meet Machine Learning Challenges: Towards Big Data Science as a Service , 2017, Big Data Res..

[23]  Kaushik Roy,et al.  IMPACT: IMPrecise adders for low-power approximate computing , 2011, IEEE/ACM International Symposium on Low Power Electronics and Design.

[24]  Alan D. George,et al.  A real-time, power-efficient architecture for mean-shift image segmentation , 2018, Journal of Real-Time Image Processing.

[25]  Ozcan Ozturk,et al.  A Novel Heterogeneous Approximate Multiplier for Low Power and High Performance , 2018, IEEE Embedded Systems Letters.

[26]  D Napoleon,et al.  A New Method for Dimensionality Reduction using K- Means Clustering Algorithm for High Dimensional Data Set , 2011 .

[27]  Qiang Xu,et al.  ApproxIt: An approximate computing framework for iterative methods , 2014, 2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).