Cluster computing for digital microscopy

Microscopy is becoming increasingly digital and dependent on computation. Some of the computational tasks in microscopy are computationally intense, such as image restoration (deconvolution), some optical calculations, image segmentation, and image analysis. Several modern microscope technologies enable the acquisition of very large data sets. 3D imaging of live cells over time, multispectral imaging, very large tiled 3D images of thick samples, or images from high throughput biology all can produce extremely large images. These large data sets place a very large burden on laboratory computer resources. This combination of computationally intensive tasks and larger data sizes can easily exceed the capability of single personal computers. The large multiprocessor computers that are the traditional technology for larger tasks are too expensive for most laboratories. An alternative approach is to use a number of inexpensive personal computers as a cluster; that is, use multiple networked computers programmed to run the problem in parallel on all the computers in the cluster. By the use of relatively inexpensive over‐the‐counter hardware and open source software, this approach can be much more cost effective for many tasks. We discuss the different computer architectures available, and their advantages and disadvantages. Microsc. Res. Tech. 64:204–213, 2004. © 2004 Wiley‐Liss, Inc.

[1]  James M. Coggins,et al.  Interfacing image processing and computer graphics systems using an artificial visual system , 1986 .

[2]  Jack Dongarra,et al.  MPI: The Complete Reference , 1996 .

[3]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[4]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[5]  Peter S. Pacheco.  Parallel programming with MPI , 1996 .

[6]  F S Fay,et al.  Superresolution three-dimensional images of fluorescence in cells with minimal light exposure. , 1995, Science.

[7]  D. Agard,et al.  Fluorescence microscopy in three dimensions. , 1989, Methods in cell biology.

[8]  Steven G. Johnson,et al.  FFTW: an adaptive software architecture for the FFT , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[9]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dario L. Ringach,et al.  Look at the big picture (details will follow) , 2003, Nature Neuroscience.

[11]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  Odysseas I. Pentakalos.  An Introduction to the InfiniBand Architecture , 2002, Int. CMG Conference.

[13]  L. Loew,et al.  Quantitative cell biology with the Virtual Cell. , 2003, Trends in cell biology.

[14]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[15]  Anthony Skjellum,et al.  Using MPI - portable parallel programming with the message-parsing interface , 1994 .