Computer vision-based recognition of liquid surfaces and phase boundaries in transparent vessels, with emphasis on chemistry applications

The ability to recognize the liquid surface and the liquid level in transparent containers is perhaps the most commonly used evaluation method when dealing with fluids. Such recognition is essential in determining the liquid volume, fill level, phase boundaries and phase separation in various fluid systems. The recognition of liquid surfaces is particularly important in solution chemistry, where it is essential to many laboratory techniques (e.g., extraction, distillation, titration). A general method for the recognition of interfaces between liquid and air or between phase-separating liquids could have a wide range of applications and contribute to the understanding of the visual properties of such interfaces. This work examines a computer vision method for the recognition of liquid surfaces and liquid levels in various transparent containers. The method can be applied to recognition of both liquid-air and liquid-liquid surfaces. No prior knowledge of the number of phases is required. The method receives the image of the liquid container and the boundaries of the container in the image and scans all possible curves that could correspond to the outlines of liquid surfaces in the image. The method then compares each curve to the image to rate its correspondence with the outline of the real liquid surface by examining various image properties in the area surrounding each point of the curve. The image properties that were found to give the best indication of the liquid surface are the relative intensity change, the edge density change and the gradient direction relative to the curve normal.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  T. Hankemeier,et al.  Solvent exchange module for LC-NMR hyphenation using machine vision-controlled droplet evaporation. , 2013, Analytical chemistry.

[3]  Chintan K. Modi,et al.  Machine vision based liquid level inspection system using ISEF edge detection technique , 2010, ICWET.

[4]  P. J. Ogren,et al.  Web Camera Use in Developmental Biology, Molecular Biology & Biochemistry Laboratories , 2004 .

[5]  Gregory P. Crawford,et al.  Liquid-crystal materials find a new order in biomedical applications. , 2007, Nature materials.

[6]  Chen-Chien James Hsu,et al.  Liquid-level measurement using a single digital camera , 2009 .

[7]  Ingolf Braune,et al.  Vision-based level control for beverage-filling processes , 1994, Other Conferences.

[8]  Amar S Basu,et al.  Droplet morphometry and velocimetry (DMV): a video processing software for time-resolved, label-free tracking of droplet parameters. , 2013, Lab on a chip.

[9]  Hideho Okamoto,et al.  Design of a robotic workstation for automated organic synthesis , 2000 .

[10]  Md. Iqbal Hossain,et al.  Determination of Actual Object Size Distribution from Direct Imaging , 2009 .

[11]  John F. MacGregor,et al.  Multivariate image analysis in the process industries: A review , 2012 .

[12]  S. Bamberg,et al.  Increasing the accuracy of level-based volume detection of medical liquids in test tubes by including the optical effect of the meniscus , 2011 .

[13]  Anton Satria Prabuwono,et al.  Feature extraction algorithm for fill level and cap inspection in bottling machine , 2011, 2011 International Conference on Pattern Analysis and Intelligence Robotics.

[14]  Gerard C. M. Meijer,et al.  Liquid-level measurement system based on a remote grounded capacitive sensor , 2007 .

[15]  Richard J Ingham,et al.  Camera-enabled techniques for organic synthesis , 2013, Beilstein journal of organic chemistry.

[16]  Wang Li Liquid Surface Location of Milk Bottle Based on Digital Image Processing , 2012 .

[17]  Hajime Tanaka,et al.  A novel particle tracking method with individual particle size measurement and its application to ordering in glassy hard sphere colloids , 2013, 1301.7237.

[18]  Kai Sundmacher,et al.  Image-Based in Situ Identification of Face Specific Crystal Growth Rates from Crystal Populations , 2014 .

[19]  Alexei Kazarine,et al.  Automated liquid-liquid extraction by pneumatic recirculation on a centrifugal microfluidic platform. , 2012, Analytical chemistry.

[20]  Chintan K. Modi,et al.  Comparison of Optimal Edge Detection Algorithms for Liquid Level Inspection in Bottles , 2009, 2009 Second International Conference on Emerging Trends in Engineering & Technology.

[21]  Bryant D. Taylor,et al.  A Wireless Fluid-Level Measurement Technique , 2007 .

[22]  Kevin J. Roberts,et al.  Particle Shape Characterisation via Image Analysis: from Laboratory Studies to In-process Measurements Using an in Situ Particle Viewer System , 2008 .

[23]  Chris Aldrich,et al.  Rule-based characterization of industrial flotation processes with inductive techniques and genetic algorithms , 1996 .

[24]  I. Papautsky,et al.  Optimization of a paper-based ELISA for a human performance biomarker. , 2013, Analytical chemistry.

[25]  C. Huck,et al.  Fourier transform infrared imaging analysis in discrimination studies of squamous cell carcinoma. , 2012, The Analyst.

[26]  Syed Azer Reza,et al.  Agile lensing-based non-contact liquid level optical sensor for extreme environments , 2010 .

[27]  Marco Forgione,et al.  Rapid Crystallization Process Development Strategy from Lab to Industrial Scale with PAT Tools in Skid Configuration , 2012 .

[28]  Dominik Engel,et al.  Efficient automated liquid detection in microplates , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[29]  Huasheng Zhu,et al.  New Algorithm of Liquid Level of Infusion Bottle Based on Image Processing , 2009, 2009 International Conference on Information Engineering and Computer Science.

[30]  Rajeev Sharma,et al.  Noncontact level sensing technique using computer vision , 2002, IEEE Trans. Instrum. Meas..

[31]  Massimiliano Barolo,et al.  Maintenance of Machine Vision Systems for Product Quality Assessment. Part I. Addressing Changes in Lighting Conditions , 2013 .

[32]  Chi‐Huey Wong,et al.  Toward Automated Synthesis of Oligosaccharides and Glycoproteins , 2001, Science.

[33]  H K Singh,et al.  A New Non-Intrusive Optical Technique to Measure Transparent Liquid Level and Volume , 2011, IEEE Sensors Journal.

[34]  Wei Wang,et al.  Texture-Based Foam Segmentation and Analysis , 2011 .

[35]  Steven V. Ley,et al.  Application of ReactArray Robotics and Design of Experiments Techniques in Optimisation of Supported Reagent Chemistry , 2002 .

[36]  Maria Margarita Gonzalez Ramirez,et al.  Liquid level control of Coca-Cola bottles using an automated system , 2014, 2014 International Conference on Electronics, Communications and Computers (CONIELECOMP).

[37]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[38]  T. Bezboruah,et al.  Truly Nonintrusive Liquid-Level-Sensing Method Based on Lateral Displacement Effect of Light Rays , 2013, IEEE Sensors Journal.

[39]  ブライアン・ヒングリー,et al.  Liquid level sensor , 2012 .

[40]  L. L. Simon,et al.  Histogram Matching, Hypothesis Testing, and Statistical Control-Chart-Assisted Nucleation Detection Using Bulk Video Imaging for Optimal Switching between Nucleation and Seed Conditioning Steps , 2010 .

[41]  Byungjoo Lee,et al.  Microscopic augmented-reality indicators for long-term live cell time-lapsed imaging. , 2013, The Analyst.

[42]  J. Pate Introduction to Optics , 1937, Nature.

[43]  Nicolai Petkov,et al.  Edge and line oriented contour detection: State of the art , 2011, Image Vis. Comput..

[44]  Rachel V. Bennett,et al.  Robotic plasma probe ionization mass spectrometry (RoPPI-MS) of non-planar surfaces. , 2014, The Analyst.

[45]  J. Canny A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  K. Osada,et al.  Contactless Liquid-Level Measurement With Frequency-Modulated Millimeter Wave Through Opaque Container , 2013, IEEE Sensors Journal.

[47]  Steven V Ley,et al.  A prototype continuous-flow liquid-liquid extraction system using open-source technology. , 2012, Organic & biomolecular chemistry.

[48]  Peter Murray-Rust,et al.  Ami - The chemist's amanuensis , 2011, J. Cheminformatics.

[49]  David A Selck,et al.  Increased robustness of single-molecule counting with microfluidics, digital isothermal amplification, and a mobile phone versus real-time kinetic measurements. , 2013, Analytical chemistry.

[50]  Steven V. Ley,et al.  Camera-enabled Techniques for Organic Synthesis , 2013 .

[51]  Steven V Ley,et al.  Continuous multiple liquid-liquid separation: diazotization of amino acids in flow. , 2012, Organic letters.

[52]  U. Köthe,et al.  Active learning for convenient annotation and classification of secondary ion mass spectrometry images. , 2013, Analytical chemistry.

[53]  Henry S. Rzepa,et al.  Chemical Machine Vision: Automated Extraction of Chemical Metadata from Raster Images , 2003, J. Chem. Inf. Comput. Sci..

[54]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[55]  K. Thurow,et al.  Camera grids for laboratory automation , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[57]  A. Scheeline,et al.  Mixing in colliding, ultrasonically levitated drops. , 2014, Analytical chemistry.

[58]  Ana Maria Mendonça,et al.  Automatic segmentation of chromatographic images for region of interest delineation , 2011, Medical Imaging.

[59]  A New Liquid Level Measuring System of Standard Metal Tank Based on Sub-pixel Edge Detection , 2007, 2007 IEEE International Conference on Control and Automation.

[60]  Desheng Li,et al.  Measurement of liquid interface based on vision , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[61]  H H Bülthoff,et al.  An Introduction to Object Recognition , 1998, Zeitschrift fur Naturforschung. C, Journal of biosciences.

[62]  V. Karathanassi,et al.  Application of machine vision techniques in the quality control of pharmaceutical solutions , 1996 .

[63]  K. Hambrice,et al.  A Dozen Ways to Measure Fluid Level and How They Work , 2004 .