Deep-learning-based quality filtering of mechanically exfoliated 2D crystals

Two-dimensional (2D) crystals are attracting growing interest in various research fields such as engineering, physics, chemistry, pharmacy, and biology owing to their low dimensionality and dramatic change of properties compared to the bulk counter parts. Among the various techniques used to manufacture 2D crystals, mechanical exfoliation has been essential to practical applications and fundamental research. However, mechanically exfoliated crystals on substrates contain relatively thick flakes that must be found and removed manually, limiting high-throughput manufacturing of atomic 2D crystals and van der Waals heterostructures. Here, we present a deep-learning-based method to segment and identify the thickness of atomic layer flakes from optical microscopy images. Through carefully designing a neural network based on U-Net, we found that our neural network based on U-net trained only with the data based on realistically small number of images successfully distinguish monolayer and bilayer MoS2 and graphene with a success rate of 70–80%, which is a practical value in the first screening process for choosing monolayer and bilayer flakes of all flakes on substrates without human eye. The remarkable results highlight the possibility that a large fraction of manual laboratory work can be replaced by AI-based systems, boosting productivity.

[1]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[2]  Hua Zhang,et al.  The chemistry of two-dimensional layered transition metal dichalcogenide nanosheets. , 2013, Nature chemistry.

[3]  A. Gaharwar,et al.  Two‐Dimensional Nanomaterials for Biomedical Applications: Emerging Trends and Future Prospects , 2015, Advanced materials.

[4]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[5]  Andre K. Geim,et al.  Two-dimensional atomic crystals. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Madan Dubey,et al.  Two-dimensional material nanophotonics , 2014, 1410.3882.

[7]  Giuseppe Iannaccone,et al.  Electronics based on two-dimensional materials. , 2014, Nature nanotechnology.

[8]  Michaël Gharbi,et al.  Convolutional neural network for earthquake detection and location , 2017, Science Advances.

[9]  Yi Cui,et al.  Physical and chemical tuning of two-dimensional transition metal dichalcogenides. , 2015, Chemical Society reviews.

[10]  Stefanie Jegelka,et al.  Virtual screening of inorganic materials synthesis parameters with deep learning , 2017, npj Computational Materials.

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  L. Lauhon,et al.  Emerging device applications for semiconducting two-dimensional transition metal dichalcogenides. , 2014, ACS nano.

[13]  Qing Hua Wang,et al.  Electronics and optoelectronics of two-dimensional transition metal dichalcogenides. , 2012, Nature nanotechnology.

[14]  Ohad Shamir,et al.  Optimal Distributed Online Prediction Using Mini-Batches , 2010, J. Mach. Learn. Res..

[15]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[16]  Michael A. McGuire,et al.  Layer-dependent ferromagnetism in a van der Waals crystal down to the monolayer limit , 2017, Nature.

[17]  Hua Zhang,et al.  Rapid and reliable thickness identification of two-dimensional nanosheets using optical microscopy. , 2013, ACS nano.

[18]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Hugen Yan,et al.  Anomalous lattice vibrations of single- and few-layer MoS2. , 2010, ACS nano.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Takashi Taniguchi,et al.  Autonomous robotic searching and assembly of two-dimensional crystals to build van der Waals superlattices , 2018, Nature Communications.

[22]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[23]  Tsutomu Nojima,et al.  Highly crystalline 2D superconductors , 2017 .

[24]  Michael V. McConnell,et al.  Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning , 2017, Nature Biomedical Engineering.

[25]  Kevin M. Ryan,et al.  Crystal Structure Prediction via Deep Learning. , 2018, Journal of the American Chemical Society.

[26]  K. Novoselov,et al.  2D materials and van der Waals heterostructures , 2016, Science.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Alexander J. Smola,et al.  Efficient mini-batch training for stochastic optimization , 2014, KDD.

[29]  Xiang Zhang,et al.  Discovery of intrinsic ferromagnetism in two-dimensional van der Waals crystals , 2017, Nature.

[30]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[31]  Yihong Wu,et al.  Graphene thickness determination using reflection and contrast spectroscopy. , 2007, Nano letters.

[32]  J. Shan,et al.  Photonics and optoelectronics of 2D semiconductor transition metal dichalcogenides , 2016, Nature Photonics.

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Gang Lu,et al.  Optical identification of single- and few-layer MoS₂ sheets. , 2012, Small.

[36]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[37]  Jun Wang,et al.  Optical identification of layered MoS2 via the characteristic matrix method. , 2016, Nanoscale.

[38]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  P. Baldi,et al.  Searching for exotic particles in high-energy physics with deep learning , 2014, Nature Communications.

[40]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.