A rapid and cost-effective pipeline for digitization of museum specimens with 3D photogrammetry

Natural history collections are yielding more information as digitization brings specimen data to researchers, connects specimens across museums, and as new technologies allow for more large-scale data collection. Therefore, a key goal in specimen digitization is developing methods that both increase access and allow for the highest yield of phenomic data. 3D digitization is increasingly popular because it has the potential to meet both aspects of that key goal. However, current methods overlook or do not prioritize some of the most sought-after phenotypic traits, those involving the external appearance of specimens, especially color. Here, we introduce an efficient and cost-effective pipeline for 3D photogrammetry to capture the external appearance of natural history specimens and other museum objects. 3D photogrammetry aligns and compares sets of dozens, hundreds, or even thousands of photos to create 3D models. The hardware set-up requires little physical space and around $3,000 in initial investment, while the software pipeline requires $1,400/year for proprietary software subscriptions (with open-source alternatives). The creation of each 3D model takes 1–2 hours/specimen and much of the software pipeline is automated with minimal supervision required, including the onerous step of mesh processing. We showcase the method by creating 3D models for most of the type specimens in the Moore Laboratory of Zoology bird collection and show that digital bill measurements are comparable to hand-taken measurements. Color data, while not included as part of this pipeline, is easily extractable from the models and one of the most promising areas of data collection. Future advances can adapt the method for ultraviolet reflectance capture and increased efficiency and model quality. Combined with genomic data, phenomic data from 3D models including photogrammetry will open new doors to understanding organismal evolution.

[1]  A. Herrel,et al.  3D Photogrammetry of Bat Skulls: Perspectives for Macro-evolutionary Analyses , 2019, Evolutionary Biology.

[2]  M. Hofmeyr,et al.  Terrestrial mammal three-dimensional photogrammetry: multispecies mass estimation , 2015 .

[3]  N. Yastikli Documentation of cultural heritage using digital photogrammetry and laser scanning , 2007 .

[4]  G. Spellman The Extended Specimen: Emerging Frontiers in Collections-Based Ornithological Research , 2019, The Auk.

[5]  Climate change, collections and the classroom: using big data to tackle big problems , 2017, Evolution: Education and Outreach.

[6]  Fabio Manucci,et al.  The smallest of the largest: new volumetric body mass estimate and in-vivo restoration of the dwarf elephant Palaeoloxodon ex gr. P. falconeri from Spinagallo Cave (Sicily) , 2019, Historical Biology.

[7]  The birds of Genome10K , 2014, GigaScience.

[8]  M. Nachman,et al.  Natural history collections as windows on evolutionary processes , 2016, Molecular ecology.

[9]  N. Grishin,et al.  Genomics of a complete butterfly continent , 2019, bioRxiv.

[10]  Christopher R. Cooney,et al.  Sexual selection predicts the rate and direction of colour divergence in a large avian radiation , 2019, Nature Communications.

[11]  D. Willard,et al.  Shared morphological consequences of global warming in North American migratory birds , 2019, bioRxiv.

[12]  Roberto Scopigno,et al.  Web-based visualization for 3D data in archaeology: The ADS 3D viewer , 2016 .

[13]  Vincent S. Smith,et al.  No specimen left behind: industrial scale digitization of natural history collections , 2012, ZooKeys.

[14]  A. Veneziano,et al.  Surface smoothing, decimation, and their effects on 3D biological specimens. , 2018, American journal of physical anthropology.

[15]  Doug M. Boyer,et al.  MORPHOSOURCE: ARCHIVING AND SHARING 3-D DIGITAL SPECIMEN DATA , 2016 .

[16]  Scott A. Taylor,et al.  High-throughput sequencing is revealing genetic associations with avian plumage color , 2019, The Auk.

[17]  Natural history collections document biological responses to climate change , 2019, Global change biology.

[18]  Allison J. Shultz,et al.  Widespread Cryptic Dichromatism and Ultraviolet Reflectance in the Largest Radiation of Neotropical Songbirds: Implications of Accounting for Avian Vision in the Study of Plumage Evolution , 2012 .

[19]  H. Mallison,et al.  PHOTOGRAMMETRY IN PALEONTOLOGY – A PRACTICAL GUIDE , 2014 .

[20]  G. Bitelli,et al.  TERRESTRIAL LASER SCANNING AND DIGITAL PHOTOGRAMMETRY TECHNIQUES TO MONITOR LANDSLIDE BODIES , 2004 .

[21]  Moshe Caine,et al.  Low Cost Heritage Imaging Techniques Compared , 2017, EVA.

[22]  Sanja Seljan,et al.  Photogrammetric 3D Scanning of Physical Objects: Tools and Workflow , 2019 .

[23]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Anthony Romilio,et al.  A standard protocol for documenting modern and fossil ichnological data , 2018 .

[25]  Allison Y. Hsiang,et al.  AutoMorph: Accelerating morphometrics with automated 2D and 3D image processing and shape extraction , 2017 .

[26]  B. Kempenaers,et al.  The effects of life history and sexual selection on male and female plumage colouration , 2015, Nature.

[27]  Peter L. Falkingham,et al.  Acquisition of high resolution three-dimensional models using free, open-source, photogrammetric software , 2012 .

[28]  W. Jetz,et al.  The global diversity of birds in space and time , 2012, Nature.

[29]  Nico Cellinese,et al.  Mass digitization of scientific collections: New opportunities to transform the use of biological specimens and underwrite biodiversity science , 2012, ZooKeys.

[30]  Jesús Marugán-Lobón,et al.  Open data and digital morphology , 2017, Proceedings of the Royal Society B: Biological Sciences.

[31]  D. Fritsch,et al.  Integration of Laser Scanning and Photogrammetry in 3D/4D Cultural Heritage Preservation – A Review , 2020 .

[32]  Jonathan Brecko,et al.  Comparing 3D digitizing technologies: What are the differences? , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[33]  M. Olalla‐Tárraga,et al.  Anuran 3D models reveal the relationship between surface area‐to‐volume ratio and climate , 2019, Journal of Biogeography.

[34]  Paula M. Mabee,et al.  The Extended Specimen Network: A Strategy to Enhance US Biodiversity Collections, Promote Research and Education , 2019, Bioscience.

[35]  I. Cuthill,et al.  Ultraviolet Vision in Birds , 2000 .

[36]  George Pavlidis,et al.  Methods for 3D digitization of Cultural Heritage , 2007 .

[37]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[38]  Maria C. Chiappelli,et al.  How flat can a horse be? Exploring 2D approximations of 3D crania in equids , 2019, bioRxiv.

[39]  Joshua M. Stuart,et al.  Genome 10K: a proposal to obtain whole-genome sequence for 10,000 vertebrate species. , 2009, The Journal of heredity.

[40]  Michael D. Abràmoff,et al.  Image processing with ImageJ , 2004 .

[41]  W. Jetz,et al.  Inferring the mammal tree: Species-level sets of phylogenies for questions in ecology, evolution, and conservation , 2019, PLoS biology.

[42]  E. Rayfield,et al.  The multifactorial nature of beak and skull shape evolution in parrots and cockatoos (Psittaciformes) , 2019, BMC Evolutionary Biology.

[43]  Michael Heethoff,et al.  An automated device for the digitization and 3D modelling of insects, combining extended-depth-of-field and all-side multi-view imaging , 2018, ZooKeys.

[44]  Christopher R. Cooney,et al.  Mega-evolutionary dynamics of the adaptive radiation of birds , 2017, Nature.

[45]  Gregory T. Baxter,et al.  The Digital Fish Library: Using MRI to Digitize, Database, and Document the Morphological Diversity of Fish , 2012, PloS one.

[46]  Glenn F. Seeholzer,et al.  Macroevolutionary bursts and constraints generate a rainbow in a clade of tropical birds , 2020, BMC Evolutionary Biology.

[47]  Xing Zhou,et al.  Large-scale 3D imaging of insects with natural color. , 2019, Optics express.

[48]  Matt Adcock,et al.  Capturing Natural-Colour 3D Models of Insects for Species Discovery and Diagnostics , 2014, PloS one.

[49]  Takashi Maekawa,et al.  System for reconstruction of three-dimensional micro objects from multiple photographic images , 2011, Comput. Aided Des..

[50]  Lawrence M. Page,et al.  Digitization of Biodiversity Collections Reveals Biggest Data on Biodiversity , 2015 .

[51]  A. Lister Natural history collections as sources of long-term datasets. , 2011, Trends in ecology & evolution.

[52]  Heinrich Mallison,et al.  The Digital Plateosaurus II: An Assessment of the Range of Motion of the Limbs and Vertebral Column and of Previous Reconstructions using a Digital Skeletal Mount , 2010 .

[53]  Emily K. Meineke,et al.  Digitization and the Future of Natural History Collections , 2019, BioScience.

[54]  Luigi Maria Galantucci,et al.  Photogrammetry Applied to Small and Micro Scaled Objects: A Review , 2018 .