A Grassroots Remote Sensing Toolkit Using Live Coding, Smartphones, Kites and Lightweight Drones

This manuscript describes the development of an android-based smartphone application for capturing aerial photographs and spatial metadata automatically, for use in grassroots mapping applications. The aim of the project was to exploit the plethora of on-board sensors within modern smartphones (accelerometer, GPS, compass, camera) to generate ready-to-use spatial data from lightweight aerial platforms such as drones or kites. A visual coding ‘scheme blocks’ framework was used to build the application (‘app’), so that users could customise their own data capture tools in the field. The paper reports on the coding framework, then shows the results of test flights from kites and lightweight drones and finally shows how open-source geospatial toolkits were used to generate geographical information system (GIS)-ready GeoTIFF images from the metadata stored by the app. Two Android smartphones were used in testing–a high specification OnePlus One handset and a lower cost Acer Liquid Z3 handset, to test the operational limits of the app on phones with different sensor sets. We demonstrate that best results were obtained when the phone was attached to a stable single line kite or to a gliding drone. Results show that engine or motor vibrations from powered aircraft required dampening to ensure capture of high quality images. We demonstrate how the products generated from the open-source processing workflow are easily used in GIS. The app can be downloaded freely from the Google store by searching for ‘UAV toolkit’ (UAV toolkit 2016), and used wherever an Android smartphone and aerial platform are available to deliver rapid spatial data (e.g. in supporting decision-making in humanitarian disaster-relief zones, in teaching or for grassroots remote sensing and democratic mapping).

[1]  John C. Murray,et al.  Development and Deployment of an Intelligent Kite Aerial Photography Platform (iKAPP) for Site Surveying and Image Acquisition , 2013, J. Field Robotics.

[2]  Erle C. Ellis,et al.  Using lightweight unmanned aerial vehicles to monitor tropical forest recovery , 2015 .

[3]  Marc J. Rubin The effectiveness of live-coding to teach introductory programming , 2013, SIGCSE '13.

[4]  M. Johnson-Roberson,et al.  Kite Aerial Photography for Low-Cost, Ultra-high Spatial Resolution Multi-Spectral Mapping of Intertidal Landscapes , 2013, PloS one.

[5]  Gurkan Tuna,et al.  Unmanned aerial vehicle-aided communications system for disaster recovery , 2014, J. Netw. Comput. Appl..

[6]  Mika Raento,et al.  Smartphones , 2009 .

[7]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[8]  S. M. Jong,et al.  Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography , 2014 .

[9]  David M. Aanensen,et al.  EpiCollect: Linking Smartphones to Web Applications for Epidemiology, Ecology and Community Data Collection , 2009, PloS one.

[10]  J. Labadz,et al.  The potential of small unmanned aircraft systems and structure-from-motion for topographic surveys: A test of emerging integrated approaches at Cwm Idwal, North Wales , 2014 .

[11]  Dave Litwiller,et al.  CCD vs. CMOS: Facts and Fiction , 2001 .

[12]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[13]  Richard Inger,et al.  Smartphones in ecology and evolution: a guide for the app-rehensive , 2013, Ecology and evolution.

[14]  Erle C. Ellis,et al.  High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision , 2013 .

[15]  Fabio Paternò,et al.  End User Development: Survey of an Emerging Field for Empowering People , 2013 .

[16]  Richard Oehler,et al.  Surfing the web: practicing medicine in a technological age: using smartphones in clinical practice. , 2008, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[17]  J. Poesen,et al.  The potential of 3D gully monitoring with GIS using high-resolution aerial photography and a digital photogrammetry system , 2009 .

[18]  Dan Rahmel Development and Deployment , 2013 .

[19]  S. Robson,et al.  Mitigating systematic error in topographic models derived from UAV and ground‐based image networks , 2014 .

[20]  M. Goodchild Citizens as sensors: the world of volunteered geography , 2007 .

[21]  Thor Magnusson,et al.  Algorithms as Scores: Coding Live Music , 2011, Leonardo Music Journal.

[22]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[23]  Philippe Martinet,et al.  Simultaneous Object Pose and Velocity Computation Using a Single View from a Rolling Shutter Camera , 2006, ECCV.

[24]  Morwenna Kirwan,et al.  Using Smartphone Technology to Monitor Physical Activity in the 10,000 Steps Program: A Matched Case–Control Trial , 2012, Journal of medical Internet research.

[25]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[26]  Nick Collins,et al.  Live coding in laptop performance , 2003, Organised Sound.

[27]  Karen Anderson,et al.  Lightweight unmanned aerial vehicles will revolutionize spatial ecology , 2013 .

[28]  K. Ekschmitt,et al.  Influence of grain size on species–habitat models , 2011 .

[29]  Erle C. Ellis,et al.  Remote Sensing of Vegetation Structure Using Computer Vision , 2010, Remote. Sens..

[30]  A. Tatem,et al.  Dynamic population mapping using mobile phone data , 2014, Proceedings of the National Academy of Sciences.

[31]  Amine Bermak,et al.  CMOS Image Sensor with On-Chip Image Compression: A Review and Performance Analysis , 2010, J. Sensors.

[32]  Jonathan E. Thompson,et al.  Remote Sensing of Atmospheric Optical Depth Using a Smartphone Sun Photometer , 2014, PloS one.

[33]  Alex McLean,et al.  Visualisation of live code , 2010, EVA.