Streaming and 3D mapping of AGRI-data on mobile devices

A mobile app for delivery of context aware data for crop monitoring and scouting is presented.Data intensive streaming methods were evaluated for delivering in-field AGRI-data.Customisable interactive 3D visualisation methods were evaluated for displaying AGRI-data.Testing highlights that different users prefer different 3D interactive visualisation methods.Testing highlights that data streaming and rendering is possible in low connectivity environments. Farm monitoring and operations generate heterogeneous AGRI-data from a variety of different sources that have the potential to be delivered to users on the go and in the field to inform farm decision making. A software framework capable of interfacing with existing web mapping services to deliver in-field farm data on commodity mobile hardware was developed and tested. This raised key research challenges related to: robustness of data steaming methods under typical farm connectivity scenarios, and mapping and 3D rendering of AGRI-data in an engaging and intuitive way. The presentation of AGRI-data in a 3D and interactive context was explored using different visualisation techniques; currently the 2D presentation of AGRI- data is the dominant practice, despite the fact that mobile devices can now support sophisticated 3D graphics via programmable pipelines. The testing found that WebSockets were the most reliable streaming method for high resolution image/texture data. From our focus groups there was no single visualisation technique that was preferred demonstrating that a range of methods is a good way to satisfy a large user base. Improved 3D experience on mobile phones is set to revolutionize the multimedia market and a key challenge is identifying useful 3D visualisation methods and navigation tools that support the exploration of data driven 3D interactive visualisation frameworks for AGRI-data.

[1]  Olaf Bubenzer,et al.  Combining digital elevation data (SRTM/ASTER), high resolution satellite imagery (Quickbird) and GIS for geomorphological mapping: A multi-component case study on Mediterranean karst in Central Crete , 2009 .

[2]  Alasdair N. Houston,et al.  Visual Simulation of Soil-Microbial System Using GPGPU Technology , 2015, Comput..

[3]  Kirk Martinez,et al.  VIPS - a highly tuned image processing software architecture , 2005, IEEE International Conference on Image Processing 2005.

[4]  Dave Shreiner,et al.  The OpenGL ES 2.0 programming guide , 2008 .

[5]  N. Zhang,et al.  Precision agriculture—a worldwide overview , 2002 .

[6]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[7]  Eliot Estep Mobile HTML5: Efficiency and Performance of WebSockets and Server-Sent Events , 2013 .

[8]  Alexander B. Sideridis,et al.  Developing a smartphone app for m-government in agriculture , 2014 .

[9]  Spyros Fountas,et al.  Farm management information systems: Current situation and future perspectives , 2015, Comput. Electron. Agric..

[10]  Luca Chittaro,et al.  Visualizing information on mobile devices , 2006, Computer.

[11]  John P. Isaacs,et al.  Indicator Modelling and Interactive Visualisation for Urban Sustainability Assessment , 2015 .

[12]  Jochen Teizer,et al.  Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system , 2014 .

[13]  Jürgen Döllner,et al.  Using 3D in Visualization , 2005 .

[14]  Terry W. Griffin,et al.  How Connected Are Our Farms , 2014 .

[15]  HENRI GOURAUD,et al.  Continuous Shading of Curved Surfaces , 1971, IEEE Transactions on Computers.

[16]  Sven Andersson,et al.  Virtual Texturing with WebGL , 2012 .

[17]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[18]  D. Mulla Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps , 2013 .

[19]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[20]  H. Navarro-Hellín,et al.  A software architecture based on FIWARE cloud for Precision Agriculture , 2017 .

[21]  Brian F. Goldiez,et al.  Real-Time Visual Simulation on PCs , 1999, IEEE Computer Graphics and Applications.

[22]  Nengcheng Chen,et al.  Integrated open geospatial web service enabled cyber-physical information infrastructure for precision agriculture monitoring , 2015, Comput. Electron. Agric..

[23]  Andrew A. Lovett,et al.  Using 3D visualization methods in landscape planning: An evaluation of options and practical issues , 2015 .

[24]  Dan Boneh,et al.  Who killed my battery?: analyzing mobile browser energy consumption , 2012, WWW.

[25]  Luca Chittaro,et al.  Geographical Data Visualization on Mobile Devices for Useer's Navigation and Decision Support Activites , 2007, Spatial Data on the Web.

[26]  Eckart Lange,et al.  The limits of realism: perceptions of virtual landscapes , 2001 .

[27]  Peter Petschek,et al.  Visualization of digital terrain and landscape data - a manual , 2010 .

[28]  Z. Tsiropoulos,et al.  Farm management information system for fruit orchards , 2015 .

[29]  Fangli Ying,et al.  Dynamic Visualization of Geospatial Data on Small Screen Mobile Devices , 2012 .

[30]  Paul Coulton,et al.  Evolution of 3D games on mobile phones , 2005, International Conference on Mobile Business (ICMB'05).

[31]  Maria Beatriz Carmo,et al.  Geo-referenced Information Visualization in Mobile Devices , 2007 .

[32]  Declan Butler,et al.  Virtual globes: The web-wide world , 2006, Nature.

[33]  Kevin Brothaler OpenGL ES 2 for Android , 2013 .