An integrated framework of sensing, machine learning, and augmented reality for aquaculture prawn farm management

Abstract The rapid growth of prawn farming on an international scale will play an important role in meeting the protein requirements of an expanding global population. Efficient management of the commercial ponds for healthy production of prawns is the key mantra of success in this industry. It is a necessity to maintain the water quality parameters in these ponds within specific ranges to create an ideal environment of optimal growth of healthy prawns. The current practice of water quality data collection and their usage for decision making on most farms is not efficient and does not take full advantage of the latest technologies. The research presented in this paper aimed at addressing this problem by systematic investigation and development of an integrated framework where (i) modern sensors were investigated for their suitability and deployed for continuous monitoring of the water quality variables in prawn ponds; (ii) novel machine learning models were investigated based on collected data and deployed to accurately forecast pond status over next 24 h. This provides farmers insight into upcoming situations and take necessary measures to avoid catastrophic situations; and (iii) augmented reality-based visualisation methods were investigated for improved data capture process and efficient decision making through real-time interactive interfaces. The paper presents the integrated framework as well as the details of sensing, machine learning, and augmented reality components. We found that (i) YSI EXO2 Multi-Sonde is the best sensor for continuous monitoring of prawn ponds; (ii) ForecastNet (our developed machine learning model) provides best forecasting results with symmetric mean absolute percentage error of 6.1 %, 9.6 %, and 8.5 % for dissolved oxygen, pH, and temperature; and (iii) augmented reality-based interactive interface achieves accuracy as high as 89.2 % for management decisions with at least 41 % less time. The experience of the project as presented in this paper can act as a guide for researchers as well as prawn farmers to take advantage of latest sensors, machine learning algorithms and augmented reality tools.

[1]  Dong An,et al.  Research of dissolved oxygen prediction in recirculating aquaculture systems based on deep belief network , 2020 .

[2]  C. Boyd,et al.  Higher minimum dissolved oxygen concentrations increase penaeid shrimp yields in earthen ponds , 2001 .

[3]  Jaime Gómez Gil,et al.  Design and Implementation of a GPS Guidance System for Agricultural Tractors Using Augmented Reality Technology , 2010, Sensors.

[4]  F. Díaz,et al.  Combined effect of temperature and salinity on the Thermotolerance and osmotic pressure of juvenile white shrimp litopenaeus vannamei (Boone) , 2012 .

[5]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[6]  M Cieplak 蛋白質の折りたたみにおける協調性と接触秩序 | 文献情報 | J-GLOBAL 科学技術総合リンクセンター , 2004 .

[7]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[8]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[9]  Jian Li,et al.  The effects of dissolved oxygen concentration and stocking density on growth and non-specific immunity factors in Chinese shrimp, Fenneropenaeus chinensis , 2006 .

[10]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[11]  Timo Oksanen,et al.  Soil sampling with drones and augmented reality in precision agriculture , 2018, Comput. Electron. Agric..

[12]  Chia-Sui Wang,et al.  Application of Regression Analysis to Achieve a Smart Monitoring System for Aquaculture , 2020, Inf..

[13]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[14]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[15]  Peter Taylor,et al.  A platform for integrating time-series with modelling systems , 2017 .

[16]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[17]  Ray Smith An Overview of the Tesseract OCR Engine , 2007 .

[18]  Joel Janek Dabrowski,et al.  ForecastNet: A Time-Variant Deep Feed-Forward Neural Network Architecture for Multi-Step-Ahead Time-Series Forecasting , 2020, ICONIP.

[19]  José Francisco Martínez Trinidad,et al.  Immediate water quality assessment in shrimp culture using fuzzy inference systems , 2012, Expert Syst. Appl..

[20]  Evangelos Spiliotis,et al.  Statistical and Machine Learning forecasting methods: Concerns and ways forward , 2018, PloS one.

[21]  Joel Janek Dabrowski,et al.  Sequence-to-Sequence Imputation of Missing Sensor Data , 2019, Australasian Conference on Artificial Intelligence.

[22]  Stuart Arnold,et al.  Identification of variables affecting production outcome in prawn ponds: A machine learning approach , 2019, Comput. Electron. Agric..

[23]  P. Thorburn,et al.  Applying Multi-Layer Artificial Neural Network and Mutual Information to the Prediction of Trends in Dissolved Oxygen , 2019, Front. Environ. Sci..

[24]  Peter Washington,et al.  Exploratory study examining the at-home feasibility of a wearable tool for social-affective learning in children with autism , 2018, npj Digital Medicine.

[25]  Antonija Mitrovic,et al.  Intelligent Augmented Reality Training for Motherboard Assembly , 2015, International Journal of Artificial Intelligence in Education.

[26]  John Mcculloch,et al.  Future Agriculture Farm Management using Augmented Reality , 2018, 2018 IEEE Workshop on Augmented and Virtual Realities for Good (VAR4Good).

[27]  Jessada Karnjana,et al.  A Study on Applying an Autoregressive Model with the Kalman Filtering in Accuracy Improvement of Dissolved Oxygen Measurement , 2018, 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP).

[28]  Yongnian Jiang,et al.  Prediction of dissolved oxygen in a fishery pond based on gated recurrent unit (GRU) , 2020 .

[29]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[30]  Mao-Jiun J. Wang,et al.  Usability evaluation of an instructional application based on Google Glass for mobile phone disassembly tasks. , 2019, Applied ergonomics.

[31]  Benjamin Letham,et al.  Forecasting at Scale , 2018 .

[32]  Stuart Arnold,et al.  State Space Models for Forecasting Water Quality Variables: An Application in Aquaculture Prawn Farming , 2018, KDD.

[33]  S. Ciavatta,et al.  The Extended Kalman Filter (EKF) as a tool for the assimilation of high frequency water quality data , 2003 .

[34]  Xinting Yang,et al.  Deep learning for smart fish farming: applications, opportunities and challenges , 2020, Reviews in Aquaculture.

[35]  Evangelos Spiliotis,et al.  The M4 Competition: Results, findings, conclusion and way forward , 2018, International Journal of Forecasting.

[36]  Alexander I. Rudnicky,et al.  Pocketsphinx: A Free, Real-Time Continuous Speech Recognition System for Hand-Held Devices , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[37]  Ashfaqur Rahman,et al.  Prediction of Dissolved Oxygen from pH and Water Temperature in Aquaculture Prawn Ponds , 2018, Proceedings of the Australasian Joint Conference on Artificial Intelligence - Workshops.

[38]  Peter J. Thorburn,et al.  Predicting the Trend of Dissolved Oxygen Based on the kPCA-RNN Model , 2020 .

[39]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[40]  Valentin Flunkert,et al.  DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks , 2017, International Journal of Forecasting.

[41]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Andrew George,et al.  Enforcing mean reversion in state space models for prawn pond water quality forecasting , 2020, Comput. Electron. Agric..