ISOBlue HD: An Open-Source Platform for Collecting Context-Rich Agricultural Machinery Datasets

This paper introduces an open-source platform called ISOBlue HD for acquisition of context-rich data from agricultural machinery. We call these datasets context-rich, because they enable the identification of machine status and farming logistics by properly labeling, fusing, and processing the data. The system includes a single board computer, a cellular modem, local storage, and power-over-ethernet switch to sensors. The system allows remote diagnostics and access, automatic startup/shut down with vehicle operations, and uses Apache Kafka to enable robust data exchange. ISOBlue HD was deployed in a combine harvester during a 2019 wheat harvest for simultaneously capturing 69 million CAN frames, 230,000 GPS points, and 437 GB of video data, focusing on header status and operator actions over 84 h of harvest time. Analyses of the collected data demonstrate that contextual knowledge can be inferred on harvest logistics (paths, speeds, header status, material transfer) and sensor data semantics.

[1]  Arto Visala,et al.  Coverage path planning algorithms for agricultural field machines , 2009, J. Field Robotics.

[2]  Michael J. O'Grady,et al.  Edge computing: A tractable model for smart agriculture? , 2019, Artificial Intelligence in Agriculture.

[3]  James V. Krogmeier,et al.  ISOBlue: An Open Source Project to Bring Agricultural Machinery Data into the Cloud , 2014 .

[4]  Robert A. Bridges,et al.  ACTT: Automotive CAN Tokenization and Translation , 2018, 2018 International Conference on Computational Science and Computational Intelligence (CSCI).

[5]  Liisa Pesonen,et al.  Cropinfra research data collection platform for ISO 11783 compatible and retrofit farm equipment , 2019, Comput. Electron. Agric..

[6]  Matthew J. Darr,et al.  CAN Bus Technology Enables Advanced Machinery Management , 2012 .

[7]  James V. Krogmeier,et al.  An Open-Source Infrastructure for Real-Time Automatic Agricultural Machine Data Processing , 2017 .

[8]  Yang Wang,et al.  CANdroid: Freeing ISOBUS Data and Enabling Machine Data Analytics , 2016 .

[9]  Peter Christiansen,et al.  FieldSAFE: Dataset for Obstacle Detection in Agriculture , 2017, Sensors.

[10]  Benjamin Ross Covington.  Assessment of utilization and downtime of a commercial level multi-pass corn stover harvesting systems , 2013 .

[11]  Jeff C. Askey.  Automated logistic processing and downtime analysis of commercial level multi-pass corn stover harvesting systems , 2014 .

[12]  Peter Hellinckx,et al.  Automatic Reverse Engineering of CAN Bus Data Using Machine Learning Techniques , 2017, 3PGCIC.

[13]  Ruben Ruiz-Gonzalez,et al.  A Kalman Filter Implementation for Precision Improvement in Low-Cost GPS Positioning of Tractors , 2013, Sensors.

[14]  Stefano Zanero,et al.  ReCAN – Dataset for reverse engineering of Controller Area Networks , 2020, Data in brief.

[15]  Santosh K. Pitla,et al.  Tractor CAN bus interface tools and application development for real-time data analysis , 2019, Comput. Electron. Agric..

[16]  Pablo González de Santos,et al.  Reducing fuel consumption in weed and pest control using robotic tractors , 2015, Comput. Electron. Agric..

[17]  Angela Ribeiro,et al.  Route planning for agricultural tasks: A general approach for fleets of autonomous vehicles in site-specific herbicide applications , 2016, Comput. Electron. Agric..

[18]  R. Eaton,et al.  Autonomous Farming: Modeling and Control of Agricultural Machinery in a Unified Framework , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[19]  Hans W. Griepentrog,et al.  Determination of Cultivated Area, Field Boundary and Overlapping for A Plowing Operation Using ISO 11783 Communication and D-GNSS Position Data , 2019 .

[20]  Mohamed-Slim Alouini,et al.  A Key 6G Challenge and Opportunity—Connecting the Base of the Pyramid: A Survey on Rural Connectivity , 2020, Proceedings of the IEEE.

[21]  Santosh K. Pitla,et al.  Validation of machine CAN bus J1939 fuel rate accuracy using Nebraska Tractor Test Laboratory fuel rate data , 2015, Comput. Electron. Agric..

[22]  Marshall F. Finner,et al.  Farm Machinery Fundamentals , 1979 .

[23]  Dimitris Paraforos,et al.  Machine operation profiles generated from ISO 11783 communication data , 2017, Comput. Electron. Agric..

[24]  Avishai Wool,et al.  Field classification, modeling and anomaly detection in unknown CAN bus networks , 2017, Veh. Commun..

[25]  Sytze de Bruin,et al.  Optimized routing on agricultural fields by minimizing maneuvering and servicing time , 2012, Precision Agriculture.

[26]  Kang G. Shin,et al.  LibreCAN: Automated CAN Message Translator , 2019, CCS.

[27]  James V. Krogmeier,et al.  Video Classification of Farming Activities with Motion-Adaptive Feature Sampling , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[28]  Mark Jensen.  Diagnostic Tool Concepts for ISO11783 (ISOBUS) , 2004 .

[29]  Mirco Marchetti,et al.  READ: Reverse Engineering of Automotive Data Frames , 2003, IEEE Transactions on Information Forensics and Security.

[30]  António Pereira,et al.  A Systematic Review of IoT Solutions for Smart Farming , 2020, Sensors.

[31]  Toru Torii.  Research in autonomous agriculture vehicles in Japan. , 2000 .

[32]  Ralph A. Palmer.  American society of agricultural engineers , 1925, Journal of the A.I.E.E..

[33]  Barry E. Mullins,et al.  Unsupervised Time Series Extraction from Controller Area Network Payloads , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[34]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[35]  Patrizia Busato,et al.  Machine Learning in Agriculture: A Review , 2018, Sensors.

[36]  Mirco Marchetti,et al.  Reverse engineering of automotive data frames , 2018 .

[37]  Muthoni Masinde,et al.  A Distributed Stream Processing Middleware Framework for Real-Time Analysis of Heterogeneous Data on Big Data Platform: Case of Environmental Monitoring , 2020, Sensors.

[38]  Tom Duckett,et al.  Agricultural Robotics: The Future of Robotic Agriculture , 2018, UKRAS White Papers.

[39]  Spyros Fountas,et al.  Agricultural Robotics for Field Operations , 2020, Sensors.

[40]  James V. Krogmeier,et al.  Video-Based Prediction for Header-Height Control of a Combine Harvester , 2019, 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).

[41]  Jie Huang,et al.  Benchmarking modern distributed streaming platforms , 2016, 2016 IEEE International Conference on Industrial Technology (ICIT).

[42]  Peter Christiansen,et al.  Using Deep Learning to Challenge Safety Standard for Highly Autonomous Machines in Agriculture , 2016, J. Imaging.

[43]  W. Romans,et al.  Advanced instrumentation for agricultural equipment , 2000 .