"I couldn't find it your honour, it mustn't be there!" - Tool errors, tool limitations and user error in digital forensics.

The field of digital forensics maintains significant reliance on the software it uses to acquire and investigate forms of digital evidence. Without these tools, analysis of digital devices would often not be possible. Despite such levels of reliance, techniques for validating digital forensic software are sparse and research is limited in both volume and depth. As practitioners pursue the goal of producing robust evidence, they face the onerous task of both ensuring the accuracy of their tools and, their effective use. Whilst tool errors provide one issue, establishing a tool's limitations also provides an investigatory challenge leading the potential for practitioner user-error and ultimately a grey area of accountability. This article debates the problems surrounding digital forensic tool usage, evidential reliability and validation.

[1]  Harlan Carvey Windows Forensic Analysis: DVD Toolkit , 2007 .

[2]  Mark Pollitt Triage: A practical solution or admission of failure , 2013, Digit. Investig..

[3]  William J Buchanan,et al.  Evaluating Digital Forensic Tools (DFTs). , 2014 .

[4]  Joshua James,et al.  Measuring Accuracy of Automated Parsing and Categorization Tools and Processes in Digital Investigations , 2015, ICDF2C.

[5]  Nina Sunde Non-technical sources of errors when handling digital evidence within a criminal investigation , 2017 .

[6]  Nigel Jones IT forensics: 22 years on , 2009, Int. J. Electron. Secur. Digit. Forensics.

[7]  Jill Slay,et al.  Validation and verification of computer forensic software tools-Searching Function , 2009 .

[8]  Jill Slay,et al.  Digital Forensics: Validation and Verification in a Dynamic Work Environment , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[9]  Lorrie Faith Cranor,et al.  Usability of Forensics Tools: A User Study , 2011, 2011 Sixth International Conference on IT Security Incident Management and IT Forensics.

[10]  Brian Cusack,et al.  Identifying Bugs In Digital Forensic Tools , 2013 .

[11]  Graeme Horsman,et al.  A case-based reasoning method for locating evidence during digital forensic device triage , 2014, Decis. Support Syst..

[12]  Ron Patton,et al.  Software Testing , 2000 .

[13]  Andreas Rauber,et al.  The Challenge of Test Data Quality in Data Processing , 2017, ACM J. Data Inf. Qual..

[14]  Larry E. Daniel,et al.  Digital Forensics for Legal Professionals: Understanding Digital Evidence from the Warrant to the Courtroom , 2011 .

[15]  Benjamin Aziz,et al.  Modelling and refinement of forensic data acquisition specifications , 2014, Digit. Investig..

[16]  Roksana Moore Standardisation: A tool for addressing market failure within the software industry , 2013, Comput. Law Secur. Rev..

[17]  James R. Lyle If error rate is such a simple concept, why don't I have one for my forensic tool yet? , 2010 .

[18]  Chris Palmer,et al.  Breaking Forensics Software: Weaknesses in Critical Evidence Collection , 2007 .

[19]  Christian F. Chessman A 'Source' of Error: Computer Code, Criminal Defendants, and the Constitution , 2016 .

[20]  Mikhaila Burgess,et al.  A Forensic Methodology for Analyzing Nintendo 3DS Devices , 2016, IFIP Int. Conf. Digital Forensics.

[21]  Richard P. Ayers,et al.  Ten years of computer forensic tool testing , 2014 .

[22]  Manar Abu Talib Towards early software reliability prediction for computer forensic tools (case study). , 2016 .