An Assessment of the DARPA IDS Evaluation Dataset Using Snort S Terry Brugger

One of the many criticisms of the DARPA IDS evaluation is that it did not evaluate traditional, signature based, off-the-shelf intrusion detection systems. We performed such an evaluation on the 1998 dataset using Snort to determine the usefulness of the DARPA dataset, and found that overall detection performance was low and false positive rates were unacceptable. We present these results in greater depth, which indicate that the dataset does consist primarily of attacks that are difficult for signature based detectors to find; however, we find no support that the false positive rate