Objective: An evaluation of Internet end-to-end performance was conducted for the purpose of better understanding the overall performance of Internet pathways typical of those used to access information in National Library of Medicine (NLM) databases and, by extension, other Internet-based biomedical information resources.
Design: The evaluation used a three-level test strategy: 1) user testing to collect empirical data on Internet performance as perceived by users when accessing NLM Web-based databases, 2) technical testing to analyze the Internet paths between the NLM and the user's desktop computer terminal, and 3) technical testing between the NLM and the World Wide Web (“Web”) server computer at the user's institution to help characterize the relative performance of Internet pathways.
Measurements: Time to download the front pages of NLM Web sites and conduct standardized searches of NLM databases, data transmission capacity between NLM and remote locations (known as the bulk transfer capacity [BTC], “ping” round-trip time as an indication of the latency of the network pathways, and the network routing of the data transmissions (number and sequencing of hops).
Results: Based on 347 user tests spread over 16 locations, the median time per location to download the main NLM home page ranged from 2 to 59 seconds, and 1 to 24 seconds for the other NLM Web sites tested. The median time to conduct standardized searches and get search results ranged from 2 to 14 seconds for PubMed and 4 to 18 seconds for Internet Grateful Med. The overall problem rate was about 1 percent; that is, on the average, users experienced a problem once every 100 test measurements. The user terminal tests at five locations and Web host tests at 13 locations provided profiles of BTC, RTT, and network routing for both dial-up and fixed Internet connections.
Conclusion: The evaluation framework provided a profile of typical Internet performance and insights into network performance and time-of-day/day-of-week variability. This profile should serve as a frame of reference to help identify and diagnose connectivity problems and should contribute to the evolving concept of Internet quality of service.
[1]
Vern Paxson,et al.
End-to-end routing behavior in the Internet
,
1996,
TNET.
[2]
Larry L. Peterson,et al.
TCP Vegas: End to End Congestion Avoidance on a Global Internet
,
1995,
IEEE J. Sel. Areas Commun..
[3]
Henry J. Lowe,et al.
Review: The World Wide Web: A Review of an Emerging Internet-based Technology for the Distribution of Biomedical Information
,
1996,
J. Am. Medical Informatics Assoc..
[4]
Srinivasan Keshav,et al.
An Engineering Approach to Computer Networking: ATM Networks
,
1996
.
[5]
James J. Cimino,et al.
Review: Beyond the Superhighway: Exploiting the Internet with Medical Informatics
,
1997,
J. Am. Medical Informatics Assoc..
[6]
E R Siegel,et al.
Transitioning to the Internet: results of a National Library of Medicine user survey.
,
1997,
Bulletin of the Medical Library Association.
[7]
Farnam Jahanian,et al.
Internet routing instability
,
1997,
SIGCOMM '97.
[8]
Vern Paxson,et al.
Measurements and analysis of end-to-end Internet dynamics
,
1997
.
[9]
Mark Crovella,et al.
Measuring Bottleneck Link Speed in Packet-Switched Networks
,
1996,
Perform. Evaluation.
[10]
Vern Paxson,et al.
Framework for IP Performance Metrics
,
1998,
RFC.
[11]
Sally Floyd,et al.
Why we don't know how to simulate the Internet
,
1997,
WSC '97.