Computer simulation models are mathematical equations combined in a structured framework to represent some real or hypothetical system. One of their uses is to allow the projection of short-term data from clinical trials to evaluate clinical outcomes and costs over a long-term period. This technology is becoming increasingly important to assist decision making in modern medicine in situations where there is a paucity of long-term clinical trial data, as recently acknowledged in the American Diabetes Association Consensus Panel Guidelines for Computer Modeling of Diabetes and its Complications. The Mount Hood Challenge Meetings provide a forum for computer modelers of diabetes to discuss and compare models and identify key areas of future development to advance the field. The Fourth Mount Hood Challenge in 2004 was the first meeting of its kind to ask modelers to perform simulations of outcomes for patients in published clinical trials, allowing comparison against “real life” data. Eight modeling groups participated in the challenge. Each group was given three of the following challenges: to simulate a trial of type 2 diabetes (CARDS [Collaborative Atorvastatin Diabetes Study]); to simulate a trial of type 1 diabetes (DCCT [Diabetes Control and Complications Trial]); and to calculate outcomes for a hypothetical, precisely specified patient (cross-model validation). The results of the models varied from each other and for methodological reasons, in some cases, from the published trial data in important ways. This approach of performing systematic comparisons and validation exercises has enabled the identification of key differences among the models, as well as their possible causes and directions for improvement in the future.