Three patients with intractable epilepsy, two with brain tumors, and one with encephalitis were imaged with magnetic resonance (MR) and positron emission tomography (PET). MR data were used to construct a three-dimensional (3D) computer model of the brain surface depicting the precentral (movement), postcentral (sensation), left inferior frontal (speech), and left superior temporal (hearing) gyri. PET-derived measurements of average surface metabolism were encoded as colors and mapped onto the 3D model by means of a retrospective technique for registering the two scans. The integrated 3D model depicted the location of PET-detected metabolic abnormalities with respect to the gyral anatomy visualized with MR. In each case, the predicted relationships were confirmed intraoperatively by means of inspection of the brain and electroencephalography. Multimodality 3D displays are likely to be particularly valuable for interpreting PET studies of epileptic patients and others with normal MR anatomy.