Using cache memory to reduce processor-memory traffic

The importance of reducing processor-memory bandwidth is recognized in two distinct situations: single board computer systems and microprocessors of the future. Cache memory is investigated as a way to reduce the memory-processor traffic. We show that traditional caches which depend heavily on spatial locality (look-ahead) for their performance are inappropriate in these environments because they generate large bursts of bus traffic. A cache exploiting primarily temporal locality (look-behind) is then proposed and demonstrated to be effective in an environment where process switches are infrequent. We argue that such an environment is possible if the traffic to backing store is small enough that many processors can share a common memory and if the cache data consistency problem is solved. We demonstrate that such a cache can indeed reduce traffic to memory greatly, and introduce an elegant solution to the cache coherency problem.

[1]  Jacob A. Abraham,et al.  Using write back cache to improve performance of multi-user multiprocessors , 1982, ICPP.

[2]  Gordon Bell,et al.  An Investigation of Alternative Cache Organizations , 1974, IEEE Transactions on Computers.

[3]  Chinya V. Ravishankar,et al.  Cache implementation for multiple microprocessors , 1983 .

[4]  Donald C. Lindsay Cache memory for microprocessors , 1981, CARN.

[5]  S. J. Frank,et al.  Tightly coupled multiprocessor system speeds memory-access times , 1984 .

[6]  Calvin K. Tang Cache system design in the tightly coupled multiprocessor system , 1976, AFIPS '76.

[7]  Gururaj S. Rao,et al.  Performance Analysis of Cache Memories , 1978, JACM.

[8]  Alan Jay Smith,et al.  Cache Memories , 1982, CSUR.

[9]  Cornelis H. Hoogendoorn Reduction of memory interference in multiprocessor systems , 1977, ISCA '77.

[10]  John S. Liptay,et al.  Structural Aspects of the System/360 Model 85 II: The Cache , 1968, IBM Syst. J..

[11]  Martin B. Solomon Economies of scale and the IBM system/360 , 1966, CACM.

[12]  Robert O. Winder,et al.  Cache-based Computer Systems , 1973, Computer.

[13]  James R. Goodman,et al.  A study of instruction cache organizations and replacement policies , 1983, ISCA '83.

[14]  Allen Newell,et al.  Computer Structures: Principles and Examples , 1983 .

[15]  Paul Feautrier,et al.  A New Solution to Coherence Problems in Multicache Systems , 1978, IEEE Transactions on Computers.

[16]  C. G. Bell,et al.  Computer engineering: A DEC view of hardware systems design , 1978 .

[17]  Ronald Fagin,et al.  Cold-start vs. warm-start miss ratios , 1978, CACM.

[18]  H. R. J. Grosch,et al.  High Speed Arithmetic: The Digital Computer as a Research Tool , 1953 .