A complexity separation between the cache-coherent and distributed shared memory models

We consider asynchronous multiprocessor systems where processes communicate by accessing shared memory. Exchange of information among processes in such a multiprocessor necessitates costly memory accesses called remote memory references (RMRs), which generate communication on the interconnect joining processors and main memory. In this paper we compare two popular shared memory architecture models, namely the ca che-coherent (CC) and distributed shared memory (DSM) models, in terms of their power for solving synchronization problems efficiently with respect to RMRs. The particular problem we consider entails one process sending a "signal" to a subset of other processes. We show that a variant of this problem can be solved very efficiently with respect to RMRs in the CC model, but not so in the DSM model, even when we consider amortized RMR complexity. To our knowledge, this is the first separation in terms of amortized RMR complexity between the CC and DSM models. It is also the first separation in terms of RMR complexity (for asynchronous systems) that does not rely in any way on wait-freedom---the requirement that a process makes progress in a bounded number of its own steps.

[1]  Leslie Lamport,et al.  The mutual exclusion problem: partII—statement and solutions , 1986, JACM.

[2]  Edsger W. Dijkstra,et al.  Solution of a problem in concurrent programming control , 1965, CACM.

[3]  Nancy A. Lynch,et al.  An introduction to input/output automata , 1989 .

[4]  Wojciech M. Golab,et al.  Closing the complexity gap between FCFS mutual exclusion and mutual exclusion , 2010, Distributed Computing.

[5]  James H. Anderson,et al.  Timing-Based Mutual Exclusion with Local Spinning , 2003, DISC.

[6]  장훈,et al.  [서평]「Computer Organization and Design, The Hardware/Software Interface」 , 1997 .

[7]  Chien-Chung Huang,et al.  Group mutual exclusion in O(log n) RMR , 2010, PODC '10.

[8]  Prasad Jayanti,et al.  Fair group mutual exclusion , 2003, PODC '03.

[9]  Vassos Hadzilacos A note on group mutual exclusion , 2001, PODC '01.

[10]  Òòòðð,et al.  Shared-memory Mutual Exclusion: Major Research Trends Since 1986 , 1986 .

[11]  Mark Moir,et al.  A simple local-spin group mutual exclusion algorithm , 1999, PODC '99.

[12]  David A. Patterson,et al.  Computer organization and design (2nd ed.): the hardware/software interface , 1997 .

[13]  James H. Anderson,et al.  A fast, scalable mutual exclusion algorithm , 1995, Distributed Computing.

[14]  James H. Anderson,et al.  A generic local-spin fetch-and-phi-based mutual exclusion algorithm , 2007, J. Parallel Distributed Comput..

[15]  Danny Hendler,et al.  Tight RMR lower bounds for mutual exclusion and other problems , 2008, STOC '08.

[16]  Hyonho Lee Transformations of Mutual Exclusion Algorithms from the Cache-Coherent Model to the Distributed Shared Memory Model , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[17]  James H. Anderson,et al.  A space- and time-efficient local-spin spin lock , 2002, Inf. Process. Lett..

[18]  James H. Anderson,et al.  A Time Complexity Bound for Adaptive Mutual Exclusion , 2001, DISC.

[19]  Michael L. Scott,et al.  Algorithms for scalable synchronization on shared-memory multiprocessors , 1991, TOCS.

[20]  G. S. Graham A New Solution of Dijkstra ' s Concurrent Programming Problem , 2022 .

[21]  Yuh-Jzer Joung,et al.  Asynchronous group mutual exclusion , 2000, Distributed Computing.

[22]  Wojciech M. Golab,et al.  An O(1) RMRs leader election algorithm , 2006, PODC '06.

[23]  Thomas E. Anderson,et al.  The Performance of Spin Lock Alternatives for Shared-Memory Multiprocessors , 1990, IEEE Trans. Parallel Distributed Syst..

[24]  Shreekant S. Thakkar,et al.  Synchronization algorithms for shared-memory multiprocessors , 1990, Computer.

[25]  Maurice Herlihy,et al.  Wait-free synchronization , 1991, TOPL.

[26]  Prasad Jayanti A Complete and Constant Time Wait-Free Implementation of CAS from LL/SC and Vice Versa , 1998, DISC.

[27]  Vassos Hadzilacos,et al.  Local-Spin Group Mutual Exclusion Algorithms , 2004, DISC.

[28]  Wojciech M. Golab,et al.  Constant-RMR implementations of CAS and other synchronization primitives using read and write operations , 2007, PODC '07.

[29]  James H. Anderson,et al.  An improved lower bound for the time complexity of mutual exclusion , 2001, PODC '01.

[30]  Nancy A. Lynch,et al.  An Ω (n log n) lower bound on the cost of mutual exclusion , 2006, PODC '06.