Order and chaos in fixed-interval schedules of reinforcement.

Fixed-interval schedule performance is characterized by high levels of variability. Responding is absent at the onset of the interval and gradually increases in frequency until reinforcer delivery. Measures of behavior also vary drastically and unpredictably between successive intervals. Recent advances in the study of nonlinear dynamics have allowed researchers to study irregular and unpredictable behavior in a number of fields. This paper reviews several concepts and techniques from nonlinear dynamics and examines their utility in predicting the behavior of pigeons responding to a fixed-interval schedule of reinforcement. The analysis provided fairly accurate a priori accounts of response rates, accounting for 92.8% of the variance when predicting response rate 1 second in the future and 64% of the variance when predicting response rates for each second over the entire next interreinforcer interval. The nonlinear dynamics account suggests that even the "noisiest" behavior might be the product of purely deterministic mechanisms.

[1]  J H Wearden,et al.  Fixed-interval performance: The dynamics of behavior and the interval length. , 1983, Journal of the experimental analysis of behavior.

[2]  P B Dews,et al.  Studies on responding under fixed-interval schedules of reinforcement: II. The scalloped pattern of the cumulative record. , 1978, Journal of the experimental analysis of behavior.

[3]  R L Shull.  Sequential patterns in post-reinforcement pauses on fixed-interval schedules of food. , 1971, Journal of the experimental analysis of behavior.

[4]  Reinforcement probability and ordinal position of response in fixed-interval schedules. , 1986, Journal of the experimental analysis of behavior.

[5]  William L. Palya,et al.  An inexpensive experiment controller for stand-alone applications or distributed processing networks , 1984 .

[6]  R. Bevins,et al.  Serial conditioning as a function of stimulus, response, and temporal dependencies. , 1990, Journal of the experimental analysis of behavior.

[7]  M. Marr,et al.  Intractable properties of responding under a fixed-interval schedule. , 1982, Journal of the experimental analysis of behavior.

[8]  L J Hayes,et al.  The “It” That is Steady in Steady States , 1990, The Behavior analyst.

[9]  W. Palya.  Dynamics in the fine structure of schedule-controlled behavior. , 1992, Journal of the experimental analysis of behavior.

[10]  O. Rössler.  Chaotic Behavior in Simple Reaction Systems , 1976 .

[11]  M. Marr.  Behavior dynamics: One perspective. , 1992, Journal of the experimental analysis of behavior.

[12]  P. Killeen.  On the temporal control of behavior. , 1975 .

[13]  W N Schoenfeld,et al.  Behavior under extended exposure to a high-value fixed interval reinforcement schedule. , 1958, Journal of the experimental analysis of behavior.

[14]  V. Laties,et al.  A computer analysis of serial interactions in spaced responding. , 1966, Journal of the experimental analysis of behavior.

[15]  B. Weiss,et al.  The microanalysis of fixed-interval responding. , 1983, Journal of the experimental analysis of behavior.

[16]  J H Wearden.  Periodicities within a fixed-interval session. , 1979, Journal of the experimental analysis of behavior.

[17]  W. R. Sewell,et al.  A Chained Adjusting Ratio Schedule , 1968, Psychological reports.

[18]  Richard J. Herrnstein,et al.  A CONJUNCTIVE SCHEDULE OF REINFORCEMENT1 , 1958 .

[19]  B A Schneider,et al.  Separating the effects of interreinforcement time and number of interreinforcement responses. , 1968, Journal of the experimental analysis of behavior.

[20]  A. Brownstein,et al.  Interresponse time duration in fixed-interval schedules of reinforcement: control by ordinal position and time since reinforcement. , 1970, Journal of the experimental analysis of behavior.

[21]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[22]  R. T. Kelleher,et al.  A mathematical index of performance on fixed-interval schedules of reinforcement. , 1960, Journal of the experimental analysis of behavior.