Psychology by BogdanovaThe Encyclopedia of Psychology for the Artificial Era

RESEARCH DOSSIER

Reinforcement Schedules and Behavioral Timing

Abstract. Reinforcement schedules define experimentally controlled relations between action, time, and consequential events. Their effects on behavioral timing offer a fundamental window into experience-dependent organization of responding. This monograph critically synthesizes historical operant experiments, fixed- and variable-ratio and interval procedures, spacing contingencies, postreinforcement pauses, response bouts, peak timing, scalar expectancy theory, behavioral-state and learning-to-time models, molar feedback accounts, partial reinforcement and behavioral persistence, human rule-guided performance, and contemporary movement-based measurements. The evidentiary analysis distinguishes programmed from obtained reinforcement, temporally local response dependencies from extended activity allocation, and aggregate response curves from individual-trial dynamics. Experimental comparisons from classical laboratory research through recent studies in 2025 clarify where temporal gradients generalize and where procedural, species, training, or motivational constraints change their interpretation. The synthesis establishes reinforcement schedules as structured temporal action-control procedures and identifies unresolved challenges in mechanism identification, multiscale measurement, causal transportability, and human–artificial interaction. This is a critical narrative research monograph; it contains no original experiments, systematic-review protocol, or quantitative meta-analysis.

Keywords: reinforcement schedules; behavioral timing; operant conditioning; fixed-ratio schedules; variable-ratio schedules; fixed-interval schedules; variable-interval schedules; postreinforcement pause; interresponse time; behavioral bouts; differential reinforcement of low rates; scalar expectancy theory; peak-interval procedure; behavioral theory of timing; learning-to-time models; partial reinforcement extinction effect; behavioral momentum; schedule-induced behavior; temporal discrimination; response–reinforcer delay; human rule-governed behavior; molar feedback functions

The Scientific Object of Reinforcement Schedules and Behavioral Timing

Reinforcement schedules are experimentally specified relations among responses, elapsed time, environmental conditions, and the availability or delivery of consequential events. Behavioral timing concerns the systematic organization of action with respect to durations, event sequences, and changing temporal opportunities. Their intersection is a distinct psychological research object: how temporally and quantitatively structured contingencies generate response rates, pauses, bouts, anticipatory gradients, switching patterns, and persistence. An operational analysis defines the response class, reinforcer, clock origin, eligibility rule, and measurement interval before invoking reinforcement as an explanatory process. The classic investigations assembled by Ferster and Skinner (1957) showed that the distribution of consequences changes the form of behavior even when response topology remains constant Ferster & Skinner (1957).

Research on schedules asks at least four separable questions. Which pattern appears after prolonged exposure to a programmed contingency? Which properties of the contingency produce that pattern when altered experimentally? What learning and timing processes can generate the observed within-session sequence? Which aspects generalize from controlled laboratory preparations to humans, other species, applied activities, and artificial environments? Those questions require more than a single summary response rate. Fixed-interval curves can arise from trial-level transitions between comparatively low and high rates, so identical averages may be consistent with different behavioral mechanisms Schneider (1969) Church et al. (1994).

This monograph provides a critical narrative synthesis of foundational experiments, quantitative theory, comparative temporal discrimination, human schedule research, and selected contemporary investigations. Its unit of evidence is a documented manipulation linked to a particular dependent measure, with inference restricted by species, training history, reinforcer quality, and procedural controls. The synthesis distinguishes ratio from interval contingency, response-contingent from response-independent delivery, delay from scheduled interval, and persistence from the mere continuation of responding after omitted reinforcement. It reports no original experiment, systematic-review protocol, or meta-analysis Catania & Reynolds (1968) Lattal (2010).

Schedules as Contingency Algorithms

A fixed-ratio schedule makes a consequence eligible after a specified number of counted responses; a variable-ratio schedule varies the response requirement according to an arranged sequence or probability distribution. A fixed-interval schedule makes a response eligible after a specified elapsed time since a defined event, ordinarily the preceding reinforcer, whereas a variable-interval schedule varies those programmed durations. In ordinary interval arrangements, the first eligible response delivers the consequence. Ratio requirements are response-count dependent and interval requirements are time dependent, yet the obtained rates of reinforcement depend on what the participant actually does. The difference is best described by the formal contingency and its experienced feedback relation, rather than by a popular slogan that one schedule is simply faster or stronger Ferster & Skinner (1957) Baum (2025).

Several further schedules reveal why the four textbook cases are a foundation rather than a complete taxonomy. Differential reinforcement of low rates (DRL) makes reinforcement depend on spacing between responses; a response arriving too soon typically restarts the waiting requirement. Differential reinforcement of high rates and limited-hold procedures place other constraints on spacing or response frequency. Fixed-time and variable-time schedules deliver outcomes according to clocks without requiring a target response. Response-initiated fixed intervals require an action to begin the timed cycle. Multiple schedules alternate discriminably signaled components; mixed schedules change components without distinct signals; chained and tandem schedules impose sequences of component requirements. Each arrangement creates potentially different temporal cues and conditional probabilities Wilson & Keller (1953) Shull (1970a) Shull (1970b).

A schedule description must specify whether the interval resets at reinforcement or at a response, whether an eligible reinforcer waits until a response or expires, and how the variable requirement is sampled. A variable-interval label alone does not establish constant moment-by-moment reinforcement probability: interval distribution, hold conditions, limited holds, and response behavior modify experienced hazard. Similarly, a variable-ratio schedule implemented by independent probability per response differs in microstructure from one that draws requirements from a finite list. General claims about schedule effects should therefore identify both the programmed rule and obtained response–reinforcer relation. Catania and Reynolds (1968) explicitly varied interval means and distributions, demonstrating the importance of parameters concealed by broad schedule names Catania & Reynolds (1968).

From Experimental Operant Analysis to the Modern Schedule Laboratory

Early experimental behavior analysis made regularity visible through apparatus that continuously recorded actions and reinforcer deliveries. Skinner's early work on operant behavior, the systematic development of reinforcement programming, and later cumulative recording turned rates and pauses into observable sequences rather than retrospective impressions. The Ferster and Skinner volume of 1957 combined extensive investigations of pigeons' behavior under simple and complex contingencies and became a primary document for the field's technical vocabulary. Its historical achievement lies in establishing manipulable relations among contingencies and behavioral forms; it does not by itself settle the later question of which information-processing or neurobiological mechanisms generate those forms Ferster & Skinner (1957).

Contemporaneous experiments showed that schedule effects can change the sensitivity of behavior to other interventions. Dews (1955) compared pigeons performing under a fixed-ratio requirement with behavior maintained by a fixed interval and reported contrasting effects of pentobarbital on schedule-appropriate response patterns. The inference is methodological: a pharmacological intervention can interact with the conditions controlling a response even when the basic motor capacity to peck remains present. A later study by Dews (1969) analyzed response spacing near the end of fixed intervals, underlining that within-interval distributions contain information unavailable in a gross session total Dews (1955) Dews (1969).

The field subsequently developed analyses of local response rate, interresponse-time distributions, schedule feedback functions, conditional reinforcement probability, choice allocation, and time estimation. Rather than treating visible cumulative-record curvature as a final explanation, investigators made it a phenomenon in need of explanation. Schneider (1969) modeled fixed-interval responding as transitions between low-rate and high-rate states; Shull (1970) changed the exact dependencies linking responses and reinforcers; Machado (1997) proposed a model of learned temporal dynamics. These programs describe different levels of an experimental system, and their adequacy must be judged by predictions under new values and altered task structures Schneider (1969) Shull (1970b) Machado (1997).

Measurement: Cumulative Records, Event Logs, and Temporal Microstructure

A cumulative record plots total responses against elapsed time, ordinarily making its local slope the instantaneous or windowed response rate. It is useful for visually identifying postreinforcement pauses, steady runs, accelerations, and abrupt changes when schedule components alternate. Its convenience also invites overinterpretation: pen resets, recording scale, smoothing, and aggregation may exaggerate similarities or obscure switching. Contemporary event-level analysis should preserve raw response timestamps, reinforcer timestamps, discriminative stimuli, schedule state, and programmed versus obtained durations. A reproduced cumulative trace can then be checked against trial-by-trial interresponse times, first-response latencies, and duration-normalized response functions Ferster & Skinner (1957) Schneider (1969).

Response rate is the number of responses per unit time; reinforcer rate is the number of delivered consequential events per unit time. Both depend on the temporal denominator. Overall rate includes postreinforcement pauses, while running rate may be calculated only during active response bouts; comparisons that change denominator can reverse apparent effects. The postreinforcement pause is typically the latency from reinforcer termination or another defined marker to the next response, and its distribution may be more informative than its mean. Interresponse time records measure time between consecutive responses, revealing burst structure, spacing rules, and transitions from disengagement to engagement. Shull, Gaynor, and Grimes (2001) modeled overall responding through visits and within-visit responding, emphasizing that one rate can mask different behavioral organizations Shull et al. (2001).

Measurement quality depends on whether an experiment preserves the environment that makes temporal cues meaningful. A lever response, key peck, activity trajectory, and human touchscreen press impose different costs and opportunities. Reinforcer delivery can produce consumption time, local displacement, orientation, and differential effort; these periods must be represented in analysis instead of counted automatically as pure clock estimation. New video-tracking work has extended schedule analysis beyond a single operandum. Kono (2025) described multidimensional measurement of pigeon behavior under ratio and interval schedules, illustrating how behavioral movement and spatial allocation can supplement the traditional response count. Such methods enlarge the observation space while requiring explicit coding reliability and preregistered hypotheses for confirmatory comparisons Kono (2025).

Causal Designs and the Problem of Obtained Reinforcement

Reliable schedule research uses within-subject reversals, counterbalanced sequence comparisons, stable-baseline criteria, and parametric variations of one schedule property at a time when feasible. Manipulation checks should report programmed parameters alongside the actually experienced reinforcer intervals and response costs. An interval contingency can deliver fewer reinforcers to an inactive organism than its nominal maximum; a ratio contingency can deliver less frequent reinforcement as its response requirement suppresses responding. Equating scheduled intervals without equating obtained reinforcement may confound opportunity, incentive density, and motor workload. Catania and Reynolds (1968) confronted these relations by distinguishing programmed mean intervals from their behavioral consequences across six experiments with pigeons Catania & Reynolds (1968).

A yoked comparison can arrange the same reinforcer delivery times for a second participant while removing or changing the response dependency. This separates, imperfectly, time-correlated effects from the specific contingency linking an action to the event. Response-independent comparisons also introduce changes in predictability, stimulus control, and event location, which should be inspected. Shull's (1970) comparison of fixed-interval arrangements in which the final response was or was not required demonstrated that identical minimum intervals can accompany different temporal response patterns. The result identifies a causal role for dependency while preserving the contribution of timing and event expectation Shull (1970b).

An adequate interpretation records experimental unit and repeated observations. Thousands of responses from four birds provide detailed within-organism evidence, not a sample of thousands of independent animals. Replication across schedule values, sessions, subjects, laboratories, and species probes different levels of generalization; large event counts alone do not resolve between-organism uncertainty. Data exclusion criteria, extinction endpoints, asymptotic stability definitions, apparatus failures, reinforcer deprivation state, and carryover from previous schedules also influence outcomes. A strong research synthesis accordingly assigns greater confidence to effects replicated under independent manipulations than to any universal behavior pattern inferred from a single striking cumulative record Fox & Kyonka (2013) Lejeune & Wearden (1991).

Fixed-Ratio Contingencies: Work, Pauses, and Response Runs

Under fixed-ratio reinforcement, a specified count of responses must occur after a reset before the programmed event can be delivered. Once responding begins, subjects in many established laboratory preparations produce a high-rate run followed by a pause after reinforcement, sometimes described as a break-and-run pattern. This organization reflects an interaction of required work, reinforcer consumption and expectancy, prior schedule history, and the animal's ability to sustain responding. The duration of the postreinforcement pause is a behavioral outcome rather than a fixed intrinsic property of every ratio requirement. Ferster and Skinner's (1957) extensive laboratory records documented pronounced temporal organization under fixed ratios, while later models sought to account for the cost and feedback relations generating the pause Ferster & Skinner (1957) Baum (2025).

Ratio size influences effort and obtained reward density jointly. If the required number of responses rises, the expected payoff per response falls for a given reinforcer magnitude; pausing and running behavior can also change the resulting delay to the next event. Comparisons that hold only the ratio label constant may overlook response force, fatigue, differential reinforcement histories, and time taken to consume reward. A ratio that produces steady responding at one value can support prolonged pauses or unstable behavior at a larger value, often described in terms of ratio strain. The scientifically meaningful claim is conditional on organism, reinforcer, requirement, and baseline. Mazur and Vaughan (1987) directly compared explanatory accounts of choices between fixed and progressive ratios, illustrating how delayed outcomes and longer-run payoff can be experimentally dissociated Mazur & Vaughan (1987).

Fixed-ratio performance also questions whether behavior is controlled by the next response or by a larger unit of action. A subject may contact one reinforcer only after completing an entire sequence, so action episodes can be organized as bouts or work cycles. Reinforcement history may select patterns of engagement and disengagement, not only discrete movements. Analysis should compare response-count completion times, pauses, within-bout rates, ratio-level latencies, and changes after schedule transitions. Such measurements can adjudicate whether a lower aggregate rate reflects slower responding while engaged, less frequent initiation of engagement, or both Shull et al. (2001) Baum (2025).

Variable-Ratio Contingencies and Probabilistic Reward

Variable-ratio schedules arrange changing response requirements. Under one common implementation each response has an independent probability of being reinforced, yielding a geometric distribution of required counts; other implementations use prescribed lists with specified arithmetic means. These differences affect the probability of an imminent event after a run of unrewarded responses. A variable ratio can sustain relatively high rates with less conspicuous postreinforcement pausing than many fixed ratios, but the magnitude of that effect is conditional on the distribution, response cost, reward quality, and prior training. The experimental construct is a stochastic contingency governing reward opportunity, not an assertion that uncertain outcomes always intensify behavior Ferster & Skinner (1957) Baum (2025).

Probabilistic ratio contingencies must be distinguished from variable-interval contingencies that wait for time to elapse. In a probabilistic ratio arrangement, each additional qualifying response may advance an opportunity to receive reinforcement; in a typical variable interval, responses made before the interval expires do not directly hasten eligibility. This alters the programmed feedback function linking work rate to reinforcement rate. A participant may learn a regularity in reward distribution while also changing behavior because the expected cost of obtaining a single reward changes. Appropriate comparisons isolate reinforcement frequency, unit effort, and temporal exposure instead of treating both schedules as interchangeable forms of partial reinforcement Catania & Reynolds (1968) Herrnstein (1961).

A particular research hazard is projecting laboratory variable-ratio findings directly onto gambling, consumer engagement, or online recommendation systems. Real-world outcomes may combine sequential prediction, signaling, loss aversion, money, complex goals, social information, and differential access to opportunities. A scheduled laboratory reinforcer also may be subject to deprivation and consumption procedures unlike human incentives. A rigorous transfer claim requires observation of the actual contingency and testable counterfactual manipulations. Token systems can provide controlled bridges between exchangeable generalized reinforcers and direct consumables, while retaining important differences between human and animal economic contexts Hackenberg (2009).

Fixed-Interval Contingencies: Temporal Scallops and State Transitions

Fixed-interval schedules make a consequence available for the first qualifying response after a defined duration has elapsed. With prolonged exposure, cumulative records may display a pause after reinforcement followed by an increasing rate near the programmed eligibility time, the familiar fixed-interval scallop. However, the smoothness of that curve is partly a consequence of aggregation. In Schneider's (1969) pigeon experiments, individual intervals were modeled by an abrupt shift from a low-rate period to a relatively high-rate period, with the average switch occurring around two-thirds into the interval. A study that reports only a smoothly rising across-trial mean can therefore obscure two-stage or more heterogeneous individual dynamics Schneider (1969).

Schedule timing is embedded in stimulus and response contingencies. Under response-initiated fixed intervals, an initial action starts the clock and a later action earns reinforcement after that interval expires. Shull (1970) observed long pauses and break-and-run patterns under such arrangements, even though the first response carried additional control over clock onset. Fox and Kyonka (2013) subsequently compared fixed and response-initiated fixed intervals across several durations, finding differences in interfood intervals and early response rates while some normalized temporal discrimination measures appeared comparable. These results show that timing performance cannot be inferred from pause duration alone; which event starts the interval and what the participant must do both matter Shull (1970a) Fox & Kyonka (2013).

Several interpretations can explain temporally organized fixed-interval performance. An organism might estimate elapsed time from reinforcement, discriminate a rising probability of reward availability, pass through behavior states with learned associations, or participate in an extended temporal feedback system. These explanations predict different effects when the time marker is signaled, schedule length changes unexpectedly, or reinforcers are omitted. The strongest account is one that predicts individual-trial latency distributions, peak-time scaling, and adaptation to changed contingencies instead of fitting the average scallop alone Gibbon (1977) Machado (1997) Church et al. (1994).

Variable-Interval Contingencies: Distribution, Hazard, and Stable Engagement

Variable-interval schedules arrange varying durations after which the first response produces reinforcement. Under many conventional distributions, responding is distributed more evenly across time than under a fixed interval with a salient periodic marker. The claim of a stable rate is statistical and procedure-dependent: intervals can vary in mean, variance, serial correlation, and hazard, and the actual obtained rate depends on responding after eligibility. Catania and Reynolds (1968) manipulated mean interval and distribution in their systematic pigeon experiments, showing that response patterns must be interpreted in relation to the interval series used. Two arrangements with the same nominal mean can produce different local opportunities and response distributions Catania & Reynolds (1968).

Theoretical analysis separates the distribution of programmed waiting times from the conditional probability that the interval ends given survival until a time point. A memoryless exponential interval distribution has constant instantaneous hazard in continuous time, whereas many commonly used discrete interval sets do not. This distinction matters for interpreting temporal anticipation. If the probability of interval completion changes across elapsed time, the organism may be sensitive to that structure through behavioral discrimination; uniform overall responding does not prove that no timing occurs. To test hazard learning, researchers should vary distributions while preserving mean delay and obtained reinforcement when possible and then measure time-conditioned responding rather than global rate alone Catania & Reynolds (1968) Gallistel & Gibbon (2000).

Variable-interval research is inseparable from response allocation because alternative activities compete with the target response. Behavioral engagement can be broken into visits, starts, within-bout rates, and pauses. Shull, Gaynor, and Grimes (2001) applied interresponse-time survivor analyses to characterize bouts and found that interpretations of reinforcement effects depend on whether changes occur in initiation or continuation. Concurrent or multiple schedule contexts further change the opportunity structure, making a supposedly stable rate an emergent property of a broader environment. This provides a methodological bridge to choice research without collapsing the distinct subject of matching-law allocation into reinforcement-schedule timing Shull et al. (2001) Herrnstein (1961).

Time-Based and Spacing Contingencies Beyond the Four Basic Schedules

Differential reinforcement of low rates makes response spacing itself consequential. A response that occurs before the required interval has elapsed typically prevents reinforcement and restarts the waiting period. The procedure therefore produces a demanding temporal-control problem in which producing more responses can lower the rate of reinforcement. Wilson and Keller (1953) studied selective reinforcement of spaced responses, providing an early experimental foundation for treating waiting as learned operant organization. Sidman's (1956) study of time discrimination and behavioral interaction added historical evidence that temporal demands can alter relations among ongoing activities. These procedures call for analysis of full interresponse-time distributions, not merely successful intervals Wilson & Keller (1953) Sidman (1956).

Fixed-time and variable-time delivery offer another important contrast. Because reinforcers occur without a programmed target-response dependency, behavior may nonetheless become temporally patterned through anticipation, spatial approach, species-typical activity, or adventitious pairings. Skinner's (1948) influential pigeon experiment motivated analysis of behavior that appeared selected by temporal coincidence, but the theoretical interpretation remained open. Staddon and Simmelhag (1971) reexamined the preparation and reported interim and terminal behaviors at different points of the reinforcement cycle, providing evidence that schedule-induced patterns involve more than one process. A precise explanation must distinguish behavior maintained by a response consequence from activities arising around periodic delivery Skinner (1948) Staddon & Simmelhag (1971).

Schedules also arrange token production, chained activities, conditioned reinforcers, and competing routes to reward. Tokens may bridge substantial time gaps between earning and exchanging rewards; their discriminative and exchange functions can change how a person or animal distributes effort. Hackenberg (2009) reviewed these relations as a way to integrate temporally extended reinforcement and behavioral economics. The analytical principle remains to specify the arrangement: how actions earn tokens, when tokens exchange for backup outcomes, which stimuli mark the phases, and what alternative uses of time are available. The schedule's temporal architecture can create distinct behavioral organizations even when total reward quantity remains similar Hackenberg (2009).

Peak Procedures and Behavioral Temporal Gradients

The peak-interval procedure extends fixed-interval training by occasionally omitting the expected reinforcer and allowing responses to continue beyond the usual eligibility time. On ordinary reinforced trials the first response after the interval can be followed by reward, whereas on unreinforced probe trials the experimenter observes a full response-rate function as time passes. The resulting aggregate function often rises before the expected time and declines afterward, yielding a measurable peak location, width, and asymmetry. These observations make it possible to distinguish an organism that merely waits for an anticipated first opportunity from one whose responding reflects a distributed estimate of elapsed time. The method also requires caution: probe-trial responding changes as participants encounter reward omission, and a population mean can merge quite different individual response patterns Church et al. (1994) Gibbon (1977).

Analysis at the single-trial level has particular explanatory value. Church, Meck, and Gibbon (1994) applied scalar timing theory to individual trials and characterized transitions between low and high response states, rather than treating the smooth aggregate function as the process itself. A common analysis estimates a start time and a stop time on each probe. Those transitions are behavioral estimates whose inferential validity depends on the statistical segmentation method and on whether high-rate behavior is stable within the middle segment. Comparing transition distributions with peak-time shifts can test whether timing errors reflect clock rate, memory retrieval, decision thresholds, or mixtures of these processes Church et al. (1994) Schneider (1969).

The peak method establishes control by an expected duration under defined reinforcement contingencies, not the presence of a single literal central stopwatch. Timing may recruit internal state changes, associative memories of contextual events, and strategies for responding under uncertainty. Experiments that vary target intervals, motivational conditions, discriminative signals, and sensory modalities can reveal both regularities and limitations. Peak-time scaling should be tested over several durations and at both individual and group levels; reporting one visually symmetric curve does not establish scalar variability or the mechanism producing it Gibbon (1977) Wearden & Lejeune (2008).

Scalar Expectancy and the Psychophysics of Duration

Scalar expectancy theory links temporal discrimination with a Weber-like property: in many animal timing tasks the spread of a temporal response distribution increases approximately in proportion to its target duration. Gibbon's (1977) analysis made scalar variability and time-scale invariance central predictions of a quantitative account of temporal expectation. Relative variability, often expressed as a coefficient of variation, provides a way to compare uncertainty across intervals. However, a fit to this relation is evidence about performance under measured conditions; it does not uniquely identify a pacemaker, accumulator, or the physical substrate of timing. Different generative models can yield similar scalar statistics Gibbon (1977) Gallistel & Gibbon (2000).

Temporal measurement can be framed through memory for intervals, comparisons between current elapsed time and learned standards, and a criterion for responding. This decomposition helps separate acquisition of temporal information from expression of an action under reinforcement. Manipulating a cue or reinforcer may change response vigor without changing the estimated expected time. Conversely, a temporal distribution can shift with little change in total number of responses. Human studies reviewed by Wearden and Lejeune (2008) found both compliance with and departures from scalar properties, emphasizing that tasks, durations, counting strategies, and response measures matter Wearden & Lejeune (2008).

Scalar prediction can be evaluated in schedule laboratories by plotting response rate against time normalized to the programmed interval, comparing peak times and widths, and estimating within-subject variation. Perfect superposition of normalized gradients is a strong prediction that need not hold when response constraints, reward delays, or temporal landmarks differ. Model comparison should distinguish random measurement noise from systematic departures. An organism may learn time-dependent conditional opportunities while also tracking response contingencies, so observed temporal precision is interpreted jointly with schedule structure and task demands Church et al. (1994) Fox & Kyonka (2013).

Behavioral Theory of Timing and Learning-to-Time Models

The behavioral theory of timing developed by Killeen and Fetterman (1988) represents temporal discrimination through transitions among behavioral states whose pace is influenced by reinforcement-related processes. Rather than locating all temporal information in an independently running clock, the theory describes how a series of adjunctive or interim activities may act as temporal cues. Different learned responses can become associated with successive states. The model supplies testable predictions about when responses occur, how reinforcement rate affects performance, and why temporal discrimination can be embedded in overt behavioral organization Killeen & Fetterman (1988) Staddon & Simmelhag (1971).

Bizo and White (1994) investigated a core proposal of that account by manipulating reinforcement rates and examining the inferred pacemaker rate. Their work matters methodologically because it turns a theoretical parameter into an experimental prediction: when a schedule changes the rate of reinforcement, the model requires specified changes in temporal behavior. Such tests must consider that a manipulation of reward rate can also alter arousal, consumption, response competition, and the conditioned value of contextual cues. A good explanatory model describes the direction and magnitude of the timing change rather than merely assigning a new latent parameter after observing it Bizo & White (1994) Killeen & Fetterman (1988).

Machado's learning-to-time framework (1997) described temporal behavior as learning about a sequence of states with response strengths updated by differential reinforcement. Its contribution lies in specifying a mechanism through which reinforcement can shape a temporal gradient without assuming a fixed scalar clock. Predictions can be tested by changing interval lengths, examining peak procedures, and comparing adaptation after unexpected schedule shifts. Scalar expectancy, behavioral-state accounts, and learning-to-time models therefore share a measurable empirical domain while positing different routes to its organization. Determining which components are indispensable requires direct model comparison across novel parameters and individual-trial dynamics Machado (1997) Church et al. (1994).

Event Rates, Temporal Prediction, and the Meaning of Reinforcement Frequency

An organism may exploit the rate at which significant events occur as well as the elapsed time since a particular marker. Gallistel and Gibbon (2000) proposed a rate-centered analysis in which learned temporal information plays a fundamental role in conditioning and response regulation. Their framework challenged simple descriptions in which a local stimulus–response association grows solely because two events occur close together. In schedule experiments the comparison can be sharpened by varying absolute intervals, relative event rates, and conditioned cues independently. A response increase following denser reinforcement establishes a functional relationship but does not alone decide whether event-rate computation, local strengthening, motivational changes, or altered response costs produced it Gallistel & Gibbon (2000) Catania & Reynolds (1968).

Programmed reinforcement frequency differs from obtained frequency. An organism that responds less frequently on an interval schedule may postpone collection after interval eligibility, changing the event rate it experiences; on a ratio schedule it directly determines when the response count reaches requirement. The resulting feedback functions link behavioral activity to food delivery in different ways. Baum's (2025) molar theoretical account incorporates feedback and allocation in a model of interval–ratio differences and explicitly limits its empirical treatment to pigeon data. As a model-based explanation, it is useful for deriving comparisons but should be judged against independent species, reinforcer classes, and changed experimental conditions Baum (2025).

Quantitative predictions depend on the unit of analysis. If behavior is organized into visits or bouts, the reinforcement rate associated with engaging in an activity can be more relevant than the reward probability attached to an isolated movement. A local interresponse-time analysis and a molar time-allocation model can therefore be jointly informative when their predictions are specified independently. Herrnstein's (1961) research on relative and absolute response strength also established a bridge between schedule-generated reward rates and allocation across alternatives. That empirical relationship warrants its own choices and matching analysis; here it serves to show why a temporally programmed consequence has broader effects than reinforcing one response Shull et al. (2001) Herrnstein (1961).

Molecular and Molar Models of Schedule Performance

Molecular analyses focus on closely spaced responses, cues, reinforcers, and specific histories of their contact; molar analyses study extended activities and feedback relations across a meaningful period. The two approaches often apply to different observational scales. An experiment might show that an individual response immediately precedes reinforcement while the longer-run schedule is simultaneously selecting a pattern of extended engagement. A complete mechanistic account should specify when local contingency is sufficient and when the behavior depends on aggregate work–reward relations. The distinction matters because schedules can generate stable patterns even though any single response is temporally remote from reward or belongs to a bout that ends in an event Lattal (2010) Baum (2025).

Feedback functions map response rate or proportion of activity to obtainable reinforcement rate under fixed environmental parameters. Ratio schedules generally make obtained reinforcement proportional to completed response work until other constraints intervene, while interval schedules exhibit a time-limited saturation in opportunities. Baum (2025) showed how an explicit molar feedback model can account for empirical differences in activity rates under interval and ratio arrangements; its explanatory success depends on the assumptions concerning behavioral units and reinforcer-induced activity. It complements older experiments showing that manipulations of response dependency change temporal organization even when scheduled time remains the same Baum (2025) Shull (1970b).

Model comparisons should not be adjudicated by rhetorical claims about whether a discrete response or an extended activity is the true unit. They should test prospective predictions for pauses, running rates, bout durations, transition times, schedule sensitivity, and stability under change. An account that predicts only overall session rate can fit a variety of incompatible microstructures; one that predicts only local interresponse times may miss changes in long-term allocation. Combining multiscale event logs with formal parameter recovery can expose identifiability failures and locate the explanatory work of each model Shull et al. (2001) Machado (1997).

Response–Reinforcer Delay and Temporal Credit Assignment

Delay of reinforcement separates an action from its consequence and can alter the conditions under which an outcome influences subsequent behavior. A schedule may require a fixed response count or elapsed time while introducing a delay between earning and delivering the reinforcer. That delay is not equivalent to the nominal interval controlling eligibility: the subject might perform intervening activities, encounter competing cues, or become uncertain about which action produced the outcome. Lattal's (2010) critical review of delayed reinforcement documents that delayed consequences can influence operant behavior under experimentally specified conditions. It supports analysis of the temporal relation between responses and outcomes rather than a universal claim that reinforcement requires immediate contiguity Lattal (2010).

Separating delay from reward density is technically demanding. Lengthening a delay can also reduce obtained reinforcers per session, alter response patterns during the waiting period, or introduce conditioned stimuli that bridge the gap. Experiments can vary delay systematically while measuring both the rate of qualifying actions and competing behavior. Procedures that deliver identical delayed outcomes contingent on different response histories allow more focused testing of temporal credit assignment, although reinforcer predictability and cues remain relevant. A formal account should specify which events can acquire credit and how the evidence for their consequence relationship changes as intervening time and responses accumulate Lattal (2010) Gallistel & Gibbon (2000).

Human participants often use verbal descriptions or explicit strategies to maintain an action through delays, adding processes to be measured rather than assumed. Token economies furnish another bridge when the immediate token is exchangeable for a backup reinforcer later. Hackenberg (2009) reviewed token reinforcement as an experimentally tractable system of conditioned value, temporal separation, and exchange schedules. The methodological implication is to distinguish learning a response–token relation from learning the token–backup relation and the timing of the exchange. Their combined effects can support apparently persistent engagement without proving the original action is controlled exclusively by a remote reinforcer Hackenberg (2009).

Human Instructions, Rules, and Schedule-Controlled Performance

Human schedule performance is jointly influenced by contact with contingencies, verbal rules, instructions, task goals, and socially established expectations. A participant told that reinforcement is available at regular intervals can respond according to that statement before experiencing enough outcomes to discriminate the schedule. Baron, Kaufman, and Stauber (1969) experimentally examined the effects of instructions and reinforcement feedback on human operant behavior under fixed-interval reinforcement. Their work helped establish why nonhuman schedule curves cannot simply be treated as a universal template for human performance. The correct causal question is what participants were told, what they observed, and how these sources of information shaped responding Baron et al. (1969).

Sheridan and colleagues (2025) tested a treadmill preparation in which access to preferred music depended on walking-speed requirements. Thirty-nine participants were randomly assigned to accurate-rule, inaccurate-rule, and no-rule groups of thirteen participants each. Schedule control emerged in eight of thirteen participants given accurate rules, zero of thirteen given inaccurate rules, and one of thirteen given no rules. In the two rule groups, twenty-four of twenty-six participants altered walking speed in accordance with the stated rule before encountering its consequences. These reported results support an influence of instructions on the acquisition of schedule control in this particular task; they do not quantify how the same instructions affect academic, occupational, or clinical outcomes Sheridan et al. (2025).

Instruction effects complicate experimental interpretation because a human can verbally track a temporal regularity while emitting an action for reasons distinct from the programmed reinforcer. A rule may be accurate, misleading, incomplete, self-generated, or socially enforced. Testing schedule control requires recording rule comprehension, timing of the first response change, exposure to contradictory feedback, and individual variability. Within-person reversals after misleading information are particularly informative when ethical and practical constraints permit. In comparing human and nonhuman performance, explicit language, counting, laboratory demand, and cultural experience are explanatory variables rather than residual noise Sheridan et al. (2025) Wearden & Lejeune (2008).

Comparative Variation, Biological Constraints, and Temporal Scale

Reinforcement schedules have been studied in rodents, pigeons, other nonhuman animals, and human experimental settings, but the use of similar schedule notation does not make procedures perceptually or motivationally equivalent across species. Differences in feeding, locomotion, motor response production, circadian state, and attention can alter both the time between responses and the time consumed by reinforcement. Lejeune and Wearden's (1991) comparative analysis of fixed-interval responding examined quantitative regularities and species-sensitive differences in temporal control. Generalization is best tested using comparable relative response costs and independently calibrated reinforcer efficacy, rather than assuming that a lever press, a keypeck, and a touchscreen tap constitute equivalent action units Lejeune & Wearden (1991).

The temporal range of an experiment matters. An interval lasting several seconds may recruit rapid response withholding and anticipatory movements; a longer delay may involve changing strategies, exploratory behavior, memory for prior feedback, or disengagement. Animals also differ in their opportunities to use external cues to mark elapsed time. An empirical claim about scalar timing or interval differentiation should state the range tested, how the timing period began, and whether cues were available throughout. Studies that manipulate session duration, interval series, and response topography help distinguish duration estimation from opportunities for reinforcement and competing activities Gibbon (1977) Fox & Kyonka (2013).

Comparative evidence also exposes confounds that are easy to overlook in human experiments. Animals often acquire schedule control through extensive training under deprivation-controlled food reinforcement, whereas humans frequently receive only a few sessions with points, sounds, money, or instructions. A short laboratory exposure can fail to reproduce stable performance that develops over extended experience. Conversely, a pattern seen after hundreds of sessions may be too specialized to inform rapid real-world learning. Research should report training histories and asymptotic criteria, distinguish within-species from between-species variance, and avoid attributing differences directly to an unobserved general timing capacity Lejeune & Wearden (1991) Baron et al. (1969).

Partial Reinforcement, Extinction, and the Meaning of Persistence

Extinction procedures remove the programmed response–reinforcer relationship or omit the reinforcer after a history of reinforcement. The partial-reinforcement extinction effect denotes conditions in which intermittently reinforced responding can persist longer in extinction than continuously reinforced responding, although its magnitude and mechanism depend on training, schedule parameters, and the dependent measure. Classic reviews distinguish the persistence of response frequency, latency to a terminal criterion, and responses emitted before suppression. A schedule may create behavioral persistence through discrimination between acquisition and extinction conditions, uncertainty about reward omissions, learned sequences, or altered alternative activities. Persistence is therefore an outcome to measure and explain, not a synonym for a stronger or better learned action Jenkins & Stanley (1950) Nevin & Grace (2000).

Behavioral momentum theory examines the resistance of behavior to change as a function of reinforcement conditions associated with discriminative contexts. Nevin (1974) analyzed response strength across components of multiple schedules, and Nevin and Grace (2000) developed a quantitative account relating reinforcement conditions and persistence. Their analyses show why a high baseline response rate need not imply high resistance to disruption. When a response occurs frequently under a particular contingency, a subsequent challenge may reduce it rapidly; another response with lower baseline frequency can be comparatively resistant under its own stimulus conditions. Testing this relation requires an explicit disruptor and a defined response measure before and during disruption Nevin (1974) Nevin & Grace (2000).

Claims about partial reinforcement must also distinguish extinction from degradation, delayed reinforcement, reinforcement of alternative actions, and cessation of the entire task. The disappearance of a reward may simultaneously change motivation, arousal, and conditioned stimuli. Researchers can compare conditions matched for prior reward amount, schedule type, and opportunity while analyzing both first-response latency and response persistence. This provides a disciplined bridge to applied behavior and habit research: an action continuing after reward removal may reflect schedule history or context-dependent expectations, and broader functional interpretations require independent manipulations Jenkins & Stanley (1950) Lattal (2010).

Contemporary Experimental Extensions and Schedule-Induced Activities

Recent research demonstrates that schedule-related behavioral organization is richer than the count of operant responses at a single device. Kono (2025) used video tracking to conduct a pilot multidimensional analysis of pigeon behavior under ratio and interval arrangements, showing how motion and location can inform interpretations of schedule performance. Such methods make previously hidden activities observable, including approach, repositioning, and nonoperant movements that occupy periods labeled as pauses in a conventional response record. Their value depends on validated tracking, treatment of missing frames, and appropriate caution about small preliminary designs; more dimensions alone do not guarantee a mechanistic explanation Kono (2025).

Schedule-induced behavior also illuminates the difference between the temporal distribution of an event and the structure of activity it evokes. In a contemporary study, Martínez-Herrada, Pellón, and López-Tolsa (2025) examined how the temporal organization of schedule-induced behavior relates to the essential value of the reinforcer. Together with the classic reexamination of response-independent periodic food delivery by Staddon and Simmelhag (1971), such work invites a more explicit decomposition of interim activity, terminal approach, reward seeking, and instrumental responding. Any proposed relationship should be reported with the actual dependent variables and animal preparation rather than treated as evidence that one causal process explains all behavioral patterns Martínez-Herrada et al. (2025) Staddon & Simmelhag (1971).

Contemporary quantitative synthesis must connect this richer measurement space to meaningful tests. Movement paths can be synchronized with response and reward timestamps, phase-normalized relative to time since the last event, and compared across randomized schedule changes. Mixed schedules and accurate versus inaccurate instructions also allow investigators to ask whether temporal organization is driven by experienced contingencies or anticipatory predictions. The human treadmill experiment of Sheridan and colleagues (2025) and the avian monitoring study of Kono (2025) represent complementary methodological extensions, each limited by its specific procedure and population. Their shared scientific contribution lies in making schedule control observable in behavioral dimensions beyond traditional keypeck totals Sheridan et al. (2025) Kono (2025).

Evidence Appraisal, Replication, and the Scope of Generalization

The evidence base for reinforcement schedules is unusually rich in repeated observations within subjects, controlled contingency changes, and temporally resolved measurement. These strengths support causal inference about particular schedules in established laboratory settings, especially when behavior reverses or reorganizes after a changed contingency. Their limitations include relatively small numbers of animals in some foundational studies, differences in exposure length, reliance on a few species and reinforcer types, and differences in what is counted as a response. Schneider's (1969) two-state analysis and Fox and Kyonka's (2013) systematic cross-schedule comparison provide complementary forms of evidence, but neither establishes a species-general mechanism by itself. The appropriate hierarchy privileges reproducible manipulation effects with converging measures over a single striking response pattern Schneider (1969) Fox & Kyonka (2013).

Historical experimental results require reconstruction with attention to reporting practice. Cumulative records and selected sessions can document a phenomenon vividly while leaving variability and selection rules difficult to recover. Later experiments may provide statistical tests but still depend on choices about stable baseline, response-bout segmentation, and how a scheduled event is timed. Within-participant replications answer a different question from independent between-laboratory replications, and a large count of trials is not equivalent to a large number of independent subjects. Primary data transparency, complete session logs, equipment configuration, preregistration of confirmatory predictions, and sensitivity analyses can improve the evidentiary value of future schedule research Catania & Reynolds (1968) Shull et al. (2001).

Quantitative theory adds a second burden: fitting familiar datasets demonstrates descriptive adequacy, while predictions on withheld schedule types, species, or parameters test explanatory transport. A model can accommodate a broad family of timing curves by changing parameter values without showing that its proposed internal process exists. Replication should therefore measure both qualitative effects and discriminating predictions of competing accounts. An account of fixed-interval behavior should predict pause distributions and individual temporal transitions, and a ratio–interval model should predict outcomes under altered response costs and rates of food availability. Baum's (2025) account offers explicit theoretical predictions and also identifies generalization beyond pigeons as an unfinished test Baum (2025) Machado (1997).

Statistical Design and Model-Based Analysis of Temporal Behavior

An evidence-focused schedule study should begin with the causal estimand and unit of replication. For an interval manipulation, the researcher might target a change in within-interval response probability or in the distribution of time to first response; for a ratio manipulation, the endpoint might be bout initiation or time required to complete a work requirement. Longitudinal within-subject designs yield highly correlated observations, so an analysis of individual response events must avoid treating each peck as an independent animal. Hierarchical models can represent between-participant differences alongside within-participant transitions. Change-point or hidden-state approaches can compare two-state descriptions with continuously changing response hazard, subject to assumptions explicitly tested by simulations and posterior predictive checks Schneider (1969) Schneider & Neuringer (1972).

Temporal series also raise censoring and competing-risk problems. A subject may not respond before the next programmed event, or the session may terminate before the waiting interval is completed. Excluding such intervals biases latency distributions toward shorter responses. Survival methods can describe bout endings and response-free durations while accounting for censoring, and point-process models can represent time-varying response intensity. Shull, Gaynor, and Grimes (2001) used interresponse-time survivor analyses to distinguish changes in bouts and initiation. Even when those tools are used, conclusions depend on predeclared response definitions and whether unrecorded activities affect exposure time Shull et al. (2001).

Quantitative comparisons should report uncertainty at the participant level, baseline variability, acquisition or adaptation times, the amount of data used to estimate each parameter, and out-of-sample predictive performance. Measures such as mean response rate, start time, peak width, coefficient of variation, and reinforcement density address different dimensions; choosing only the most dramatic measure after data inspection risks exaggerating an effect. Comparisons of scalar theory, behavioral-state models, and molar feedback accounts benefit from common datasets and measurement conventions. Transparent scripts, programmable schedule specifications, and raw timestamp archives make independent reanalysis possible Gibbon (1977) Killeen & Fetterman (1988) Baum (2025).

Scientific Applications in Education, Work, and Behavioral Design

Scheduled feedback can structure effort and waiting in training, education, occupational settings, and rehabilitation. In those settings, however, the consequences that maintain a behavior may include task mastery, social evaluation, self-set goals, physical comfort, material exchange, and competing obligations. The research implication is to map actual response–outcome dependencies before proposing a reinforcement schedule. An experimental finding that a pigeon keypecks differently under fixed and variable intervals supports a functional comparison under those conditions; whether changing feedback frequency improves learning or well-being in a classroom requires independent intervention studies. Outcomes should include skill acquisition, retention, choice autonomy, task quality, and adverse effects rather than throughput alone Ferster & Skinner (1957) Sheridan et al. (2025).

Human rule-following creates specific opportunities and risks for applied translation. Accurate information about how feedback becomes available may facilitate acquisition of schedule control, as illustrated by the treadmill experiment of Sheridan and colleagues (2025). The same study found that inaccurate rules could impede the emergence of scheduled behavioral adjustment. This result supports testing instruction accuracy and comprehension whenever researchers deploy feedback procedures. It does not warrant using misleading instructions to engineer persistent behavior in real-world environments. Transparent rules, meaningful opt-out options, and assessment of delayed or competing outcomes are scientifically and ethically relevant to intervention evaluation Sheridan et al. (2025).

Token reinforcement and exchange schedules have long provided a way to study interactions among immediate signals, delayed outcomes, and extended work cycles. Hackenberg's (2009) synthesis shows that token arrangements can be analyzed as structured contingencies rather than treated merely as incentives. In applied research, the critical comparison is whether a schedule supports durable independent competence after support is reduced, including generalization to different contexts and tasks. Measurement should track both schedule-controlled performance and broader welfare; strong experimental control over short-term responding does not demonstrate long-term benefit Hackenberg (2009) Nevin & Grace (2000).

Artificial Era Research: Scheduled Feedback and Human–Artificial Systems

Computational agents and human–artificial interfaces can implement explicit temporal reward schedules, delayed feedback, and controlled transitions between contingent and noncontingent events. Such systems create test environments for modeling reinforcement processes, but a shared schedule equation does not establish identity of psychological mechanisms across biological and artificial systems. The scientific bridge lies in measurable variables: action selection under fixed or stochastic consequence schedules, adaptation after schedule change, temporal prediction, credit assignment, and persistence when programmed rewards disappear. A valid cross-system comparison requires matching task observables, training histories, opportunities for alternative action, and independent test conditions Machado (1997) Baum (2025).

In human–artificial relations, feedback timing may influence human expectations of reliability, action initiation, and patterns of cognitive reliance. Research can experimentally manipulate the delay and informativeness of artificial feedback, record human response latencies and subjective expectations separately, and evaluate whether individuals maintain competencies in the absence of automated reinforcement. Such experiments would extend classical schedule methods into a new interaction context, while their results would depend on explicit psychological outcomes and appropriate participant protections. The philosophical horizon of the Artificial Era motivates those research questions; empirical claims require their own observations and controlled comparisons Lattal (2010) Sheridan et al. (2025).

Artificial agents can also be used as formal comparators in generative simulations. Models implementing scalar timing, state-based timing, and molar feedback can generate predicted action sequences under identical scheduled events. Simulation can identify discriminating experimental conditions and reveal when different mechanisms produce equivalent patterns, including the same overall rate but different pause structures. It cannot substitute for experimental validation with an organism or human participant. The most valuable use of artificial systems in this dossier is therefore methodological: explicit algorithms, transparent assumptions, prospective predictions, and experiments that determine which description accounts for which behavioral evidence Gallistel & Gibbon (2000) Killeen & Fetterman (1988) Baum (2025).

Open Problems and Future Experimental Research

A foundational open problem concerns causal identification of timing mechanisms. The same schedule-induced gradient may be generated by elapsed-time estimation, learned state transitions, conditional reward expectations, or a change in activity allocation. Future experiments should change the timer reset, response dependency, conditional hazard, and reinforcement rate separately where practicable. They should compare model predictions before observing the altered behavior. The aim is to identify the smallest set of processes necessary to explain both individual response sequences and broader activity patterns Schneider (1969) Machado (1997) Baum (2025).

Another open problem is transportability across participants, environments, and reinforcer systems. An effect found under extended pigeon food training may change when outcomes are monetary, social, symbolic, informational, or self-selected. Human instructional history, culture, and individual differences may dominate early performance before substantial contingency exposure. Multisite research using shared event-logging formats, standardized parametric schedules, and transparent training histories could establish which functional properties generalize. Ecological measurement methods, including video tracking, can capture alternative activities that narrow laboratory records have historically missed Kono (2025) Sheridan et al. (2025).

Finally, the relationship between short-term schedule control and durable adaptive benefit remains scientifically unresolved in many applied contexts. More responses, longer persistence, and smaller timing errors are not uniformly desirable outcomes. Research needs to specify the task's purpose and evaluate accuracy, effort, welfare, autonomy, and retention after scheduled support ends. Experiments could compare matched reward rates under contingent and response-independent delivery, test disruption and extinction at delayed intervals, and use computational predictions to select theoretically decisive interventions. Such work would connect laboratory precision with wider psychological significance while preserving the distinct evidentiary claims of each design Nevin & Grace (2000) Hackenberg (2009).

Conclusion

Reinforcement schedules establish experimentally tractable relations among consequences, behavioral work, and elapsed time. Fixed-ratio and variable-ratio contingencies organize responding around work requirements, while fixed-interval and variable-interval contingencies make temporal eligibility central to the opportunity for reinforcement. Spacing schedules, response-initiated intervals, time-based delivery, and token exchange expand this architecture into different forms of temporal control. Foundational laboratory research demonstrates that changing such arrangements can reorganize response rates, postreinforcement pauses, interresponse-time distributions, bouts, and patterns of alternative activity. The empirically meaningful unit is the specified contingency together with the observed behavior under it Ferster & Skinner (1957) Catania & Reynolds (1968) Shull et al. (2001).

Quantitative timing theories explain different aspects of these patterns. Scalar expectancy theory emphasizes temporal scaling and variability; behavioral-state and learning-to-time models propose mechanisms for temporally organized action; molar feedback analyses describe how extended work and reward rate constrain activity allocation. The contemporary evidence does not reduce these explanatory levels to a single universal process. Individual-trial observations, schedule-switch experiments, response-independent controls, and out-of-sample model tests distinguish claims more precisely than aggregate schedule labels. Human research further demonstrates that explicit instructions can shape schedule performance before consequences are experienced, while comparative and movement-based studies expose additional variables Gibbon (1977) Killeen & Fetterman (1988) Machado (1997) Baum (2025) Sheridan et al. (2025).

The scientific synthesis is a structured account of behavioral timing as a joint product of contingency, temporal information, action organization, learning history, and context. Its strongest conclusions are experimentally local and capable of independent replication; broader claims require new tests with different tasks and populations. The outstanding research program combines high-resolution event measurement, transparent programming, model comparison, careful developmental and cross-species sampling, and applied outcomes that extend beyond raw response frequency. This framework positions reinforcement schedules as a central experimental approach to understanding how the temporal structure of the environment shapes organized behavior Fox & Kyonka (2013) Lejeune & Wearden (1991) Nevin & Grace (2000).

References

  • Baron, A., Kaufman, A., & Stauber, K. A. (1969). Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement. Journal of the Experimental Analysis of Behavior, 12(5), 701–712. https://doi.org/10.1901/jeab.1969.12-701
  • Baum, W. M. (2025). Explaining performance on interval and ratio schedules with a molar view of behavior. Perspectives on Behavior Science, 48(2), 173–202. https://doi.org/10.1007/s40614-025-00455-3
  • Bizo, L. A., & White, K. G. (1994). The behavioral theory of timing: Reinforcer rate determines pacemaker rate. Journal of the Experimental Analysis of Behavior, 61(1), 19–33. https://doi.org/10.1901/jeab.1994.61-19
  • Catania, A. C., & Reynolds, G. S. (1968). A quantitative analysis of the responding maintained by interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 11(3, Part 2, Supplement), 327–383. https://doi.org/10.1901/jeab.1968.11-s327
  • Church, R. M., Meck, W. H., & Gibbon, J. (1994). Application of scalar timing theory to individual trials. Journal of Experimental Psychology: Animal Behavior Processes, 20(2), 135–155. https://doi.org/10.1037/0097-7403.20.2.135
  • Dews, P. B. (1955). Studies on behavior. I. Differential sensitivity to pentobarbital of pecking performance in pigeons depending on the schedule of reward. Journal of Pharmacology and Experimental Therapeutics, 113(4), 393–401. https://doi.org/10.1016/S0022-3565(25)11525-5
  • Dews, P. B. (1969). Studies on responding under fixed-interval schedules of reinforcement: The effects on the pattern of responding of changes in requirements at reinforcement. Journal of the Experimental Analysis of Behavior, 12(2), 191–199. https://doi.org/10.1901/jeab.1969.12-191
  • Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. Appleton-Century-Crofts. https://search.worldcat.org/title/Schedules-of-reinforcement-by-C.B.-Ferster-and-B.F.-Skinner/oclc/4596140
  • Fox, A. E., & Kyonka, E. G. E. (2013). Pigeon responding in fixed-interval and response-initiated fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 100(2), 187–197. https://doi.org/10.1002/jeab.38
  • Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107(2), 289–344. https://doi.org/10.1037/0033-295X.107.2.289
  • Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84(3), 279–325. https://doi.org/10.1037/0033-295X.84.3.279
  • Hackenberg, T. D. (2009). Token reinforcement: A review and analysis. Journal of the Experimental Analysis of Behavior, 91(2), 257–286. https://doi.org/10.1901/jeab.2009.91-257
  • Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4(3), 267–272. https://doi.org/10.1901/jeab.1961.4-267
  • Jenkins, W. O., & Stanley, J. C., Jr. (1950). Partial reinforcement: A review and critique. Psychological Bulletin, 47(3), 193–234. https://doi.org/10.1037/h0060772
  • Killeen, P. R., & Fetterman, J. G. (1988). A behavioral theory of timing. Psychological Review, 95(2), 274–295. https://doi.org/10.1037/0033-295X.95.2.274
  • Kono, M. (2025). Multidimensional analysis of pigeons’ behavior under ratio and interval schedules using a video tracking system: A pilot study. The Psychological Record, 75, 17–22. https://doi.org/10.1007/s40732-024-00622-z
  • Lattal, K. A. (2010). Delayed reinforcement of operant behavior. Journal of the Experimental Analysis of Behavior, 93(1), 129–139. https://doi.org/10.1901/jeab.2010.93-129
  • Lejeune, H., & Wearden, J. H. (1991). The comparative psychology of fixed-interval responding: Some quantitative analyses. Learning and Motivation, 22(1–2), 84–111. https://doi.org/10.1016/0023-9690(91)90018-4
  • Machado, A. (1997). Learning the temporal dynamics of behavior. Psychological Review, 104(2), 241–265. https://doi.org/10.1037/0033-295X.104.2.241
  • Martínez-Herrada, A., Pellón, R., & López-Tolsa, G. E. (2025). Temporal distribution of schedule-induced behavior depends on the essential value of the reinforcer. Journal of the Experimental Analysis of Behavior, 123(1), 10–29. https://doi.org/10.1002/jeab.4235
  • Mazur, J. E., & Vaughan, W., Jr. (1987). Molar optimization versus delayed reinforcement as explanations of choice between fixed-ratio and progressive-ratio schedules. Journal of the Experimental Analysis of Behavior, 48(2), 251–261. https://doi.org/10.1901/jeab.1987.48-251
  • Nevin, J. A. (1974). Response strength in multiple schedules. Journal of the Experimental Analysis of Behavior, 21(3), 389–408. https://doi.org/10.1901/jeab.1974.21-389
  • Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. Behavioral and Brain Sciences, 23(1), 73–90. https://doi.org/10.1017/S0140525X00002405
  • Schneider, B. A. (1969). A two-state analysis of fixed-interval responding in the pigeon. Journal of the Experimental Analysis of Behavior, 12(5), 677–687. https://doi.org/10.1901/jeab.1969.12-677
  • Schneider, B. A., & Neuringer, A. J. (1972). Responding under discrete-trial fixed-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 18(2), 187–199. https://doi.org/10.1901/jeab.1972.18-187
  • Sheridan, D. J., Rapp, J. T., Anderson, A. N., Edgemon, A. K., Pinkston, J. W., & Walker, E. J. (2025). Effects of rules on schedule performance with synchronous schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 124(1), Article e70022. https://doi.org/10.1002/jeab.70022
  • Shull, R. L. (1970a). A response-initiated fixed-interval schedule of reinforcement. Journal of the Experimental Analysis of Behavior, 13(1), 13–15. https://doi.org/10.1901/jeab.1970.13-13
  • Shull, R. L. (1970b). The response-reinforcement dependency in fixed-interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 14(1), 55–60. https://doi.org/10.1901/jeab.1970.14-55
  • Shull, R. L., Gaynor, S. T., & Grimes, J. A. (2001). Response rate viewed as engagement bouts: Effects of relative reinforcement and schedule type. Journal of the Experimental Analysis of Behavior, 75(3), 247–274. https://doi.org/10.1901/jeab.2001.75-247
  • Sidman, M. (1956). Time discrimination and behavioral interaction in a free operant situation. Journal of Comparative and Physiological Psychology, 49(5), 469–473. https://doi.org/10.1037/h0041892
  • Skinner, B. F. (1948). ‘Superstition’ in the pigeon. Journal of Experimental Psychology, 38(2), 168–172. https://doi.org/10.1037/h0055873
  • Staddon, J. E. R., & Simmelhag, V. L. (1971). The ‘superstition’ experiment: A reexamination of its implications for the principles of adaptive behavior. Psychological Review, 78(1), 3–43. https://scholars.duke.edu/publication/659947
  • Wearden, J. H., & Lejeune, H. (2008). Scalar properties in human timing: Conformity and violations. Quarterly Journal of Experimental Psychology, 61(4), 569–587. https://doi.org/10.1080/17470210701282576
  • Wilson, M. P., & Keller, F. S. (1953). On the selective reinforcement of spaced responses. Journal of Comparative and Physiological Psychology, 46(3), 190–193. https://doi.org/10.1037/h0057705