Multiple Baseline Design
Encyclopedia
A multiple baseline design is a style of research involving the careful measurement of multiple persons, traits or settings both before and after a treatment. This design is used in medical, psychological and biological research to name a few areas. It has several advantages over AB designs which only measures a single case. By gathering data from many subjects (instances), inferences can be made about the likeliness that the measured trait generalizes
to a greater population.
In multiple baseline designs, the experimenter starts by measuring a trait of interest, then applying a treatment
before measuring that trait again. Treatment should not begin until a stable baseline has been recorded, and should not finish until measures regain stability. If a significant change occurs across all participants the experimenter may infer
that the treatment is effective.
Multiple base-line experiments are most commonly used in cases where the dependent variable is not expected to return to normal after the treatment has been applied, or when medical reasons forbid the withdrawal of a treatment. They often employ particular methods or recruiting participants. Multiple base-line designs are associated with potential confounds
introduced by an experimenter bias which must be addressed in order to preserve objectivity. Particularly, researchers are advised to develop all test schedules and data collection limits beforehand.
Ex post facto recruitment methods are not considered true experiments, due to the limits of experimental control or randomized control that the experimenter has over the trait. This is because a control group may necessarily be selected from a discrete separate population. This research design is thus considered a quasi-experimental design
.
, and history effects in particular. Concurrent multiple baseline designs are also useful for saving time, since all participants are processed at once. The ability to retrieve complete data sets within well defined time constraints is a valuable asset while planning research.
It is recommended that the experimenter selects time frames beforehand to avoid experimenter bias, but even when methods are used to improve validity, inferences may be weakened. Currently, there is debate as to whether nonconcurrent studies represent a real threat from history effects. It is generally agreed, however, that concurrent testing is more stable.
, time frames, and data limits help control threats due to experimenter bias
. For the same reason researchers should avoid removing participants based on merit.
Multiple probe designs may be useful in identifying extraneous factors which may be influencing your results. Lastly, experimenters should avoid gathering data during sessions alone. If in-session data is gathered a note of the dates should be tagged to each measurement in order to provide an accurate time-line for potential reviewers. This data may represent unnatural behaviour or states of mind, and must be considered carefully during interpretation.
Generalization
A generalization of a concept is an extension of the concept to less-specific criteria. It is a foundational element of logic and human reasoning. Generalizations posit the existence of a domain or set of elements, as well as one or more common characteristics shared by those elements. As such, it...
to a greater population.
In multiple baseline designs, the experimenter starts by measuring a trait of interest, then applying a treatment
Design of experiments
In general usage, design of experiments or experimental design is the design of any information-gathering exercises where variation is present, whether under the full control of the experimenter or not. However, in statistics, these terms are usually used for controlled experiments...
before measuring that trait again. Treatment should not begin until a stable baseline has been recorded, and should not finish until measures regain stability. If a significant change occurs across all participants the experimenter may infer
Inference
Inference is the act or process of deriving logical conclusions from premises known or assumed to be true. The conclusion drawn is also called an idiomatic. The laws of valid inference are studied in the field of logic.Human inference Inference is the act or process of deriving logical conclusions...
that the treatment is effective.
Multiple base-line experiments are most commonly used in cases where the dependent variable is not expected to return to normal after the treatment has been applied, or when medical reasons forbid the withdrawal of a treatment. They often employ particular methods or recruiting participants. Multiple base-line designs are associated with potential confounds
Confounds and Artifacts
Although often used interchangeably, confounds and artifacts refer to two different kinds of threat to the validity of social psychological research....
introduced by an experimenter bias which must be addressed in order to preserve objectivity. Particularly, researchers are advised to develop all test schedules and data collection limits beforehand.
Recruiting participants
Although multiple baseline designs may employ any method of recruitment, it is often associated with "ex post facto" recruitment. This is because multiple baselines can provide data regarding the consensus of a treatment response. Such data can often not be gathered from ABA (reversal) designs for ethical or learning reasons. Experimenters are advised not to remove cases that do not exactly fit their criteria, as this may introduce sampling bias and threaten validity.Ex post facto recruitment methods are not considered true experiments, due to the limits of experimental control or randomized control that the experimenter has over the trait. This is because a control group may necessarily be selected from a discrete separate population. This research design is thus considered a quasi-experimental design
Quasi-experimental design
The design of a quasi-experiment relates to a particular type of experiment or other study in which one has little or no control over the allocation of the treatments or other factors being studied. The key difference in this empirical approach is the lack of random assignment...
.
Concurrent designs
Multiple baseline studies are often categorized as either concurrent or nonconcurrent. Concurrent designs are the traditional approach to multiple baseline studies, where all participants undergo treatment simultaneously. This strategy is advantageous because it moderates several threats to validityValidity (statistics)
In science and statistics, validity has no single agreed definition but generally refers to the extent to which a concept, conclusion or measurement is well-founded and corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong...
, and history effects in particular. Concurrent multiple baseline designs are also useful for saving time, since all participants are processed at once. The ability to retrieve complete data sets within well defined time constraints is a valuable asset while planning research.
Nonconcurrent designs
Nonconcurrent multiple baseline studies apply treatment to several individuals at delayed intervals. This has the advantage of greater flexibility in recruitment of participants and testing location. For this reason, perhaps, nonconcurrent multiple baseline experiments are recommended for research in an educational setting.It is recommended that the experimenter selects time frames beforehand to avoid experimenter bias, but even when methods are used to improve validity, inferences may be weakened. Currently, there is debate as to whether nonconcurrent studies represent a real threat from history effects. It is generally agreed, however, that concurrent testing is more stable.
Disadvantages
Although multiple baseline experimental designs compensate for many of the issues inherent in ex post facto recruitment, experimental manipulation of a trait gathered by this method may not be manipulated. Thus these studies are prevented from inferring causation.Managing threats to validity
A priori (beforehand) specification of the hypothesisHypothesis
A hypothesis is a proposed explanation for a phenomenon. The term derives from the Greek, ὑποτιθέναι – hypotithenai meaning "to put under" or "to suppose". For a hypothesis to be put forward as a scientific hypothesis, the scientific method requires that one can test it...
, time frames, and data limits help control threats due to experimenter bias
Experimenter's bias
In experimental science, experimenter's bias is subjective bias towards a result expected by the human experimenter. David Sackett, in a useful review of biases in clinical studies, states that biases can occur in any one of seven stages of research:...
. For the same reason researchers should avoid removing participants based on merit.
Multiple probe designs may be useful in identifying extraneous factors which may be influencing your results. Lastly, experimenters should avoid gathering data during sessions alone. If in-session data is gathered a note of the dates should be tagged to each measurement in order to provide an accurate time-line for potential reviewers. This data may represent unnatural behaviour or states of mind, and must be considered carefully during interpretation.
External links
- http://allpsych.com/researchmethods/multiplebaselines.html
- https://www.msu.edu/user/sw/ssd/issd10d.htm
- http://findarticles.com/p/articles/mi_hb6516/is_4_41/ai_n29146430/