Rubin Causal Model
Encyclopedia
The Rubin Causal Model is an approach to the statistical analysis of cause and effect
based on the framework
of potential outcomes. RCM is named after Donald Rubin
, Professor
of Statistics
at Harvard University
. The name Rubin causal model was first coined by
Rubin's graduate school colleague, Paul Holland
.
The assignment mechanism is the explanation for why some units received the treatment and others the control. In observational data, there is a non-random assignment mechanism: in the case of college attendance, people may choose to attend a private versus a public college based on their financial situation, parents' education, relative ranks of the schools they were admitted to, etc. If all of these factors can be balanced between the two groups of public and private college students, then the effect of the college attendance can be attributed to the college choice.
Many statistical methods have been developed for causal inference, such as propensity score
matching
and nearest-neighbor matching (which often uses the Mahalanobis metric, also called Mahalanobis matching). These methods attempt to correct for the assignment mechanism by finding control units similar to treatment units. In the example, matching finds graduates of a public college most similar to graduates of a private college, so that like is compared only with like.
Causal inference methods make few assumptions other than that one unit's outcomes are unaffected by another unit's treatment assignment, the stable unit treatment value assumption (SUTVA).
According to the RCM, the causal effect of your taking or not taking aspirin one hour ago is the difference between how your head would have felt in case 1 (taking the aspirin) and case 2 (not taking the aspirin). If your headache would remain without aspirin but disappear if you took aspirin, then the causal effect of taking aspirin is headache relief.
Suppose that Joe is participating in an FDA test for a new hypertension drug. If we are omniscient, we can see the outcomes for Joe under both the treatment (drug) and control (placebo) conditions and know the treatment effect.
is the change in Joe's blood pressure
if he takes the pill. In general, this notation expresses the effect of a treatment, t, on a unit, u. Similarly,
is the effect of a different treatment, c or control, on a unit, u. In this case, 
is the change in Joe's blood pressure if he doesn't take the pill. 
is the causal effect of taking the drug.
From this table we only know the causal effect on Joe. Everyone else in the study might have an increase in blood pressure. However, regardless of what the causal effect is for the other subjects, the causal effect for Joe is a decrease in blood pressure.
Consider a larger sample of patients:
The causal effect is different for every subject, but the drug works for everyone because everyone's blood pressure decreases.
one unit should be unaffected by the particular assignment
of treatments to the other units” (Cox 1958, §2.4). This is called the Stable Unit Treatment Value Assumption (SUTVA), which goes beyond the concept of independence.
In the context of our example, Joe's change in blood pressure may not depend on whether or not Mary receives the drug. Suppose that Joe and Mary live in the same house. Mary always cooks. If Mary does not take the drug she will not cook salty foods, but if she does take the drug she will cook salty foods. A high salt diet increases Joe's blood pressure. Therefore, his response will depend on which treatment Mary receives. [Note that if it's a blinded trial, Mary doesn't know if she gets the active or placebo drug, so another example is probably better.]
SUTVA violation makes causal inference more difficult. We can account for dependent observations by considering more treatments. We create 4 treatments by taking into account whether or not Mary receives treatment.
Now there are multiple causal effects. One is the causal effect of the drug on Joe when Mary receives treatment and is calculated,
. Another is the causal effect on Joe when Mary does not receive treatment and is calculated 
. The third is the causal effect of Mary on Joe, and is calculated 
. The treatment Mary receives has a greater causal effect for Joe than the assignment of treatment to Joe.
With additional treatments, SUTVA holds. However, if any units other than Joe are dependent on Mary, then we must consider further treatments. The greater the number of dependent units, the more treatments we must consider and the more complex the calculations become (consider an experiment with 20 different causal effects). In order to determine the causal effect using only two treatments, the observations must be independent.
Consider an example where not all subjects benefit from the drug.
One may calculate the average causal effect by taking the mean of all the causal effects or by subtracting the mean change under control from the mean change under treatment. Although the average causal effect is a decrease in blood pressure, the causal effect for Joe is an increase in blood pressure. Joe would never want to take the drug.
How we measure the response affects what inferences we draw. Suppose that we measure changes in blood pressure as a percentage change:
This measurement suggests the opposite conclusion, that the average causal effect is an increase in blood pressure. One obtains this result because the positive change in blood pressure for Joe is a larger percentage of his blood pressure. This would occur if Joe's blood pressure is lower than the blood pressure of the other subjects. For example, Joe's blood pressure is 140 and increase by 14 mm Hg, an increase of 10%. If Mary's blood pressure is 200 mm Hg and her blood pressure increases by 14 mm Hg, then her blood pressure only increases by 7%. Consequently, a small absolute change in blood pressure would yield a larger percentage change for Joe.
Question marks are responses that could not be observed. Some scholars call the impossibility of observing responses to multiple treatments on the same subject over a given period of time the Fundamental Problem of Causal Inference. The FPCI makes observing causal effects impossible. However, this does not make causal inference impossible. Certain techniques and assumptions allow the FPCI to be overcome.
Suppose that we want to determine the causal effect of the drug on Joe. The FPCI makes it impossible to observe the causal effect so we must determine the average causal effect instead. To do this, we could instruct Joe to repeat the experiment each month for 6 consecutive months. At the beginning of each month, we would flip a coin to determine which treatment he receives. The results of this experiment follow:
Suppose that Joe could only choose to take the drug for all 6 months or not take the drug at all. During one of the months Joe's blood pressure increases when he takes the drug. However, it could have been even higher if he had not taken the drug. Joe would, on average, benefit from the drug because the average causal effect is a decrease in blood pressure. Even if he knew that he would be better off not taking the drug in February, it would most likely be in his overall interest to choose the drug for the entire duration of the study.
In order for us to conclude that the average causal effect of the pill is a decrease in Joe's blood pressure, we must make certain assumptions. Joe's responses must be independent of each other. Joe's response during any month must not be affected by the treatments he receives during any other month. His taking the drug in January should not affect his response to the control in February. If this assumption does not hold, perhaps because the drug remains in the blood stream, we would have to consider multiple treatments. By making each treatment a combination of the treatment Joe received the previous month and the treatment he would receive the following month, we would create 4 treatments:
Using these different treatments would restore independence. However, as responses become dependent on more than one treatment assignment, the number of treatments becomes exponentially greater, and determining average causal effect becomes more complex. In this example, we would have to determine three different causal effects. The first is the causal effect of the drug on Joe when Joe takes the drug the month before. The second is the causal effect of the drug on Joe when Joe does not take the drug the month before. The third is the causal effect of taking the drug on Joe when he does not take the
We can infer what Joe's response to the unobserved treatment would be if we make an assumption of constant effect. This means that the causal effect is the same at different times, no different in March than it is in April. If the causal effect is always the same, then the average causal effect equals the causal effect. Therefore, knowing the average causal effect and observing one response, we can calculate the other response.
and
Since the average causal effect for Joe is a reduction in blood pressure, an assumption of constant effect suggests that the drug would always reduce his blood pressure.
Mary's and Susie's blood pressures increase when they take the drug. We do not know the causal effect of the drug on Susie or Mary because we do not know their responses under control.
If we wanted to infer the unobserved values we could make an assumption of either constant effect or homogeneity, an even stronger assumption than constant effect. If the subjects are all the same or homogeneous, then they would all have the same response to the treatment and the same response to the control. Mathematically,
where 1 and 2 are units being tested for homogeneity. As causal effect equals 
, the causal effect would be the same for all of them. The following tables illustrate data that supports assumptions of constant effect, homogeneity, or both:
All of the subjects have the same causal effect even though they have different responses to the treatments. This data supports the assumption of constant effect, but does not support the assumption of homogeneity.
These subjects have the same responses to the treatment and consequently, the same causal effect. This makes them homogeneous. This data supports the assumptions of both constant effect and homogeneity.
If the assumption of homogeneity holds, then the average causal effect equals the causal effect for every unit. Knowing the average causal effect and having observed the response to one treatment for each unit, one can determine the response to the other treatment. One cannot apply this assumption to the data in this example because the responses are different for every subject.
This is the true average causal effect. Assigning treatments randomly, we calculate another causal effect.
Under the same mechanism another random assignment of treatments yields yet another average causal effect.
The average causal effect varies because our sample is small and the responses have a large variance
. If the sample were larger and the variance were less, the average causal effect would be closer to the true average causal effect.
Alternatively, suppose the mechanism assigns the treatment to all men and only to them.
Under this assignment mechanism, it is impossible for women to receive treatment and therefore impossible to determine the average causal effect on female subjects. In order to make any inferences of causal effect on a subject, the probability that the subject receive treatment must be greater than 0 and less than 1.
Based on this knowledge she would make the following treatment assignments:
The perfect doctor distorts both averages by filtering out poor responses to both the treatment and control. The difference between means, which is the supposed average causal effect, is distorted in a direction that depends on details. For instance, a subject like Susie who is harmed by taking the drug would be assigned to the control group by the perfect doctor and thus the negative effect of the drug would be masked.
If matched units are homogeneous, then they have the same causal effect. This means that they have the same average causal effect. Therefore, if all units are perfectly matched, the average causal effect equals the causal effect.
Propensity score
is often used for matching when there are multiple attributes.
(2000), the Rubin Causal Model (RCM) is subsumed by the Structural Equation Model (SEM)
used in econometrics and the social sciences, in its extended nonparametric form. That view,
which has long been argued by Heckman
(2005) is presented formally in Pearl (2000). The key connection between the RCM and SEM rests on interpreting the "potential outcome" variable Yx(u) to be the solution for variable Y in a modified structural model, in which the external intervention X=x is emulated by replacing the equation that determines X by the
constant equation X=x.
The variable u, which in the RCM stands for the identity
of each experimental unit (e.g., a patient or an agricultural lot,)
is represented in the SEM formulation by a vector of exogeneous
variables (usually unobserved) that characterize that unit.
With this interpretation, every theorem in RCM can be shown to be
a theorem in SEM and vice versa.
This interpretation has led to a complete axiomatization of RCM and,
based on the derivations of Shpitser-Pearl (2006), a complete
solution to the identification of causal effects, using graphs.
Complete solution means that,
for any subset X of variables and a set A of causal assumptions
encoded in a graph G, it is possible
to determine algorithmically whether the causal effect P(Yx = y)
can be estimated consistently from non-experimental data and,
if so, what form the estimand of P(Yx = y) should have.
Using that estimand, it is possible then to estimate, from
observational study, the average causal effect over the population:
.
From the perspective of Pearl and his colleagues, a major shortcoming of RCM is that all assumptions and background knowledge pertaining to a given problem must first be translated into the language of counterfactuals (e.g., ignorability) before analysis can commence. In SEM, by comparison, Pearl (2000) and Heckman (2008)
hold that background knowledge is expressed directly in the
vocabulary of ordinary scientific discourse, invoking cause-effect
relationships among realizable, not hypothetical variables.
The Rubin causal model has also been connected to instrumental variables
(Angrist, Imbens, and Rubin, 1996) and other techniques for causal
inference. For more on the connections between the Rubin causal model, structural equation modeling, and other statistical methods for causal inference, see Morgan and Winship (2007) and Pearl (2009).
Causality
Causality is the relationship between an event and a second event , where the second event is understood as a consequence of the first....
based on the framework
Conceptual framework
A conceptual framework is used in research to outline possible courses of action or to present a preferred approach to an idea or thought. For example, the philosopher Isaiah Berlin used the "hedgehogs" versus "foxes" approach; a "hedgehog" might approach the world in terms of a single organizing...
of potential outcomes. RCM is named after Donald Rubin
Donald Rubin
Donald Bruce Rubin is the John L. Loeb Professor of Statistics at Harvard University. He was hired by Harvard in 1984, and served as chair of the department from 1985-1994....
, Professor
Professor
A professor is a scholarly teacher; the precise meaning of the term varies by country. Literally, professor derives from Latin as a "person who professes" being usually an expert in arts or sciences; a teacher of high rank...
of Statistics
Statistics
Statistics is the study of the collection, organization, analysis, and interpretation of data. It deals with all aspects of this, including the planning of data collection in terms of the design of surveys and experiments....
at Harvard University
Harvard University
Harvard University is a private Ivy League university located in Cambridge, Massachusetts, United States, established in 1636 by the Massachusetts legislature. Harvard is the oldest institution of higher learning in the United States and the first corporation chartered in the country...
. The name Rubin causal model was first coined by
Rubin's graduate school colleague, Paul Holland
Paul Holland
Paul Holland is a former English footballer who made over 300 appearances in the Football League for Mansfield Town, Sheffield United, Chesterfield and Bristol City and was capped four times for the England U21s. He is a former manager of Mansfield Town.-Career:As a player, Holland was a combative...
- a similar causal framework was proposed by Jerzy NeymanJerzy NeymanJerzy Neyman , born Jerzy Spława-Neyman, was a Polish American mathematician and statistician who spent most of his professional career at the University of California, Berkeley.-Life and career:...
in his 1923 Master's thesi
.
Introduction
The Rubin Causal Model is based in the idea of potential outcomes and the assignment mechanism: every unit has different potential outcomes depending on their "assignment" to a condition. For instance, someone may have one income at age 40 if they attend a private college and a different income at age 40 if they attend a public college. To measure the causal effect of going to a public versus a private college, the investigator should look at the outcome for the same individual in both alternative futures. Since it is impossible to see both potential outcomes at once, one of the potential outcomes is always missing. A randomized experiment works by assigning people randomly to (in this case) public or private college; because the assignment was random, the groups are (on average) equivalent, and the difference in income at age 40 can be attributed to the college assignment since that was the only difference between the groups.The assignment mechanism is the explanation for why some units received the treatment and others the control. In observational data, there is a non-random assignment mechanism: in the case of college attendance, people may choose to attend a private versus a public college based on their financial situation, parents' education, relative ranks of the schools they were admitted to, etc. If all of these factors can be balanced between the two groups of public and private college students, then the effect of the college attendance can be attributed to the college choice.
Many statistical methods have been developed for causal inference, such as propensity score
Propensity score
In the design of experiments, a propensity score is the probability of a unit being assigned to a particular condition in a study given a set of known covariates...
matching
Matching (statistics)
Matching is a statistical technique which is used to evaluate the effect of a treatment by comparing the treated and the non-treated in non experimental design . People use this technique with observational data...
and nearest-neighbor matching (which often uses the Mahalanobis metric, also called Mahalanobis matching). These methods attempt to correct for the assignment mechanism by finding control units similar to treatment units. In the example, matching finds graduates of a public college most similar to graduates of a private college, so that like is compared only with like.
Causal inference methods make few assumptions other than that one unit's outcomes are unaffected by another unit's treatment assignment, the stable unit treatment value assumption (SUTVA).
An extended example
Rubin defines a causal effect:
Intuitively, the causal effect of one treatment, E, over another, C, for a particular unit and an interval of time fromto
is the difference between what would have happened at time
if the unit had been exposed to E initiated at
and what would have happened at
if the unit had been exposed to C initiated at
: 'If an hour ago I had taken two aspirins instead of just a glass of water, my headache would now be gone,' or because an hour ago I took two aspirins instead of just a glass of water, my headache is now gone.' Our definition of the causal effect of the E versus C treatment will reflect this intuitive meaning.
According to the RCM, the causal effect of your taking or not taking aspirin one hour ago is the difference between how your head would have felt in case 1 (taking the aspirin) and case 2 (not taking the aspirin). If your headache would remain without aspirin but disappear if you took aspirin, then the causal effect of taking aspirin is headache relief.
Suppose that Joe is participating in an FDA test for a new hypertension drug. If we are omniscient, we can see the outcomes for Joe under both the treatment (drug) and control (placebo) conditions and know the treatment effect.
| subject |  |  |  |
|---|---|---|---|
| Joe | -5 | 5 | -10 |
is the change in Joe's blood pressureBlood pressure
Blood pressure is the pressure exerted by circulating blood upon the walls of blood vessels, and is one of the principal vital signs. When used without further specification, "blood pressure" usually refers to the arterial pressure of the systemic circulation. During each heartbeat, BP varies...
if he takes the pill. In general, this notation expresses the effect of a treatment, t, on a unit, u. Similarly,
is the effect of a different treatment, c or control, on a unit, u. In this case, is the change in Joe's blood pressure if he doesn't take the pill. is the causal effect of taking the drug.From this table we only know the causal effect on Joe. Everyone else in the study might have an increase in blood pressure. However, regardless of what the causal effect is for the other subjects, the causal effect for Joe is a decrease in blood pressure.
Consider a larger sample of patients:
| subject |  |  |  |
|---|---|---|---|
| Joe | -5 | 5 | -10 |
| Mary | -10 | -5 | -5 |
| Sally | 0 | 10 | -10 |
| Bob | -20 | -5 | -15 |
The causal effect is different for every subject, but the drug works for everyone because everyone's blood pressure decreases.
Stable unit treatment value assumption (SUTVA)
We require “the [potential outcome] observation onone unit should be unaffected by the particular assignment
of treatments to the other units” (Cox 1958, §2.4). This is called the Stable Unit Treatment Value Assumption (SUTVA), which goes beyond the concept of independence.
In the context of our example, Joe's change in blood pressure may not depend on whether or not Mary receives the drug. Suppose that Joe and Mary live in the same house. Mary always cooks. If Mary does not take the drug she will not cook salty foods, but if she does take the drug she will cook salty foods. A high salt diet increases Joe's blood pressure. Therefore, his response will depend on which treatment Mary receives. [Note that if it's a blinded trial, Mary doesn't know if she gets the active or placebo drug, so another example is probably better.]
SUTVA violation makes causal inference more difficult. We can account for dependent observations by considering more treatments. We create 4 treatments by taking into account whether or not Mary receives treatment.
| subject | Joe = c, Mary = t | Joe = t, Mary = t | Joe = c, Mary = c | Joe = t, Mary = c |
|---|---|---|---|---|
| Joe | 20 | 10 | 5 | 0 |
Now there are multiple causal effects. One is the causal effect of the drug on Joe when Mary receives treatment and is calculated,
. Another is the causal effect on Joe when Mary does not receive treatment and is calculated . The third is the causal effect of Mary on Joe, and is calculated . The treatment Mary receives has a greater causal effect for Joe than the assignment of treatment to Joe.With additional treatments, SUTVA holds. However, if any units other than Joe are dependent on Mary, then we must consider further treatments. The greater the number of dependent units, the more treatments we must consider and the more complex the calculations become (consider an experiment with 20 different causal effects). In order to determine the causal effect using only two treatments, the observations must be independent.
Consider an example where not all subjects benefit from the drug.
| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | -5 | 15 |
| Mary | 0 | 5 | |
| Sally | -20 | 5 | -25 |
| Bob | -10 | 10 | -20 |
| James | -5 | 0 | -5 |
| MEAN | -5 | 3 | -8 |
One may calculate the average causal effect by taking the mean of all the causal effects or by subtracting the mean change under control from the mean change under treatment. Although the average causal effect is a decrease in blood pressure, the causal effect for Joe is an increase in blood pressure. Joe would never want to take the drug.
How we measure the response affects what inferences we draw. Suppose that we measure changes in blood pressure as a percentage change:
| subject |  |  |  |
|---|---|---|---|
| Joe | 12 | -6 | 18 |
| Mary | 0 | 1 | -1 |
| Sally | -8 | 2 | -10 |
| Bob | -1 | 1 | -2 |
| James | -1 | 0 | -1 |
| MEAN | 0.4% | -0.4% | 0.8% |
This measurement suggests the opposite conclusion, that the average causal effect is an increase in blood pressure. One obtains this result because the positive change in blood pressure for Joe is a larger percentage of his blood pressure. This would occur if Joe's blood pressure is lower than the blood pressure of the other subjects. For example, Joe's blood pressure is 140 and increase by 14 mm Hg, an increase of 10%. If Mary's blood pressure is 200 mm Hg and her blood pressure increases by 14 mm Hg, then her blood pressure only increases by 7%. Consequently, a small absolute change in blood pressure would yield a larger percentage change for Joe.
The fundamental problem of causal inference
The results we have seen up to this point would never be observed in practice. It is impossible to observe the effect of more than one treatment on a subject at one time. Joe cannot both take the pill and not take the pill at the same time. Therefore, the data would look something like this:| subject |  |  |  |
|---|---|---|---|
| Joe | -5 | ? | ? |
Question marks are responses that could not be observed. Some scholars call the impossibility of observing responses to multiple treatments on the same subject over a given period of time the Fundamental Problem of Causal Inference. The FPCI makes observing causal effects impossible. However, this does not make causal inference impossible. Certain techniques and assumptions allow the FPCI to be overcome.
Suppose that we want to determine the causal effect of the drug on Joe. The FPCI makes it impossible to observe the causal effect so we must determine the average causal effect instead. To do this, we could instruct Joe to repeat the experiment each month for 6 consecutive months. At the beginning of each month, we would flip a coin to determine which treatment he receives. The results of this experiment follow:
| date |  |  |  |
|---|---|---|---|
| January | -5 | ? | ? |
| February | 10 | ? | ? |
| March | ? | 10 | ? |
| April | -20 | ? | ? |
| May | ? | 5 | ? |
| June | ? | 15 | ? |
| MEAN | -5 | 10 | -15 |
Suppose that Joe could only choose to take the drug for all 6 months or not take the drug at all. During one of the months Joe's blood pressure increases when he takes the drug. However, it could have been even higher if he had not taken the drug. Joe would, on average, benefit from the drug because the average causal effect is a decrease in blood pressure. Even if he knew that he would be better off not taking the drug in February, it would most likely be in his overall interest to choose the drug for the entire duration of the study.
In order for us to conclude that the average causal effect of the pill is a decrease in Joe's blood pressure, we must make certain assumptions. Joe's responses must be independent of each other. Joe's response during any month must not be affected by the treatments he receives during any other month. His taking the drug in January should not affect his response to the control in February. If this assumption does not hold, perhaps because the drug remains in the blood stream, we would have to consider multiple treatments. By making each treatment a combination of the treatment Joe received the previous month and the treatment he would receive the following month, we would create 4 treatments:
| subject | Joe = 0, last month = 1 | Joe = 1, last month = 1 | Joe = 0, last month = 0 | Joe = 1, last month = 0 |
|---|---|---|---|---|
| Joe | 20 | 10 | 5 | 0 |
Using these different treatments would restore independence. However, as responses become dependent on more than one treatment assignment, the number of treatments becomes exponentially greater, and determining average causal effect becomes more complex. In this example, we would have to determine three different causal effects. The first is the causal effect of the drug on Joe when Joe takes the drug the month before. The second is the causal effect of the drug on Joe when Joe does not take the drug the month before. The third is the causal effect of taking the drug on Joe when he does not take the
We can infer what Joe's response to the unobserved treatment would be if we make an assumption of constant effect. This means that the causal effect is the same at different times, no different in March than it is in April. If the causal effect is always the same, then the average causal effect equals the causal effect. Therefore, knowing the average causal effect and observing one response, we can calculate the other response.
and
Since the average causal effect for Joe is a reduction in blood pressure, an assumption of constant effect suggests that the drug would always reduce his blood pressure.
Multiple subjects
Another way to determine average causal effect is to use multiple subjects:| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | ? | ? |
| Mary | ? | 5 | ? |
| Sally | -20 | ? | ? |
| Bob | ? | 10 | ? |
| James | ? | 0 | ? |
| MEAN | -5 | 5 | 10 |
Mary's and Susie's blood pressures increase when they take the drug. We do not know the causal effect of the drug on Susie or Mary because we do not know their responses under control.
If we wanted to infer the unobserved values we could make an assumption of either constant effect or homogeneity, an even stronger assumption than constant effect. If the subjects are all the same or homogeneous, then they would all have the same response to the treatment and the same response to the control. Mathematically,
where 1 and 2 are units being tested for homogeneity. As causal effect equals , the causal effect would be the same for all of them. The following tables illustrate data that supports assumptions of constant effect, homogeneity, or both:| subject |  |  |  |
|---|---|---|---|
| Joe | 15 | 20 | -5 |
| Mary | 5 | 10 | -5 |
| Sally | -5 | 0 | -5 |
| Bob | 0 | 5 | -5 |
| James | -10 | -5 | -5 |
| MEAN | 1 | 6 | -5 |
All of the subjects have the same causal effect even though they have different responses to the treatments. This data supports the assumption of constant effect, but does not support the assumption of homogeneity.
| subject |  |  |  |
|---|---|---|---|
| Joe | -5 | 0 | -5 |
| Mary | -5 | 0 | -5 |
| Sally | -5 | 0 | -5 |
| Bob | -5 | 0 | -5 |
| James | -5 | 0 | -5 |
| MEAN | -5 | 0 | -5 |
These subjects have the same responses to the treatment and consequently, the same causal effect. This makes them homogeneous. This data supports the assumptions of both constant effect and homogeneity.
If the assumption of homogeneity holds, then the average causal effect equals the causal effect for every unit. Knowing the average causal effect and having observed the response to one treatment for each unit, one can determine the response to the other treatment. One cannot apply this assumption to the data in this example because the responses are different for every subject.
The assignment mechanism
The assignment mechanism, the method by which units are assigned treatment, affects the calculation of the average causal effect. One such assignment mechanism is randomization. For each subject we could flip a coin to determine if she receives treatment. If we wanted five subjects to receive treatment, we could assign treatment to the first five names we pick out of a hat. When we randomly assign treatments we may get different answers.| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | -5 | 15 |
| Mary | 0 | 5 | -5 |
| Sally | -20 | 5 | -25 |
| Bob | -10 | 10 | -20 |
| James | -5 | 0 | -5 |
| MEAN | -5 | 3 | -8 |
This is the true average causal effect. Assigning treatments randomly, we calculate another causal effect.
| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | ? | ? |
| Mary | 0 | ? | ? |
| Sally | ? | 5 | ? |
| Bob | ? | 10 | ? |
| James | -5 | ? | ? |
| MEAN | 1.66 | 7.5 | -5.83 |
Under the same mechanism another random assignment of treatments yields yet another average causal effect.
| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | ? | ? |
| Mary | 0 | ? | ? |
| Sally | -20 | ? | ? |
| Bob | ? | 10 | ? |
| James | ? | 0 | ? |
| MEAN | -3.33 | 5 | -8.33 |
The average causal effect varies because our sample is small and the responses have a large variance
Variance
In probability theory and statistics, the variance is a measure of how far a set of numbers is spread out. It is one of several descriptors of a probability distribution, describing how far the numbers lie from the mean . In particular, the variance is one of the moments of a distribution...
. If the sample were larger and the variance were less, the average causal effect would be closer to the true average causal effect.
Alternatively, suppose the mechanism assigns the treatment to all men and only to them.
| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | ? | ? |
| Bob | -10 | ? | ? |
| James | -15 | ? | ? |
| Mary | ? | 10 | ? |
| Sally | ? | 5 | ? |
| Susie | ? | 15 | ? |
| MEAN | -5 | 10 | -15 |
Under this assignment mechanism, it is impossible for women to receive treatment and therefore impossible to determine the average causal effect on female subjects. In order to make any inferences of causal effect on a subject, the probability that the subject receive treatment must be greater than 0 and less than 1.
The perfect doctor
Consider the use of the perfect doctor as an assignment mechanism. The perfect doctor knows how each subject will respond to the drug or the control and assigns each subject to the treatment that will most benefit her. The perfect doctor knows this information about a sample of patients:| subject |  |  |  |
|---|---|---|---|
| Joe | 10 | -5 | 15 |
| Bob | 0 | 5 | -5 |
| James | -50 | 5 | 45 |
| Mary | -10 | 10 | -20 |
| Sally | -20 | 15 | -35 |
| Susie | 10 | -20 | 30 |
| MEAN | -10 | 1.7 | -11.7 |
Based on this knowledge she would make the following treatment assignments:
| subject |  |  |  |
|---|---|---|---|
| Joe | ? | -5 | ? |
| Bob | 0 | ? | ? |
| James | -50 | ? | ? |
| Mary | -10 | ? | ? |
| Sally | -20 | ? | ? |
| Susie | ? | -20 | ? |
| MEAN | -18 | -12.5 | -5.5 |
The perfect doctor distorts both averages by filtering out poor responses to both the treatment and control. The difference between means, which is the supposed average causal effect, is distorted in a direction that depends on details. For instance, a subject like Susie who is harmed by taking the drug would be assigned to the control group by the perfect doctor and thus the negative effect of the drug would be masked.
Matching
Another approach to estimation of causal effect is matching or pairing similar units, as an approximation to observing the same unit twice. If an experiment is possible, match units with identical or most similar attributes; randomly assign treatment to one and control to the other unit in each pair.| subject | sex | blood pressure |  |  |  |
|---|---|---|---|---|---|
| Joe | male | 180 | ? | -15 | ? |
| Bob | male | 180 | -20 | ? | ? |
| James | male | 160 | -10 | ? | ? |
| Paul | male | 160 | ? | -5 | ? |
| Mary | female | 180 | 5 | ? | ? |
| Sally | female | 180 | ? | 10 | ? |
| Susie | female | 160 | 5 | ? | ? |
| Jen | female | 160 | ? | 10 | ? |
| MEAN | 170 | -5 | 0 | -5 |
If matched units are homogeneous, then they have the same causal effect. This means that they have the same average causal effect. Therefore, if all units are perfectly matched, the average causal effect equals the causal effect.
Propensity score
Propensity score
In the design of experiments, a propensity score is the probability of a unit being assigned to a particular condition in a study given a set of known covariates...
is often used for matching when there are multiple attributes.
Conclusion
The causal effect of a treatment on a single unit at a point in time is the difference between the outcome variable with the treatment and without the treatment. The Fundamental Problem of Causal Inference is that it is impossible to observe the causal effect on a single unit. You either take the aspirin now or you don't. As a consequence, assumptions must be made in order to estimate the missing counterfactuals.Relations to other approaches
In the view of PearlJudea Pearl
Judea Pearl is a computer scientist and philosopher, best known for developing the probabilistic approach to artificial intelligence and the development of Bayesian networks ....
(2000), the Rubin Causal Model (RCM) is subsumed by the Structural Equation Model (SEM)
Structural equation modeling
Structural equation modeling is a statistical technique for testing and estimating causal relations using a combination of statistical data and qualitative causal assumptions...
used in econometrics and the social sciences, in its extended nonparametric form. That view,
which has long been argued by Heckman
James Heckman
James Joseph Heckman is an American economist and Nobel laureate. He is the Henry Schultz Distinguished Service Professor of Economics at the University of Chicago, Professor of Science and Society at University College Dublin and a Senior Research Fellow at the American Bar Foundation.Heckman...
(2005) is presented formally in Pearl (2000). The key connection between the RCM and SEM rests on interpreting the "potential outcome" variable Yx(u) to be the solution for variable Y in a modified structural model, in which the external intervention X=x is emulated by replacing the equation that determines X by the
constant equation X=x.
The variable u, which in the RCM stands for the identity
of each experimental unit (e.g., a patient or an agricultural lot,)
is represented in the SEM formulation by a vector of exogeneous
variables (usually unobserved) that characterize that unit.
With this interpretation, every theorem in RCM can be shown to be
a theorem in SEM and vice versa.
This interpretation has led to a complete axiomatization of RCM and,
based on the derivations of Shpitser-Pearl (2006), a complete
solution to the identification of causal effects, using graphs.
Complete solution means that,
for any subset X of variables and a set A of causal assumptions
encoded in a graph G, it is possible
to determine algorithmically whether the causal effect P(Yx = y)
can be estimated consistently from non-experimental data and,
if so, what form the estimand of P(Yx = y) should have.
Using that estimand, it is possible then to estimate, from
observational study, the average causal effect over the population:
.From the perspective of Pearl and his colleagues, a major shortcoming of RCM is that all assumptions and background knowledge pertaining to a given problem must first be translated into the language of counterfactuals (e.g., ignorability) before analysis can commence. In SEM, by comparison, Pearl (2000) and Heckman (2008)
hold that background knowledge is expressed directly in the
vocabulary of ordinary scientific discourse, invoking cause-effect
relationships among realizable, not hypothetical variables.
The Rubin causal model has also been connected to instrumental variables
(Angrist, Imbens, and Rubin, 1996) and other techniques for causal
inference. For more on the connections between the Rubin causal model, structural equation modeling, and other statistical methods for causal inference, see Morgan and Winship (2007) and Pearl (2009).
External links
- "Rubin Causal Model": an article for the New Palgrave Dictionary of Economics by Guido Imbens and Donald RubinDonald RubinDonald Bruce Rubin is the John L. Loeb Professor of Statistics at Harvard University. He was hired by Harvard in 1984, and served as chair of the department from 1985-1994....
. - "Counterfactual Causal Analysis": a webpage maintained by Stephen MorganStephen MorganStephen Morgan was a U.S. Representative from Ohio.Born in Jackson County, Ohio, Morgan attended the common schools, Central College, Worthington, Ohio, and the National Normal University, Lebanon, Ohio....
, Christopher Winship, and others with links to many research articles on causal inference.