alcohol problem, these authors attempted to see if the probability of a homicide was correlated with the ownership of a gun.
There are many problems with Kellermann et al.'s paper that undercut the misleading impression that victims were killed by the gun in the
home. For example, they fail to report that in only 8 of these 444 homicide cases could it be established that the "gun involved had been kept in the home." 8 More important, the question posed by the authors cannot be tested properly using their chosen methodology because of the endogeneity problem discussed earlier with respect to cross-sectional data.
To demonstrate this, suppose that the same statistical method—with a matching control group—was used to do an analogous study on the efficacy of hospital care. Assume that we collected data just as these authors did; that is, we got a list of all the people who died in a particular county over the period of a year, and we asked their relatives whether they had been admitted to a hospital during the previous year. We would also put together a control sample with people of similar ages, sex, race, and neighborhoods, and ask these men and women whether they had been in a hospital during the past year. My bet is that we would find a very strong positive relationship between those who spent time in hospitals and those who died, quite probably a stronger relationship than in Kellermann's study on homicides and gun ownership. If so, would we take that as evidence that hospitals kill people? I would hope not. We would understand that, although our methods controlled for age, sex, race, and neighborhood, the people who had visited a hospital during the past year and the people in the "control" sample who did not visit a hospital were really not the same types of people. The difference is pretty obvious: those hospitalized were undoubtedly sick, and thus it should come as no surprise that they would face a higher probability of dying.
The relationship between homicides and gun ownership is no different. The finding that those who are more likely to own guns suffer a higher homicide rate makes us ask, Why were they more likely to own guns? Could it be that they were at greater risk of being attacked? Is it possible that this difference arose because of a higher rate of illegal activities among those in the case study group than among those in the control group? Owning a gun could lower the probability of attack but still leave it higher than the probability faced by those who never felt the need to buy a gun to begin with. The fact that all or virtually all the homicide victims were killed by weapons brought into their homes by intruders makes this all the more plausible.
Unfortunately, the case study method was not designed for studying these types of social issues. Compare these endogeneity concerns with a laboratory experiment to test the effectiveness of a new drug. Some patients with the disease are provided with the drug, while others are given a placebo. The random assignment of who gets the drug and who receives the placebo is extremely important. A comparable approach to the
HOW TO TEST THE EFFECTS OF GUN CONTROL/25
link between homicide and guns would have researchers randomly place guns inside certain households and also randomly determine in which households guns would be forbidden. Who receives a gun would not be determined by other factors that might themselves be related to whether a person faces a high probability of being killed.
So how does one solve this causation problem? Think for a moment about the preceding hospital example. One approach would be to examine a change in something like the cost of going to hospitals. For example, if the cost of going to hospitals fell, one could see whether some people who would otherwise not have gone to the hospital would now seek help there. As we observed an increase in the number of people going to hospitals, we could then check to see whether this was