Explore The NRA Universe Of Websites

APPEARS IN News

Identifying the Problem of Gun Control Research

Friday, April 12, 2019

Identifying the Problem of Gun Control Research

In 2017, anti-gun researcher John Donohue and his team released a study that purported to find that Right to Carry laws increase overall violent crime rates. The paper was updated six months later seemingly to address criticism of its methodology and produced the same conclusion. Readers may be familiar with the study as an anti-gun press fawned over the results without questioning the mechanism of the effect or the methodology itself. 

Economist Carlise E. Moody and lawyer-sociologist Thomas B. Marvell released a critique of the Donohue Right to Carry study recently and concluded that “there is no significant relationship between RTC laws and either murder or violent crime.” 

Moody and Marvell determined that the panel data analysis in the Donohue study is dependent on the use of population weights, which Donohue argues in a response are necessary to avoid implying that the impact of RTC laws on small population states is “equally important” as the impact of the population of the largest states in the Union. 

Despite a spirited argument against Moody and Marvell, Donohue and his co-authors recognize “the difference in results between the population-weighted and unweighted regressions is likely signaling a specification issue.” In other words, the findings depend on the metrics incorporated into the model and the approach used. 

Donohue and his team weighted their data by state population and found RTC laws increase violent crime. Moody and Marvell did not weight by population and found no significant effect of RTC laws on violent crime. The effect is dependent on the weighting. Misspecified models and the misuse of data are two of the most common issues we see in anti-gun research. 

The aspect of the original Donohue study that received the press coverage used a synthetic controls methodology to derive an estimated impact of RTC laws on violent crime. The specific finding is that violent crime is 13%-15% higher after the adoption of RTC laws than it could have been if the state had not adopted RTC. The first question readers may ponder is: how and/or why would RTC laws lead to an increase in violent crime? Law-abiding citizens filling out paperwork, meeting established requirements, and abiding by federal, state, and local laws somehow inspire criminals to commit more crimes? 

Let’s review the reasons according to Donohue, et al.: permit holders may commit crimes they would not have committed without the permit, the culture of gun carrying can promote confrontations, guns may be stolen from people carrying legally, and criminals will find it “increasingly beneficial” to use violence to complete their criminal agenda. Donohue and his team present no more than anecdotal evidence to support these claims. 

Now, consider the synthetic controls methodology. (Where a state is compared to a “synthetic” version of itself created by combining portions of other states). In their first draft, Donohue and his team utilized Hawaii as a contributor to 18 Right to Carry states including Colorado, Kansas, Minnesota, and Nebraska. Donohue revised his approach and included robustness checks in the revised paper, but Moody and Marvell present an additional critique. The synthetic controls methodology could be biased by excluded control variables in both the treatment and control states. 

Much like the specification issue presented in the panel data analyses, the synthetic control methodology is limited by what is missing. That Hawaii was used as a significant component of synthetic Minnesota is amusing, but it really simplifies the missing differences between states. As Moody and Marvell state, “states have certain permanent, or at least long-lived, attributes such as history, tradition, culture, climate, attitudes toward firearms, attitudes toward self-defense, etc., that could affect both crime and the policies adopted to combat crime.” The differences between states should not be overlooked, and restricting the donor pool in any number of ways as a robustness check does not necessarily alleviate this issue – especially when the donor pool of non-Right to Carry states shrinks over the years and more states adopted Right to Carry. 

Moody and Marvell point out that the synthetic controls model cannot control for all relevant factors, pre- and post-treatment, including major factors that cause crime rates to vary. They conclude “the claim that RTC laws increase either murder or violent crime is not supported.” Donohue, et al., present a rebuttal but their original paper helpfully includes charts for the violent crime rate in each RTC state in the appendix. The solid lines are the actual violent crime rate in each state and the dashed lines are the synthetic control version of that state. The vertical line indicates the year RTC was adopted. Go on, take a look. We see more states in which the violent crime rate started to decrease or continued to decrease after RTC than states in which the rate increased. 

But who are you going to believe: the Donohue analysis that overlooks fundamental differences between states or your lying eyes? 

TRENDING NOW
California Using Tax Dollars to Racially Profile Gun Owners

News  

Monday, August 15, 2022

California Using Tax Dollars to Racially Profile Gun Owners

California gun owners have been under siege for the past year - even by the not-so-Golden State’s standards. In September 2021, Governor Gavin Newsom (D) signed AB-173, which allows for the disclosure of highly sensitive ...

Canada’s Liberals Bypass Parliament to Further Gun Control Agenda

News  

Monday, August 15, 2022

Canada’s Liberals Bypass Parliament to Further Gun Control Agenda

Earlier this year, Prime Minister Justin Trudeau’s government introduced Bill C-21, proposing a permanent freeze on the sale, transfer and import of handguns in Canada. The bill remains at the initial stages and did not pass prior to ...

Guide To The Interstate Transportation Of Firearms

Gun Laws  

Thursday, January 1, 2015

Guide To The Interstate Transportation Of Firearms

CAUTION: Federal and state firearms laws are subject to frequent change. This summary is not to be considered as legal advice or a restatement of law.

California: Appropriations Committees Pass Anti-Gun Bills to Floor

Friday, August 12, 2022

California: Appropriations Committees Pass Anti-Gun Bills to Floor

Yesterday, the Appropriations Committees of both chambers considered bills previously placed on the suspense file. SB 505, which would have required gun owners to carry insurance and held them strictly civilly liable, was held in committee, while the ...

Supreme Court Signals It May Rein In Federal Rulemakers

News  

Monday, August 8, 2022

Supreme Court Signals It May Rein In Federal Rulemakers

While most of the attention from the end of the United States Supreme Court’s last term focused on several landmark cases, including a major win for gun owners in the NRA-supported case New York State Rifle ...

Oregon: Faulty Gun Control Ballot Measure Summary Approved

Friday, August 12, 2022

Oregon: Faulty Gun Control Ballot Measure Summary Approved

This week, the Explanatory Statement Committee approved Ballot Measure 114’s (formerly IP 17) summary that will appear in the voter pamphlet.

Another Good Guy with a Gun Stops the Bad Guy

News  

Monday, July 25, 2022

Another Good Guy with a Gun Stops the Bad Guy

On July 19, 22-year-old Elisjsha Dicken was shopping with his girlfriend at the Greenwood Park Mall in Greenwood, Ind. when a gunman armed with a rifle opened fire in the food court. Upon witnessing the ...

NRA Achieves Historical Milestone as 25 States Recognize Constitutional Carry

News  

Friday, April 1, 2022

NRA Achieves Historical Milestone as 25 States Recognize Constitutional Carry

Half the country will now enjoy the freedom to carry a handgun for self-defense without a permit from the state thanks to the tireless efforts of men and women of the National Rifle Association. 

Illinois: Naperville Considering Banning Many Firearm & Magazine Sales

Monday, July 18, 2022

Illinois: Naperville Considering Banning Many Firearm & Magazine Sales

Tomorrow, at 7:00 P.M., the Naperville City Council will consider File 22-0848, to ban commercial sales of many commonly-owned firearms and standard capacity magazines. NRA Members and Second Amendment supporters are invited to ask the Council ...

Guide To The Interstate Transportation Of Firearms

Gun Laws  

Monday, June 30, 2014

Guide To The Interstate Transportation Of Firearms

CAUTION: Federal and state firearms laws are subject to frequent change. This summary is not to be considered as legal advice or a restatement of law.

MORE TRENDING +
LESS TRENDING -

More Like This From Around The NRA

NRA ILA

Established in 1975, the Institute for Legislative Action (ILA) is the "lobbying" arm of the National Rifle Association of America. ILA is responsible for preserving the right of all law-abiding individuals in the legislative, political, and legal arenas, to purchase, possess and use firearms for legitimate purposes as guaranteed by the Second Amendment to the U.S. Constitution.