Explore The NRA Universe Of Websites

APPEARS IN News

Identifying the Problem of Gun Control Research

Friday, April 12, 2019

Identifying the Problem of Gun Control Research

In 2017, anti-gun researcher John Donohue and his team released a study that purported to find that Right to Carry laws increase overall violent crime rates. The paper was updated six months later seemingly to address criticism of its methodology and produced the same conclusion. Readers may be familiar with the study as an anti-gun press fawned over the results without questioning the mechanism of the effect or the methodology itself. 

Economist Carlise E. Moody and lawyer-sociologist Thomas B. Marvell released a critique of the Donohue Right to Carry study recently and concluded that “there is no significant relationship between RTC laws and either murder or violent crime.” 

Moody and Marvell determined that the panel data analysis in the Donohue study is dependent on the use of population weights, which Donohue argues in a response are necessary to avoid implying that the impact of RTC laws on small population states is “equally important” as the impact of the population of the largest states in the Union. 

Despite a spirited argument against Moody and Marvell, Donohue and his co-authors recognize “the difference in results between the population-weighted and unweighted regressions is likely signaling a specification issue.” In other words, the findings depend on the metrics incorporated into the model and the approach used. 

Donohue and his team weighted their data by state population and found RTC laws increase violent crime. Moody and Marvell did not weight by population and found no significant effect of RTC laws on violent crime. The effect is dependent on the weighting. Misspecified models and the misuse of data are two of the most common issues we see in anti-gun research. 

The aspect of the original Donohue study that received the press coverage used a synthetic controls methodology to derive an estimated impact of RTC laws on violent crime. The specific finding is that violent crime is 13%-15% higher after the adoption of RTC laws than it could have been if the state had not adopted RTC. The first question readers may ponder is: how and/or why would RTC laws lead to an increase in violent crime? Law-abiding citizens filling out paperwork, meeting established requirements, and abiding by federal, state, and local laws somehow inspire criminals to commit more crimes? 

Let’s review the reasons according to Donohue, et al.: permit holders may commit crimes they would not have committed without the permit, the culture of gun carrying can promote confrontations, guns may be stolen from people carrying legally, and criminals will find it “increasingly beneficial” to use violence to complete their criminal agenda. Donohue and his team present no more than anecdotal evidence to support these claims. 

Now, consider the synthetic controls methodology. (Where a state is compared to a “synthetic” version of itself created by combining portions of other states). In their first draft, Donohue and his team utilized Hawaii as a contributor to 18 Right to Carry states including Colorado, Kansas, Minnesota, and Nebraska. Donohue revised his approach and included robustness checks in the revised paper, but Moody and Marvell present an additional critique. The synthetic controls methodology could be biased by excluded control variables in both the treatment and control states. 

Much like the specification issue presented in the panel data analyses, the synthetic control methodology is limited by what is missing. That Hawaii was used as a significant component of synthetic Minnesota is amusing, but it really simplifies the missing differences between states. As Moody and Marvell state, “states have certain permanent, or at least long-lived, attributes such as history, tradition, culture, climate, attitudes toward firearms, attitudes toward self-defense, etc., that could affect both crime and the policies adopted to combat crime.” The differences between states should not be overlooked, and restricting the donor pool in any number of ways as a robustness check does not necessarily alleviate this issue – especially when the donor pool of non-Right to Carry states shrinks over the years and more states adopted Right to Carry. 

Moody and Marvell point out that the synthetic controls model cannot control for all relevant factors, pre- and post-treatment, including major factors that cause crime rates to vary. They conclude “the claim that RTC laws increase either murder or violent crime is not supported.” Donohue, et al., present a rebuttal but their original paper helpfully includes charts for the violent crime rate in each RTC state in the appendix. The solid lines are the actual violent crime rate in each state and the dashed lines are the synthetic control version of that state. The vertical line indicates the year RTC was adopted. Go on, take a look. We see more states in which the violent crime rate started to decrease or continued to decrease after RTC than states in which the rate increased. 

But who are you going to believe: the Donohue analysis that overlooks fundamental differences between states or your lying eyes? 

TRENDING NOW
Florida: House Passes Constitutional Carry

Friday, March 24, 2023

Florida: House Passes Constitutional Carry

Today, the House voted 76-32 to pass House Bill 543, the constitutional carry bill.

Updates to ATF Final Rule on Stabilizing Braces

News  

Monday, January 30, 2023

Updates to ATF Final Rule on Stabilizing Braces

On Monday, January 30, the Bureau of Alcohol, Tobacco, Firearms, and Explosives’ (ATF) published the final Factoring Criteria for Firearms with Attached “Stabilizing Braces” rule for public inspection in the federal register.

Biden’s Executive Order Targeting Gun Ownership

News  

Wednesday, March 15, 2023

Biden’s Executive Order Targeting Gun Ownership

On Tuesday, Joe Biden issued an executive order on gun control that could accurately be described as a mile wide and an inch deep.

Florida: Senate’s Constitutional Carry Passes Committee

Thursday, March 9, 2023

Florida: Senate’s Constitutional Carry Passes Committee

Today, the Senate Fiscal Policy Committee voted 11-6 to approve Senate Bill 150, constitutional carry, with an amendment aligning the language with the House’s version. It will now go to the full Senate for further consideration.

Washington: Senate Committee Hearing California-Style Gun Ban & Waiting Period Bills

Friday, March 17, 2023

Washington: Senate Committee Hearing California-Style Gun Ban & Waiting Period Bills

On March 23rd, at 8:00AM, the Senate Committee on Law & Justice will hear House Bill 1240, a comprehensive gun ban bill, and House Bill 1143, to impose a waiting period and training mandate for acquiring ...

Florida: 2023 Session Convened, Senate Committee Hearing Constitutional Carry

Wednesday, March 8, 2023

Florida: 2023 Session Convened, Senate Committee Hearing Constitutional Carry

Yesterday, March 7th, the Florida Legislature began the 2023 legislative session. Tomorrow, at 9:00AM, the Senate Fiscal Policy Committee will hear Senate Bill 150, the Senate’s constitutional carry bill.

Michigan: House to Consider Requiring Firearms Be Made Unavailable for Self-Defense

Wednesday, March 22, 2023

Michigan: House to Consider Requiring Firearms Be Made Unavailable for Self-Defense

As early as tonight, the House may bring to the floor a bill package to impose a one-size-fits-all firearm storage requirement to make them unavailable for self-defense.

Michigan: Senate Sends Anti-Gun Bills to Governor

Thursday, March 23, 2023

Michigan: Senate Sends Anti-Gun Bills to Governor

Today, the Senate voted to concur with the House on Senate Bills 79, 80, 81, and 82, which the House passed last night, to impose a one-size-fits-all firearm storage requirement to make them unavailable for self-defense. 

Columnist thinks gun owners can be shamed out of their rights

News  

Monday, March 20, 2023

Columnist thinks gun owners can be shamed out of their rights

At least one of the joyless scolds that predominate in gun control circles thinks they’ve stumbled onto a novel anti-gun tactic. According to Colorado Newsline Editor Quentin Young, gun control supporters should try to shame gun ...

Florida: House Judiciary Passes Constitutional Carry

Tuesday, February 21, 2023

Florida: House Judiciary Passes Constitutional Carry

Today, the House Judiciary Committee voted 17-6 to advance House Bill 543, the constitutional carry bill. It will now go to the House floor for debate.

MORE TRENDING +
LESS TRENDING -

More Like This From Around The NRA

NRA ILA

Established in 1975, the Institute for Legislative Action (ILA) is the "lobbying" arm of the National Rifle Association of America. ILA is responsible for preserving the right of all law-abiding individuals in the legislative, political, and legal arenas, to purchase, possess and use firearms for legitimate purposes as guaranteed by the Second Amendment to the U.S. Constitution.