Dual-anonymization Yields Promising Results for Reducing Gender Bias: A Naturalistic Field Experiment of Applications for Hubble Space Telescope Time

Anonymizing information, such as gender, about grant applicants reduced gender bias, particularly in male reviewers, who tended to rate female applicants significantly worse than male applicants.

Introduction

Being successful in academia, in part, depends largely on a scholar’s ability to secure funding and resources for their research. However, studies have reported that biases in grant review processes often disadvantage women, resulting in lower levels of funding for women applicants compared to men.

“Blinding” or anonymizing applications is one way to remove unconscious gender bias. For example, some competitive orchestras have instituted “blind” auditions, in which the identity and gender of the candidate is concealed. These “blind” auditions have been shown to reduce sex-biased hiring and increase the number of female musicians admitted to these orchestras. Other studies have found that an effective way to eliminate bias in review processes in science may be to focus on evaluating the work (the science), rather than evaluating the individuals (the scientists).

In this study, researchers examined archival data from applicants seeking funding and access to the Hubble Space Telescope (HST), which had implemented a dual-anonymous (double-blind) review process in which the identities of both the applicants and reviewers were obscured in order to address gender inequities. Researchers assessed the impact of the implementation of this double-blind process on gender bias in the review process.

Findings

Anonymizing personal information, such as gender, about applicants reduced gender bias, particularly in male reviewers, who tended to rate female applicants significantly worse than
male applicants.

  • When applicant information was not blinded, female applicants were significantly less likely to be selected for funding and HST access than male applicants.
  • Proposals by female applicants were significantly more likely to be accepted under the double-blind review process than when applicant information was not blinded.
  • Adopting the double-blind review process successfully eliminated gender bias exhibited by male reviewers toward female applicants.
    • When applicant information was not blinded, gender bias emerged when male reviewers rated female applicants significantly worse than they rated male applicants. However, this discrepancy was no longer the case under the double-blind review process.

Researchers argue that these results have important practical implications for gender equity in all areas of science and academia. Double-blind review processes could be adopted not just for funding and resource applications, but also for conference presentations, publications, and employment.

Methodology

Using archival data from the Hubble Space Telescope Time Allocation Committee (HST TAC), researchers examined 16 cycles of 15,545 applicants seeking funding and access to the HST. In an attempt to reduce bias against women, the TAC had transitioned from a single-anonymous review system (in which the reviewers were kept anonymous) to a dual-anonymous review system (in which both the reviewers and the applicants were kept anonymous). Different versions of the dual-anonymous system had been implemented previously, but the commonality was that the name and identity of the Principle Investigator (PI) of the grant had been either obscured or removed. The researchers examined the success rate of male and female applicants under the two systems to examine the impact of bias in each version.

The archival data allowed researchers to compare each reviewer’s ratings across the applications they reviewed, therefore
allowing them to control for variation in the reviewers’ ratings (that is, some reviewers tending to give higher scores than others). The strengths of this study were its longitudinal design, its large sample size, and the nature of the quasi-field experimental data being obtained from a national agency.

Related GAP Studies