Written by: Ersilia M DefilippisElena DonaldLogan ChoAndrew SauerJennifer ManingVanessa BlumerAlexander HajduczokQuentin YoumansMartha GulatiMeredith T HurtAlayna HumphreyNosheen RezaRobert MentzAnuradha Lala
Find these authors on Roon
AS
Dr. Andrew Sauer
Advanced Heart Failure · Saint Luke's
AH
Dr. Alexander Hajduczok
Advanced Heart Failure · Oklahoma Heart Hospital
QY
Dr. Quentin Youmans
Advanced Heart Failure · Northwestern Medicine
Introduction:
Although the proportions of women entering cardiovascular fellowships has increased over time1–3, women continue to be underrepresented in academic cardiology with respect to senior positions and scientific publishing.4 In one bibliographic analysis from major cardiovascular journals over a decade, only 20% of authors on over 18,000 papers were women and nearly 50% of papers had no women authors.5 In 2018, only approximately 13% of editorial board members of Circulation, Journal of the American College of Cardiology, and American Journal of Cardiology were women.6 Further, editorial boards constituted of mainly male editors are more likely to select male peer reviewers identified as men,7 which may bias opportunities for women authorship. As scholarship is critical to academic success, under-representation of women as authors and editors can contribute to the lack of women in leadership positions, but also attribute less value and recognition to scholarship generated by women.One contributing factor to gender discrepancies in scientific authorship and productivity may include biases in peer review. Disclosure of author identity has the potential to bias reviewers’ assessment of suitability for publication. Women first authors, for example, have been shown to receive less positive reviews than their men counterparts.8 The most common model in academic cardiology is single-blinded review, whereby the reviewers remain anonymous for the authors but disclose the authors’ identities to the reviewers. However, other areas of academic cardiology, such as abstract reviewing for major professional conferences, have more commonly used double-blind peer-review, which refers to a process whereby both authors and reviewers are blinded to the other’s identity.9 Whether the conduct of blinded reviews wherein reviewers are unaware of author names or affiliations would lead to more equitable authorship is poorly studied. One systematic review evaluated 8 studies and found mixed results with respect to the impact of double-blind peer review on acceptance rate and review score based on author gender. Still, the authors concluded that there is reasonable evidence that double-blinding may mitigate the impact of gender bias in academic publishing.9 A newly formed Editorial board at the Journal of Cardiac Failure (JCF) articulated a prioritization to improve diversity, equity, and inclusion (DEI) efforts in academic publishing and at the Journal specifically.10 In July 2021, as part of this initiative, JCF implemented a process for the conduct of double-blind reviews after previously utilizing single-blind reviews.11 Seeking to better understand the impact of this change, we hypothesized this change would be associated with increased gender diversity and representation among authors. This manuscript aims to report the association between changes in authorship characteristics over time and the implementation of double-blind reviews at . We acknowledge the nuanced difference between women and female, however, for the purposes of clear communication these terms are used interchangeably throughout the manuscript.
JCF
Methods:
Double-blind reviews for the Journal of Cardiac Failure were announced on July 15, 2021. For the purposes of conducting comparative analysis, published manuscripts were stratified into 3 eras: March – September 2021 (Era 1), March – September 2022 (Era 2), and March – September 2023 (Era 3)(Figure 1). Era 1 was chosen to reflect a period before implementation of double-blind reviews under the current editorial leadership, recognizing that there was some delay between the announcement and when papers evaluated by those review processes would be published in the journal. Specifically, from the time of manuscript acceptance, an article is not typically slotted into a journal issue for several months while formatting and copyediting are performed. Eras 2 and 3 were chosen to provide two different years’ data during the same months post-initiation of double-blind reviews. We pre-specified a blanking period between the different eras involving a 5-month block around the fall and winter holidays.
All article types including Original Research Papers, State-of-the-Art Reviews, Early Career Trainee Spotlight, JCF Ignite and Perspective pieces were included, with the exception of editorial comments, which are typically invited. Data were abstracted, including names, genders, ranks, and discipline of first and senior authors. Gender was determined by a review of pronouns on speakers’ institutional profiles. Discipline was determined by author degrees. Independent of the presence of secondary degrees, MD, DO, MBBS, and MBCHB were classified as physicians, RN or DNP degrees classified as nursing, PharmD classified as pharmacist, and PhD titles classified as scientist in line with NIH criteria. In cases where there were co-first or co-senior authors, the authors listed first or last were included in the analysis. A manuscript with a single author was characterized as the first author. In addition, the region of origin and type of manuscript were collected. The region was determined by reviewing the institutional affiliations of either the first or last author. Original research included full research manuscripts, brief report submissions, and research letters as detailed in the JCF author instructions.12 All other categories were classified as non-original research. As these data were all publicly available, approval of an Institutional Review Board was not required.
Categorical variables were presented as frequencies and percentages and compared using Chi-square tests. For categorical variables, differences between groups were tested using Pearson’s chi-squared tests or Fisher’s exact test, where expected values were less than 10. Multivariable logistic regression models were generated to determine if Era was an independent predictor of females as first or senior authors. The multivariable model covariables of interest were chosen a priori and included Era, author discipline (physician vs. non-physician), author region, article category (original research vs. other) and opposing author gender. For the primary analysis, a p-value of 0.05 was considered statistically significant. A post-hoc adjustment was done to adjust for multiple comparisons for which a p-value of 0.01 was considered statistically significant. Statistical analyses were performed using R version 4.1.3 (R Foundation for Statistical Computing, Vienna, Austria).
Results:
In total, 310 manuscripts were included in the analysis (Era 1: 131 (42.2%), Era 2: 70 (22.6%), Era 3: 109 (35.2%)). Of these, 50% (n = 154) were Original Research Papers, 15% (n = 46) were Brief Reports, 11% (n = 33) were Perspective articles, 11% (n = 33) were State of the Art Review, 4% (n = 13) were Research Letters, 3% (n = 10) were Early Career Spotlights, 3% (n = 8) were Letters to Editor, 2% (n = 7) were JCF ignite, and 2% (n = 5) were Methodology articles. Characteristics of manuscripts by Era are shown in Table 1. The proportion of women first authors increased from 24% in Era 1 to 39% in Era 3 while the percentage of women authors serving in a senior authorship role remained fairly stable over time around 21–22% (Figure 1).
Original research decreased from 71% in Era 1 to 61% in Era 3 while other manuscript types such as Perspectives increased from 11% in Era 1 to 17% in Era 3 and State of the Art Review articles increased from 11% in Era 1 to 17% in Era 3. There were no significant differences in first or last-author discipline (physician, nursing, pharmacist, or scientist) or region between the three Eras.
After adjusting for first author region of origin, first author discipline, and last author gender, the first author had 2.2-fold higher odds of being female in Era 3 [95% CI 1.17–4.03, p = 0.015] compared to Era 1. Additional predictors of female first author in the multivariate model are found in Table 2. When adjusting for multiple comparisons, the results were attenuated as the p-value did not meet the 0.01 threshold for significance.
Manuscripts with a female senior author were more likely to have a female first author (Table 2). Senior authors were 5- fold more likely to be physicians compared to non-physicians [95% CI 2.03–12.8, p<0.001]. Era was not a predictor of female senior authorship.
Discussion
Equitable authorship opportunities in scientific publishing amongst women and men is of critical importance for the promotion and advancement of academic careers in cardiovascular medicine. Here we report the association of double-blinded peer reviews with diversity of authorship by gender in cardiology at JCF. Our key findings were: 1) Female first authors steadily increased from year to year across the study period. 2) the Era of publication was a predictor of a female first authorship; 3) The proportion of female senior authors remained similar over time and was not impacted by Era; and 4) manuscripts with a female senior author were more likely to have a female first author. These initial findings suggest that double-blind peer review may contribute to increased gender diversity of first authors and highlight areas for future improvement for JCF and academic publishing.
Single-blinded versus double-blinded peer review strategies have been previously compared. In one systematic review of 11 randomized controlled trials, the authors found that double-blind peer review was associated with an 18% lower acceptance rate for manuscripts.13 Only one of the included analyses assessed author gender; and found that blinding reviewers to male authorship was associated with a 27% reduction in manuscript acceptance rate. In our study, there was an association between implementation of double-blind peer review and the proportion of publications with females as first authors. There was a graded increase in female first authors from Era 1 to Era 2 to Era 3. The findings were mildly attenuated after adjusting for multiple comparisons so this should be viewed as hypothesis generating. Furthermore, manuscripts with a senior first author were more likely to have a female first author, consistent with prior literature.4
Various other metrics of diversity however remained similar over the Eras, such as region and discipline. The editorial board at JCF does have a strong representation of pharmacists as well as nursing colleagues, and the leadership has focused efforts on enhancing multi-disciplinary writing and publication.14 There is also considerable geographic diversity amongst editorial leadership at JCF in an effort to represent and foster global perspectives and input.15–17 Future steps at JCF will include additional strategic efforts to enhance the diversity of the broader editorial board as well as JCF authors, reviewers, and readers.
We recognize that our analysis has limitations. Gender is just one DEI metric and was treated as binary for this analysis, despite the fact that gender represents a non-binary construct. Furthermore, from Era 1 to Era 3, there may have been changes to female representation on the JCF editorial board, social media initiatives to promote female scholarship and early career initiatives that may partly account for our findings. Additionally, we understand that although we saw an increase in female first authors from Era 1 to Era 3, this trend may not necessarily continue with time and will need to be reiteratively examined. Although the JCF ignite articles included in this analysis were small, this manuscript type was introduced in 2022 and was not accounted for in Era 1. Future studies will aim to explore other facets of diversity, including selfreported race and/or ethnicity, as well as sexuality, sexual orientation.
Our regression analysis was limited by small sample sizes for non-physician disciplines and some regions of origin. Improving efforts to have broad representation across all aspects of scientific publishing is a major priority for JCF, and future efforts will be dedicated to advance this agenda further.
In conclusion, after implementation of double-blind peer reviews, the proportion of publications with female first authors has increased in a graded fashion over time. Although causality cannot be determined, these important data should support further research in this space. We encourage all journals across the broader cardiology and scientific community to examine their review processes and boldly question the status quo to improve diversity across academic publishing.