Clinical Care & Diagnostics Research & Innovation

Journal clubs' impact on critical appraisal skills in ID training

Share

Objective:

To review evidence on journal clubs’ effects on critical appraisal skills, perceived benefits of online participation and recommendations for structuring educational sessions.

Approach:
  • : A 1988 randomized trial assigned 44 internal medicine interns at Duke University to weekly journal clubs or ambulatory didactic sessions. Participants attended an average of five sessions.
  • : A 2020 survey of 134 #IDJClub respondents examined perceived learning and barriers addressed by online participation; findings were published in 2022.
  • : A needs assessment published in 2022 surveyed 110 infectious diseases fellows about educational resources and interest in online collaboration.
  • : IDWeek 2026 speakers discussed these findings and practical approaches to journal-club organization.
Key Findings:
  • Journal-club participants in the randomized trial reported improved critical reading habits and demonstrated gains in epidemiology and biostatistics knowledge. However, formally assessed critical appraisal skills did not differ significantly between groups.
  • Among #IDJClub survey respondents, 95% reported gaining clinically useful knowledge and 72% said they learned more than in traditional in-person journal clubs.
  • In that survey, 52% reported a lack of institutional subject experts and 29% described traditional journal clubs as intimidating. Respondents believed the online format helped address these barriers.
  • In the fellows’ needs assessment, 88% expressed interest in an online collaborative educational resource, while 64% reported satisfaction with their fellowship programs’ existing resources.
Interpretation:

Participants’ perceived value and interest in online learning are distinct from demonstrated improvements in critical appraisal skills. The randomized trial found no statistically significant difference in those skills, while the online survey and needs assessment did not establish improved learning outcomes.

Limitations:
  • The #IDJClub survey relied on self-reported experiences rather than objective learning measures.
  • The fellows’ needs assessment evaluated educational interests and satisfaction rather than the effects of online collaboration on learning.
  • The evidence presented did not establish that online or traditional journal clubs consistently improve critical appraisal skills.
Conclusion:

Dr. James B. Cutrell recommended trainee-led article selection and presentation with faculty guidance, structured appraisal of methods and limitations, advance article distribution, trained facilitators and expert participation when appropriate. Predictable scheduling and protected learning time may support participation. Online formats offer additional opportunities for discussion, but their perceived benefits should not be equated with proven improvements in critical appraisal skills.

Sources: