April 18, 2024
NATIONAL INSTITUTES OF HEALTH (NIH)
Agency for Healthcare Research and Quality (AHRQ)
This notice announces changes to the application and peer review process for NIH and AHRQ fellowship applications, starting with submissions with due dates after January 25, 2025. The overall goal of the changes is to facilitate the mission of fellowship peer review – to identify the most promising candidates and the individualized training opportunities that will assist them along their paths to support the advancement of the biomedical research enterprise.
In Fall 2021, motivated by having heard concerns from the extramural community, the NIH Center for Scientific Review (CSR) charged an Advisory Council Working Group (CSRAC WG) with evaluating the fellowship review process and making recommendations on how to make that process as effective and fair as possible. The CSRAC WG raised concerns about mentor reputational and career stage bias, how information within applications is utilized to assess candidates, and a burdensome application for both candidates and reviewers. The WG also considered data on peer review outcomes that showed applications with senior sponsors and applications from institutions that submit a disproportionately large number of fellowship applications fare better in review. In order to improve the chances that the most promising candidates will be consistently identified by peer review, the CSRAC WG issued a Final Report of the CSR Advisory Council Working Group on Peer Review of NRSA Fellowship Applications with their recommendations.
NIH solicited feedback on the proposed changes to the application and review process with a request for information (RFI) notice soliciting feedback on the proposed framework, as well as NIH blogs, social media, and direct emails to leadership of almost 500 educational institutions. Responses from the RFI reinforced CSRAC WG concerns that NIH was potentially leaving out highly promising scientists because of a process that too heavily favors elite institutions, senior, well-known sponsors, and an overly narrow emphasis on traditional markers of early academic success. Responses to the RFI also highlighted a need to: (1) change the initially proposed review criteria for clarity; (2) reduce redundancy across the review criteria; (3) clarify the application instructions to indicate which party – candidate or sponsor – is responsible for each section. These responses were considered in finalizing the review criteria and application changes.
Based on input from the CSRAC WG and public feedback, NIH and AHRQ will revise (1) the review criteria used to evaluate fellowship applications and 2) the PHS Fellowship Supplemental Form.
The revised fellowship application and review process will be effective for application due dates on or after January 25, 2025, for the programs using the following activity codes: F30, F31, F32, F33, and F99/K00.
Peer review of fellowship applications serves to provide expert assessment to NIH and AHRQ on the likelihood that a fellowship award will enhance a candidates potential for, and commitment to, a productive independent scientific research career in a health-related field. The changes to the fellowship process include revisions to (1) the criteria used to evaluate fellowship applications and (2) the PHS Fellowship Supplemental Form to align it with the review criteria. The changes serve to:
Review Criteria
The revised fellowship peer review process reorganizes the five current scored review criteria and redefines them in three scored criteria.
Revised Review Criteria
Candidates Preparedness and Potential
Research Training Plan
Commitment to Candidate
The PHS Fellowship Supplemental Form included in fellowship application packages will be updated to align with the restructured criteria. Notable changes include:
NIH and AHRQ are providing detailed instructions so that the letters better assist reviewers in understanding the candidates strengths, weaknesses, and potential to pursue a productive career in biomedical science.
More information and resources will be shared as the implementation date approaches including webinars for prospective applicants. The first public webinar will be held in September 2024.
Please direct all inquiries to:
NIH: [email protected]
AHRQ: [email protected]