First Level: Peer Review

Scope Note

The first level of review is carried out by a scientific review group (SRG), also referred to as a study section, composed primarily of non-federal scientists who have expertise in relevant scientific disciplines and current research areas. The role of SRGs is to assess the overall impact that your proposed project (or resource, or training, or center, etc.) will likely have on the biomedical research field(s) involved.

Learn more about how the first level of peer review works, scoring, roles, and more.

Background

NIH peer review policy is intended to promote a process whereby grant applications submitted to the NIH are evaluated in a fair, equitable, and timely manner that strives to be free of bias.

The core values of peer review drive the NIH to seek the highest level of ethical standards, and form the foundation for the laws, regulations, and policies that govern the NIH peer review process. The NIH dual peer review system is mandated by statute in accordance with section 492 of the Public Health Service Act and federal regulations governing "Scientific Peer Review of Research Grant Applications and Research and Development Contract Projects.”

Who Reviews Your Application?

NIH peer reviewers are scientists, mostly from academia. Serving as a peer reviewer for NIH is an important way in which scientists participate in the ecosystem of scientific discovery.

Given that they must provide objective, fair, and timely reviews free from inappropriate influences, reviewers are fully vetted for appropriate expertise, potential conflicts of interest, and other requirements based on NIH peer review policies.

NIH provides reviewers extensive orientation and training to ensure they are prepared. (Learn more on our Information for Reviewers page). As part of this orientation reviewers are reminded that NIH review meetings are confidential and not to divulge any information outside the meeting.

Depending on the type of expertise required, peer review meetings are run by either the NIH Center of Scientific Review or an NIH institute or center.

Tip
Applicants may suggest study second assignments when they submit their application using the PSH Assignment Request Form. The CSR Assisted Referral Tool (ART) can help you identify CSR study sections that might be appropriate for review of your application. Assignments consider the requests but the primary determinants are the published study section guidelines.

Meeting Overview and Roles

Each SRG is led by a scientific review officer (SRO). The SRO is an NIH extramural staff scientist and the designated federal official responsible for ensuring that each application receives an objective and fair initial peer review, and that all applicable laws, regulations, and policies are followed.

Other key roles include the chair, who is a SRG member and is responsible for leading the discussions, and scientists serving on the SRG who review your application.

Before the meeting. The SRO assigns at least three reviewers to assess each application and gives all reviewers on the panel (except those with conflicts of interest) access to the applications to be reviewed. Before the meeting, assigned reviewers will read each application thoroughly, write a critique summarizing the strengths and weaknesses of the application, and assign it a preliminary Overall Impact score. Learn more about scoring below.

At the meeting. At the review meeting, the SRO actively manages the meeting to ensure fair and effective review, manage conflicts of interest, and ensure compliance with review policy. The chairperson facilitates the discussions.

After the SRO opens the meeting, any reviewer with a conflict of interest is asked to leave the room before the group begins reviewing an individual application. The primary reviewer then presents the application to the group and starts off the discussion of it. The other two assigned reviewers may provide additional comments. All panelists not in conflict, not just the assigned reviewers, then discuss and score the application.

Tip
While assigned reviewers read your application carefully, and some others may as well, many reviewers will be scanning it as they listen to the discussion. As you prepare your application, think about how to make it easy for someone scanning it to understand what you are proposing and find the information they are looking for.

Roles. Learn more about the roles of the SRO and reviewers in the table below.

Scientific Review Officer (SRO) Scientific Review Group (SRG) Members
  • Analyze the content of each application.
  • Document and manage conflicts of interest.
  • Recruit qualified reviewers based on scientific and technical qualifications and other considerations, including:
    • Authority in their scientific field
    • Dedication to high quality, fair, and objective reviews
    • Ability to work collegially in a group setting
    • Balanced expertise, appropriate for the applications under review
  • Train and orient reviewers – both those who are new to review and returning reviewers.
  • Assign applications to reviewers for critique preparation and assignment of individual criterion scores.
  • Actively manage the peer review meeting to ensure fair and effective review, including attention to regulatory aspects of peer review meetings.
  • Prepare a resume of discussion for all applications discussed, to accurately reflect score-driving elements.
Chair
  • Serves as moderator of the discussion of scientific and technical merit of the applications under review.
  • Also serves as a peer reviewer for the meeting.
Reviewers
  • Declare conflicts of interest with specific applications following NIH guidance
  • For details, see the Managing Conflict of Interest in NIH Peer Review of Grants and Contracts page
  • Receive access to the grant applications approximately six weeks prior to the peer review meeting.
  • Ensure they maintain the confidentiality of peer review information (See Integrity and Confidentiality in NIH Peer Review)
  • Prepare a written critique (as directed by the scientific review officer) for each application assigned, based on review criteria and judgment of merit. Assign a numerical score to each scored review criterion.
  • Make recommendations concerning the scientific and technical merit of applications under review, in the form of final written comments and numerical scores.
  • Make recommendations concerning protections for human subjects; inclusion of women, minorities, and children in clinical research; welfare of vertebrate animals; and other areas as applicable for the application (see guidance for reviewers on Human Subjects Protection and Inclusion, Human Embryonic Stem Cells, and Vertebrate Animals).
  • Make recommendations concerning appropriateness of budget requests (see Budget Information for Reviewers).

Other Federal Officials. Federal officials who have a need-to-know are permitted to attend review meetings with advance approval from the responsible SRO. These staff members may provide programmatic or grants management input at the SRO's discretion.

Note
Applicants have an important role in maintaining the integrity of the peer review process. Applicants may not contact reviewers to influence the outcome of the review; send information directly to a reviewer; or try to access protected information related to the review. There are consequences to any of these actions (See Integrity and Confidentiality in NIH Peer Review).

Peer Review Criteria and Considerations

Each grant application submitted to NIH is evaluated according to established review criteria that must be stated clearly in a notice of funding opportunity. For most application types, the required review criteria are defined in NIH Peer Review regulations (see resources under See Also below), however they may be re-defined to facilitate the goals of the grant program and/or specific criteria may be added.

Scored Review Criteria

Reviewers assign individual criterion scores for all scored review criteria. These scored criteria contribute to the Overall Impact score of an application.

Each reviewer uses their own judgement to determine how each criterion weighs into the Overall Impact score of the application, unless specified differently in the funding opportunity. Criterion scores typically use a numerical scale of 1 to 9 but may also include non-numerical ratings. For example, the Expertise and Resources factor for many research grants may be evaluated as either sufficient or not.

Additional Review Criteria

Additional review criteria do not receive individual criterion scores but contribute to the Overall Impact score. Some of these criteria need to be considered acceptable before the NIH can award a grant (for example, the protections for human subjects, vertebrate animals, and biohazards criteria).

Additional Review Considerations

Additional review considerations do not receive individual criterion scores and do not contribute to the Overall Impact score. The NIH uses additional review considerations to seek the input of scientific experts concerning programmatic issues that do not directly reflect the scientific and technical merit of the work proposed, and therefore do not affect the scoring. For example, reviewers may be asked whether an application’s budget is sufficiently justified by the proposed project, or whether the project could be completed for a small budget (or in fewer years) than requested.

Scoring

Most review criteria, as well as an application’s overall impact, are rated using numerical scoring.

The NIH utilizes a 9-point rating scale (1 = exceptional; 9 = poor) in whole numbers (no decimals). Before the SRG meeting, each reviewer assigned to an application gives a separate score for each review criterion. The individual scores of the assigned reviewers for these criteria are provided to the applicant.

In addition, each reviewer assigned to an application gives a preliminary Overall Impact score for that application. In many review meetings, the preliminary scores are used to determine which applications will be discussed in full at the meeting. For each discussed application, a final Overall Impact score is given by each eligible panelist (individuals without a conflict of interest).

Note
Impact scores reflect the reviewers’ overall assessment of the likelihood for the project to exert a sustained, powerful influence on the research field(s) involved.

A final Overall Impact score for each discussed application is determined by calculating the mean score from the final impact scores from all the eligible members and multiplying the average by 10. This calculation results in final Overall Impact scores ranging from 10 (high impact) through 90 (low impact).

Not Discussed (ND) applications. Applications unanimously judged by the SRG to be less competitive (typically rank in the bottom half) are not discussed at the meeting. These application do not receive a numerical final Overall Impact score.

Tip
Looking for advice after your application has been reviewed? When you receive your summary statement, contact the listed NIH Program Official.

Summary Statement

After the meeting, all reviewed applications receive an impact score and a summary statement prepared by the SRO.

NIH typically releases scores in the eRA Commons system within 3 business days and uploads your summary statement within about 30 days. Users who have the principal investigator or signing official role in eRA Commons can view the released scores and summary statement.

The summary statement includes:

  • Impact Score and Percentile (if applicable)
  • Brief summary of the SRG discussion (written by the SRO)
  • Criterion scores from the assigned reviewers
  • Bulleted critiques (strengths and weaknesses) from the assigned reviewer
  • Budget recommendations
  • Any administrative comments
Tip
To learn about the relationship between the impact score and the percentile ranking and how these factor into the likelihood of funding, see our Funding Decisions page.

Appeals

NIH's peer review appeal system provides investigators and applicant organizations the opportunity to seek reconsideration of the initial review results if, after consideration of the summary statement, they believe the review process was flawed for reasons of either bias of a reviewer, conflict of interest, absence of appropriate expertise, or factual errors by one or more reviewers that could have substantially altered the review outcome. This policy does not apply to appeals of NIH funding decisions, appeals of decisions concerning extensions of MERIT awards, or appeals of the technical evaluation of R&D contract projects through the NIH peer review process.

FAQs

Resources

Upcoming Events

    Videos

      See Also

      Contact

      Check online guidance and direct your questions to staff in your organization's sponsored programs office. If you still need assistance, find NIH contacts at Need Help?


      This page last updated on: September 9, 2024
      For technical issues E-mail OER Webmaster