You are here
Definitions of Criteria and Considerations for R25 Critiques
Updated March 21, 2016
Standard criteria and considerations are shown below. Individual Funding Opportunity Announcements (FOAs) may have additional criteria and considerations.
Reviewers will provide an overall impact score to reflect their assessment of the likelihood for the project to strongly advance research education by fulfilling the goal of this R25 Education Program, in consideration of the following review criteria and additional review criteria, as applicable for the project proposed.
Scored Review Criteria
1. Significance. Does the proposed research education program address a key audience and an important aspect or important need in research education? Is there convincing evidence in the application that the proposed program will significantly advance the stated goals of the program?
Is the PD/PI capable of providing both administrative and scientific leadership to the development and implementation of the proposed program? Is there evidence that an appropriate level of effort will be devoted by the program leadership to ensure the program’s intended goal is accomplished? If applicable, is there evidence that the participating faculty have experience in mentoring students and teaching science? If applicable, are the faculty good role models for the participants by nature of their scientific accomplishments? If the project is collaborative or multi-PD/PI, do the investigators have complementary and integrated expertise; are their leadership approach, governance and organizational structure appropriate for the project?
Taking into consideration the nature of the proposed research education program, does the applicant make a strong case for this program effectively reaching an audience in need of the program’s offerings? Where appropriate, is the proposed program developing or utilizing innovative approaches and latest best practices to improve the knowledge and/or skills of the intended audience?
Does the proposed program clearly state its goals and objectives, including the educational level of the audience to be reached, the content to be conveyed, and the intended outcome? Is there evidence that the program is based on a sound rationale, as well as sound educational concepts and principles? Is the plan for evaluation sound and likely to provide information on the effectiveness of the program? If the proposed program will recruit participants, are the planned recruitment, retention, and follow-up (if applicable) activities adequate to ensure a highly qualified participant pool?
Will the scientific and educational environment of the proposed research education program contribute to its intended goals? Is there a plan to take advantage of this environment to enhance the educational value of the program? Is there tangible evidence of institutional commitment? Is there evidence that the faculty have sufficient institutional support to create a sound educational environment for the participants? Where appropriate, is there evidence of collaboration and buy-in among participating programs, departments, and institutions?
Protections for Human Subjects.
For research that involves human subjects but does not involve one of the six categories of research that are exempt under 45 CFR Part 46, the committee will evaluate the justification for involvement of human subjects and the proposed protections from research risk relating to their participation according to the following five review criteria: 1) risk to subjects, 2) adequacy of protection against risks, 3) potential benefits to the subjects and others, 4) importance of the knowledge to be gained, and 5) data and safety monitoring for clinical trials.
For research that involves human subjects and meets the criteria for one or more of the six categories of research that are exempt under 45 CFR Part 46, the committee will evaluate: 1) the justification for the exemption, 2) human subjects involvement and characteristics, and 3) sources of materials. For additional information, see the Guidelines for the Review of Human Subjects.
Inclusion of Women, Minorities, and Children.
When the proposed project involves human subjects and/or NIH-defined clinical research, the committee will evaluate the proposed plans for the inclusion (or exclusion) of individuals on the basis of sex/gender, race, and ethnicity, as well as the inclusion (or exclusion) of children to determine if it is justified in terms of the scientific goals and research strategy proposed. For additional information, see the Guidelines for the Review of Inclusion in Clinical Research.
The committee will evaluate the involvement of live vertebrate animals as part of the scientific assessment according to the following criteria: (1) description of proposed procedures involving animals, including species, strains, ages, sex, and total number to be used; (2) justifications for the use of animals versus alternative models and for the appropriateness of the species proposed; (3) interventions to minimize discomfort, distress, pain and injury; and (4) justification for euthanasia method if NOT consistent with the AVMA Guidelines for the Euthanasia of Animals. Reviewers will assess the use of chimpanzees as they would any other application proposing the use of vertebrate animals. For additional information on review of the Vertebrate Animals section, please refer to the Worksheet for Review of the Vertebrate Animal Section.
Reviewers will assess whether materials or procedures proposed are potentially hazardous to research personnel and/or the environment, and if needed, determine whether adequate protection is proposed.
For Resubmissions, the committee will evaluate the application as now presented, taking into consideration the responses to comments from the previous scientific review group and changes made to the project.
For Renewals, the committee will consider the progress made in the last funding period, and the success of the program in attracting and retaining individuals from diverse populations, including populations underrepresented in biomedical and behavior.
For Revisions, the committee will consider the appropriateness of the proposed expansion of the scope of the project. If the Revision application relates to a specific line of investigation presented in the original application that was not recommended for approval by the committee, then the committee will consider whether the responses to comments from the previous scientific review group are adequate and whether substantial changes are clearly evident.
Recruitment & Retention Plan to Enhance Diversity.
Peer reviewers will separately evaluate the recruitment and retention plan to enhance diversity after the overall score has been determined. Reviewers will examine the strategies to be used in the recruitment and retention of individuals from underrepresented groups. The review panel's evaluation will be included in an administrative note in the summary statement. Plans and past record will be rated as acceptable or unacceptable, and the summary statement will provide the consensus of the review committee.
Training in the Responsible Conduct of Research.
Taking into account the specific characteristics of the research education program, the level of participant experience, the reviewers will evaluate the adequacy of the proposed RCR training in relation to the following five required components: 1) Format – the required format of instruction, i.e., face-to-face lectures, coursework, and/or real-time discussion groups (a plan with only on-line instruction is not acceptable); 2) Subject Matter – the breadth of subject matter, e.g., conflict of interest, authorship, data management, human subjects and animal use, laboratory safety, research misconduct, research ethics; 3) Faculty Participation – the role of the program faculty in the instruction; 4) Duration of Instruction – the number of contact hours of instruction, taking into consideration the duration of the program; and 5) Frequency of Instruction – instruction must occur during each career stage and at least once every four years. See also NOT-OD-10-019. The review panel’s evaluation will be included in the summary statement. Plans will be rated as acceptable or unacceptable, and the summary statement will provide the consensus of the review committee.
Applications from Foreign Organizations.
Reviewers will assess whether the project presents special opportunities for furthering research programs through the use of unusual talent, resources, populations, or environmental conditions that exist in other countries and either are not readily available in the United States or augment existing U.S. resources.
Select Agent Research.
Resource Sharing Plans.
Reviewers will comment on whether the following Resource Sharing Plans, or the rationale for not sharing the following types of resources, are reasonable: 1) Data Sharing Plan; 2) Sharing Model Organisms; and 3)Genomic Data Sharing Plan. If support for development, maintenance, or enhancement of software is requested in the application, the reviewers will comment on the proposed software dissemination plan.
Budget and Period of Support.
Reviewers will consider whether the budget and the requested period of support are fully justified and reasonable in relation to the proposed research. For more details, please see Budget Information.
Additional Comments to the Applicant (Optional).
Reviewers may provide guidance to the applicant