The NIH Announces New Review Criteria for Research Project Applications Involving Clinical Trials

Notice Number: NOT-OD-17-118

Key Dates
Release Date: September 21, 2017

Related Announcements
NOT-OD-24-118
NOT-OD-18-212
NOT-DA-23-033

Issued by
National Institutes of Health (NIH)

Purpose

This notice informs the community of additional review criteria that NIH will apply to clinical trial applications for research projects submitted to due dates on or after January 25, 2018.

Background

NIH is utilizing a multi-faceted approach to strengthen policies across the life cycle of a clinical trial, from development of the funding opportunity announcement (FOA), to the information collected in a grant application or contract proposal, to peer review of the application/proposal, and through to monitoring of the award. These actions include the implementation of new and more rigorous review criteria for evaluating clinical trial applications. Addressing these challenges will ensure the highest likelihood of translating research results into knowledge that will improve human health.

Implementation

The review questions below will be effective for all clinical trial applications for research project grants and cooperative agreements that are submitted for funding consideration for due dates on or after January 25, 2018. For the evaluation of those applications, the questions below will be added to the existing review questions (see: https://grants.nih.gov/grants/peer/critiques/rpg.htm), which will not change for research project applications that do not involve clinical trials. Some Program Announcements and Requests for Applications may include FOA-specific questions in addition to those below.

Criteria

In addition, for applications involving clinical trials:
A proposed Clinical Trial application may include study design, methods, and intervention that are not by themselves innovative but address important questions or unmet needs. Additionally, the results of the clinical trial may indicate that further clinical development of the intervention is unwarranted or lead to new avenues of scientific investigation.

Scored Review Criteria

The following questions are in addition to the existing research review questions:

Significance
Are the scientific rationale and need for a clinical trial to test the proposed hypothesis or intervention well supported by preliminary data, clinical and/or preclinical studies, or information in the literature or knowledge of biological mechanisms? For trials focusing on clinical or public health endpoints, is this clinical trial necessary for testing the safety, efficacy or effectiveness of an intervention that could lead to a change in clinical practice, community behaviors or health care policy? For trials focusing on mechanistic, behavioral, physiological, biochemical, or other biomedical endpoints, is this trial needed to advance scientific understanding?

Investigator(s)
With regard to the proposed leadership for the project, do the PD/PI(s) and key personnel have the expertise, experience, and ability to organize, manage and implement the proposed clinical trial and meet milestones and timelines? Do they have appropriate expertise in study coordination, data management and statistics? For a multicenter trial, is the organizational structure appropriate and does the application identify a core of potential center investigators and staffing for a coordinating center?

Innovation
Does the design/research plan include innovative elements, as appropriate, that enhance its sensitivity, potential for information or potential to advance scientific knowledge or clinical practice?

Approach
Does the application adequately address the following, if applicable?

Study Design
Is the study design justified and appropriate to address primary and secondary outcome variable(s)/endpoints that will be clear, informative and relevant to the hypothesis being tested? Is the scientific rationale/premise of the study based on previously well-designed preclinical and/or clinical research? Given the methods used to assign participants and deliver interventions, is the study design adequately powered to answer the research question(s), test the proposed hypothesis/hypotheses, and provide interpretable results? Is the trial appropriately designed to conduct the research efficiently? Are the study populations (size, gender, age, demographic group), proposed intervention arms/dose, and duration of the trial, appropriate and well justified?

Are potential ethical issues adequately addressed? Is the process for obtaining informed consent or assent appropriate? Is the eligible population available? Are the plans for recruitment outreach, enrollment, retention, handling dropouts, missed visits, and losses to follow-up appropriate to ensure robust data collection? Are the planned recruitment timelines feasible and is the plan to monitor accrual adequate? Has the need for randomization (or not), masking (if appropriate), controls, and inclusion/exclusion criteria been addressed? Are differences addressed, if applicable, in the intervention effect due to sex/gender and race/ethnicity?

Are the plans to standardize, assure quality of, and monitor adherence to, the trial protocol and data collection or distribution guidelines appropriate? Is there a plan to obtain required study agent(s)? Does the application propose to use existing available resources, as applicable?

Data Management and Statistical Analysis
Are planned analyses and statistical approach appropriate for the proposed study design and methods used to assign participants and deliver interventions? Are the procedures for data management and quality control of data adequate at clinical site(s) or at center laboratories, as applicable? Have the methods for standardization of procedures for data management to assess the effect of the intervention and quality control been addressed? Is there a plan to complete data analysis within the proposed period of the award?

Environment
If proposed, are the administrative, data coordinating, enrollment and laboratory/testing centers, appropriate for the trial proposed?

Does the application adequately address the capability and ability to conduct the trial at the proposed site(s) or centers? Are the plans to add or drop enrollment centers, as needed, appropriate?

If international site(s) is/are proposed, does the application adequately address the complexity of executing the clinical trial?

If multi-sites/centers, is there evidence of the ability of the individual site or center to: (1) enroll the proposed numbers; (2) adhere to the protocol; (3) collect and transmit data in an accurate and timely fashion; and, (4) operate within the proposed organizational structure?

Additional Review Criteria

Study Timeline

Is the study timeline described in detail, taking into account start-up activities, the anticipated rate of enrollment, and planned follow-up assessment? Is the projected timeline feasible and well justified? Does the project incorporate efficiencies and utilize existing resources (e.g., CTSAs, practice-based research networks, electronic medical records, administrative database, or patient registries) to increase the efficiency of participant enrollment and data collection, as appropriate? Are potential challenges and corresponding solutions discussed (e.g., strategies that can be implemented in the event of enrollment shortfalls)?

Inquiries

Please direct all inquiries to:

Sally Amero, Ph.D.
Review Policy Officer
ReviewPolicyOfficer@mail.nih.gov