When an NIH-defined Phase III clinical trial is proposed, evidence must be reviewed to show whether or not clinically important sex/gender and race/ethnicity differences in the intervention effect are to be expected. The application or proposal must address plans for the analysis of intervention effect differences on the basis of sex/gender, race, and ethnicity unless there is clear evidence that such differences are unlikely to be seen.
Definition of Valid Analysis
Valid analysis means an unbiased assessment. Such an assessment will, on average, yield the correct estimate of the difference in outcomes between two groups of subjects. Valid analysis can and should be conducted for both small and large studies. A valid analysis does not need to have a high statistical power for detecting a stated effect.
The principal requirements for ensuring a valid analysis of the question of interest are:
- allocation of study participants of both sexes/genders (males and females) and from different racial and/or ethnic groups to the intervention and control groups by an unbiased process such as randomization;
- unbiased evaluation of the outcome(s) of study participants; and
- use of unbiased statistical analyses and proper methods of inference to estimate and compare the intervention effects by sex/gender, race, and/or ethnicity.
Reducing Bias and Examining Intervention Effects
Bias can be reduced using several methods. For example, bias in the evaluation can be reduced by using objective measures and staff who are blind to treatment assignment. Bias in the statistical analysis can be reduced by adjusting for potential confounders. Comparison of intervention effects can be achieved by reporting intervention effects and their confidence intervals separately for each sex/gender and for each race/ethnicity group. Generally, it is not sufficient to adjust the primary analysis for sex/gender or race/ethnicity.
Applicant/Recipient Instructions and Guidance
- PHS Human Subjects and Clinical Trials Information form, Section 2.4 Inclusion of Women and Minorities instructions (FORMS-H)
- Guidance: Valid Analysis Reporting in ClinicalTrials.gov for Applicable NIH-Defined Phase III Clinical Trials
- RPPR Instructions (check Section I pg. 1116)
- FAQs Regarding NIH-defined Phase III Clinical Trials
Other Resources
- Open Mike Blog: Continuing to Strengthen Inclusion Reporting on NIH-funded Phase III Trials
- Podcast: Reporting the Results of Valid Analyses (Transcript)
- Decision Tree: Applying the Inclusion of Women and Minorities Policy
- Video: Including Diverse Populations in NIH-funded Clinical Research Slides (4,19) Transcript
- ORWH Inclusion Outreach Toolkit
- OER Glossary Definitions for NIH-defined Phase III Clinical Trial and Valid Analysis
Policy Notices
- NOT-OD-20-125: Reminder of Upcoming FORMS-F and Inclusion Across the Lifespan Requirements for NIH Applicants and Recipients Submitting Post-Submission Updates Using the Human Subjects System (HSS), June 2020
- NOT-OD-18-116: Revision: NIH Policy and Guidelines on the Inclusion of Individuals across the Lifespan as Participants in Research Involving Human Subjects, December 2017
- NOT-OD-18-014: Amendment: NIH Policy and Guidelines on the Inclusion of Women and Minorities as Subjects in Clinical Research, November 2017
- Full Policy: NIH Policy and Guidelines on the Inclusion of Women and Minorities as Subjects in Clinical Research – Amended (announced in NOT-OD-02-001)