Part 1. Overview Information

Key Dates

The application due date for this NOFO is January 6, 2025.

No late applications will be accepted for this NOFO.

All applications are due by 5:00 PM local time of applicant organization. 

Applicants are encouraged to apply early to allow adequate time to make any corrections to errors found in the application during the submission process by the due date.

Not Applicable

Generally, four months after the receipt date

It is critical that applicants follow the Multi-Project (M) Instructions in the SF424 (R&R) Application Guide, except where instructed to do otherwise (in this NOFO or in a Notice from the NIH Guide for Grants and Contracts). Conformance to all requirements (both in the Application Guide and the NOFO) is required and strictly enforced. Applicants must read and follow all application instructions in the Application Guide as well as any program-specific instructions noted in Section IV and follow the AHRQ Grants Policy and Guidance found on the AHRQ website at http://www.ahrq.gov/funding/policies/nofoguidance/index.html.

When the program-specific instructions deviate from those in the Application Guide, follow the program-specific instructions.

Applications that do not comply with these instructions may be delayed or not accepted for review.

There are several options available to submit your application through Grants.gov to NIH and Department of Health and Human Services partners. You must use one of these submission options to access the application forms for this opportunity.

1. Use the NIH ASSIST system to prepare, submit and track your application online.
2. Use an institutional system-to-system (S2S) solution to prepare and submit your application to Grants.gov and eRA Commons to track your application. Check with your institutional officials regarding availability.
   
   



Table of Contents
Part 1. Overview Information
Key Dates
Part 2. Full Text of Announcement
Section I. Notice of Funding Opportunity Description
Section II. Award Information
Section III. Eligibility Information
Section IV. Application and Submission Information
Section V. Application Review Information
Section VI. Award Administration Information
Section VII. Agency Contacts
Section VIII. Other Information

Part 2. Full Text of Announcement

Section I. Notice of Funding Opportunity Description

Purpose & Objective

The purpose of this Notice of Funding Opportunity (NOFO) is to accelerate the dissemination and implementation of patient-centered outcomes research (PCOR) evidence into healthcare delivery through improvements in healthcare policy, payment, and practice, and to reduce healthcare disparities especially among people who receive Medicaid, are uninsured, and other people who are medically underserved.  This NOFO will fund recipients to create State-based Healthcare Extension Cooperatives (Cooperatives) to conduct an initiative based on PCOR evidence to improve care for medically underserved people; the initiative's focus must be on behavioral healthcare. To support this initiative, the Cooperative will  (1) engage key stakeholders, including Medicaid agencies, managed care organizations, and other organizations that address the health needs of medically underserved people, in identifying and addressing barriers and facilitators to implementing patient-centered healthcare delivery improvements based on PCOR evidence, (2) work with healthcare policy, payment, community, care delivery, and research organizations that serve medically underserved populations to build their capacity to implement patient-centered healthcare delivery improvements based on PCOR evidence and to support ongoing learning, (3) conduct evaluations of the impacts and refinements of the processes of the Cooperative's activities, and (4) provide the support structure to ensure these activities are integrated and aligned.    

AHRQ’s Healthcare Extension Service will consist of the Cooperatives awarded under this NOFO, a National Coordinating Center (NCC) that will provide technical assistance to the Cooperatives, and a National Evaluation Center (NEC) that will report on the outcomes and impacts of AHRQ's Healthcare Extension Service. Cooperatives will collaborate with the NCC, NEC, AHRQ program staff, and other recipients of this NOFO to share approaches, methods, and data.

As this is one of three related NOFOs, applicants are strongly encouraged to review the other two to prepare applications for this one.

Background on Healthcare Extension

It can take a long time for new findings from PCOR to be implemented in healthcare delivery. There can be tremendous variation within and across healthcare delivery organizations and states in the quality and consistency of the delivery of evidence-based care. As seen in AHRQ’s National Healthcare Quality and Disparities Reports, the United States often struggles to deliver high-quality, evidence-based care, particularly for lower-income people and people from certain racial and ethnic groups and geographic areas who receive their care from safety net healthcare delivery organizations.

Barriers to the dissemination and implementation of PCOR evidence into healthcare delivery include (1) policies and payment structures that do not align with implementing evidence-based care; (2) health information technology that does not produce real-time information that can be used for quality improvement and does not facilitate data sharing across healthcare settings; (3) workforce issues such as shortages, inefficiencies, and lack of training; (4) limited coordination and technical support for practice transformation; and (5) limited connections between healthcare delivery organizations and other sectors, such as public health and community organizations. These challenges occur across the healthcare delivery system and significantly affect more resource-challenged safety net healthcare delivery organizations.

A promising path to accelerate the dissemination and implementation of patient-centered healthcare delivery improvements is to build relationships and implementation capacity within and across organizations. At the state level, there needs to be coordination and alignment of improvement efforts through a systematic process inclusive of affected stakeholders, including but not limited to Medicaid agencies, managed care organizations, safety net healthcare delivery organizations, clinicians and staff, patients, and community-based organizations. On a more local level, improvements may also include delivering targeted support to local healthcare delivery organizations, improving healthcare delivery processes, and providing training, education, and other types of assistance to organizations, clinicians, and staff.

AHRQ's Healthcare Extension Service, modeled after the U.S. Department of Agriculture Cooperative Extension System and incorporating principles from learning health systems, proposes to help healthcare policy, payment, and delivery organizations overcome implementation barriers and improve the quality of healthcare services for medically underserved people through state- or system- and local-level, evidence-based improvements. Building from the strengths of these models, each recipient will support: 1. An Engagement, Training, Education, and Assistance Core; 2. A Monitoring, Feedback, and Evaluation Core; and 3. An Administrative Core. The Administrative Core will also establish and facilitate a Multistakeholder Council to provide expert advice and guidance to the Cooperative.  Each recipient will use this structure to complete an initiative focused on behavioral health during the award period that will accelerate the dissemination and implementation of patient-centered healthcare delivery improvements based on PCOR evidence and reduce health disparities within the State.

More specific details on the Extension Services are described below in Cooperative Components. Each applicant should partner with appropriate organizations within the state and build upon existing infrastructure to deliver all services and support the necessary administration and staffing for the Cooperative. Extension services may be provided by the recipient, organizations represented in the Multistakeholder Council, or other existing organizations that have arrangements with the recipient.

AHRQ's Healthcare Extension Service is aligned with AHRQ's mission to produce evidence that improves healthcare by making it safer, higher quality, more accessible, equitable, and affordable, and to work within the U.S. Department of Health and Human Services and with other partners to make sure that the evidence is understood and used. The Cooperative's structure and function detailed below are intended to address AHRQ’s Patient Centered Outcomes Research Trust Fund Strategic Framework’s mission, goals, vision, and priorities. This includes early, ongoing, meaningful stakeholder engagement, addressing and measuring impacts on health equity, and supporting a wide range of healthcare delivery organizations.

Key Terms for this NOFO:

For purposes of this NOFO, the following definitions apply:

Behavioral Health: An umbrella term that includes mental health and substance use conditions, life stressors and crises, stress-related physical symptoms, and health behaviors.

Clinicians and staff: An umbrella term that includes licensed, registered or certified health care providers who interact directly with patients, including but not limited to physicians, nurses, pharmacists, allied health professionals, technicians and technologists, health aides, and clinic staff.

Cooperatives: See State-based Healthcare Extension Cooperatives below.

Evidence-based, patient-centered, healthcare delivery improvement ("Evidence-based improvement"): Consistent with Brownson and colleagues (1), evidence-based, patient-centered, healthcare delivery improvements are defined as healthcare delivery interventions, programs, education, training, practices, processes, guidelines, and policies with some evidence of effectiveness in improving health outcomes that are meaningful for patients and their caregivers. This includes clinical evidence, evidence on how best to deliver healthcare that is potentially generalizable beyond specific health conditions or healthcare delivery circumstances (e.g., management strategies, models of care), or evidence-based policies. (1) Brownson RC, Shelton RC, Geng EH, Glasgow RE. Revisiting concepts of evidence in implementation science. Implement Sci. 2022 Apr 12;17(1):26. doi: 10.1186/s13012-022-01201-y. PMID: 35413917; PMCID: PMC9004065.

Healthcare delivery organization: An organization of people, institutions, and resources that is responsible for the delivery of healthcare services to meet the healthcare needs of a target population. For the purposes of this NOFO, healthcare delivery organizations include but are not limited to health systems, hospitals, ambulatory care practices (including primary care practices and specialty practices), managed care organizations, pre-hospital services, community-based organizations that provide healthcare services, and skilled nursing facilities.

Healthcare Extension Agent(s): Individual(s) who provides external support to improve the healthcare delivery system to improve population health. Healthcare extension agents work to achieve the goals of the Cooperative. Examples of healthcare extension agents include education and training professionals; health IT advisors; human factors, systems engineering or task analysis experts; implementation experts; practice facilitators and coaches.

Multistakeholder Council: A group of stakeholders that come together to provide expert advice and guidance in support of the Cooperative. The Multistakeholder Council is responsible for identifying and providing advice on policy and system change(s) across the state that support the implementation of the Cooperative's initiative. Policy and system changes may include State and local policies as well as policies and practices within the healthcare delivery organizations that influence the implementation of evidence-based improvements.

Safety Net Healthcare Delivery Organizations: Healthcare delivery organizations that provide a significant level of healthcare and health-related services to medically underserved people, including people who are uninsured, receive Medicaid, people made vulnerable by poverty, and others. Examples of safety net organizations include Community Health Centers, Federally Qualified Health Centers (and look-alikes), CMS Rural Health Clinics, Safety Net Hospitals, Indian Health Service providers, pre-hospital service organizations, and primary care practices that serve these populations.

State-based Healthcare Extension Cooperatives (“Cooperatives”): State-level entities that serve as a coordinating entity for supporting the identification and delivery of patient-centered improvements within the State based on PCOR evidence.

Cooperative Components Requirements

Each Cooperative must include the following Cores: (1) Engagement, Training, Education, and Assistance Core, (2) Monitoring, Feedback, and Evaluation Core, and (3) Administrative Core. The Administrative Core will include a Multistakeholder Council (see below). The Cooperative will plan, execute, and evaluate an initiative focused on behavioral health within the award period. The leadership of the Cooperative is provided by the Program Director(s)/Principal Investigator(s).

Engagement, Training, Education, and Assistance Core

Engagement, Training, Education, and Assistance Core is responsible for establishing and maintaining relationships with safety net healthcare delivery organizations and community partners and providing training, education, and assistance to support the improvement goals of the initiative. Applicants are expected to build on existing relationships and that this core will be staffed with individuals with ties to the regions and communities they serve. Cooperatives may start by delivering extension services in sub-state regions.

• Healthcare extension agents will be key to implementing the Cooperative's initiative. Healthcare extension agents will be responsible for assisting with implementing the selected healthcare delivery improvements and implementation strategies based on PCOR evidence and informed by local and regional safety net healthcare delivery organizations, healthcare professionals, and patients and families. Healthcare extension agents will assist safety net healthcare delivery organizations develop an implementation plan. This plan must include the ability to tailor the implementation strategies to improve the fit with their organizations and make adaptations to address the needs of different populations the organization serves. Healthcare extension agents will learn from these partners about the regional and local successes and challenges in implementing evidence-based, patient-centered healthcare improvements in safety net healthcare delivery organizations. This will give the Cooperative a real-time understanding of implementation progress, guide potential adaptations to the intervention(s) or implementation strategies, and problem-solve issues with the Multistakeholder Council.   
• Healthcare extension agents may develop activities such as (1) convening a statewide or sub-state regional learning community, (2) providing tailored support to specific healthcare delivery organizations, (3) engaging managed care organizations in improving the quality of the services they deliver, (4) working with community-based organizations to encourage involvement in improvement activities, (5) presenting information to policymakers and payers to inform their decisions, (6) assisting organizations in leveraging their health information technology to build capacity to monitor improvement efforts, (7) analyzing and improving work processes and workforce composition, and (8) addressing healthcare workforce needs through training and education. They may also collect information about healthcare delivery organizations and community priorities and share their observations with other state initiatives.
• Given the breadth of activities that healthcare extension agents may perform, Cooperatives may deploy more than one type of agent to address these needs. If the applicant organization cannot employ healthcare extension agents directly, they must partner or subcontract with organizations with that capacity. Healthcare extension agents must focus on safety net healthcare delivery organizations but may work with other organizations to achieve the initiative's goals.
• Facilitate learning across the state. Throughout the award period, the Cooperative must develop relationships with members of the safety net healthcare delivery organizations, healthcare professionals, and other partners to facilitate shared learning throughout the initiative. This may include activities such as:
  • Sharing local barriers and corresponding solutions to implementing healthcare delivery improvements as part of the initiative.
  • Sharing local facilitators to implement healthcare delivery improvements as part of the initiative.
  • Sharing methods for meaningful engagement and partnership with communities.
  • Sharing resources from other state and federal initiatives to improve the initiative's implementation.
  • Sharing interim results developed by the Monitoring, Feedback, and Evaluation Core from their monitoring efforts and giving feedback to improve implementation efforts as part of the initiative.

Monitoring, Feedback, and Evaluation Core

The Monitoring, Feedback, and Evaluation Core will be responsible for monitoring the formation and functioning of the Cooperative, applying feedback on improvements that may be needed, and evaluating the implementation, processes, and impact of the Cooperative. This core will assess the implementation, processes, and overall impact of the Cooperative’s initiative. This core will also be required to collaborate with the NEC, as specified below. The Monitoring, Feedback, and Evaluation activities must be performed by an organization within the state that can conduct a rigorous and independent evaluation, such as an academic medical center, public or private institutions of higher education, or other research organization. If the applicant organization cannot independently perform this, they must partner with an organization that can perform these tasks.

Collect and analyze qualitative and quantitative data to inform, monitor, and evaluate the Cooperative’s improvement initiative. The Cooperative must acquire and analyze state-level healthcare data and information to monitor the functioning and impacts of the Cooperative’s initiative. Examples of state-level data and information may include but are not limited to, quantitative data such as Medicaid claims data, state workforce statistics, and other data collected as part of federal or state programs, as well as qualitative data such as reports and information on state reimbursement policies and practices. These data should be shared on a regular and timely basis within the Cooperative, Multistakeholder Council and other relevant audiences.

Collect and summarize PCOR evidence on improvements and strategies for the Cooperative’s initiative.

Monitor the Cooperative’s activities and performance. The monitoring activities must focus on obtaining regular, frequent information on the Cooperative and initiative using measures and data reporting methods identified in collaboration with the NEC. Each Cooperative must:

• Monitor the Cooperative’s governance, operations, functioning, and initiative. Each Cooperative will collect data on its governance, operations, functioning, and initiative and share these data with the NEC.
• Report to NEC on measures of practice context, practice-level capacity, implementation, and process measures regarding the initiative's development, uptake of improvements, and implementation strategies as part of the initiative.
• Propose monitoring metrics and other measures, recognizing that Cooperatives will ultimately develop and use standard reporting measures identified in collaboration with the NEC after award. Each Cooperative may collect additional data beyond these standard reporting measures.

Feedback and Improvement. Each Cooperative must propose an approach for using self-monitoring and local evaluation data to support ongoing improvement of the initiative. Each Cooperative must:

• Detail a process for sharing monitoring and local evaluation data within the Cooperative to inform subsequent improvements.
• Share monitoring results and information regularly with partners in the state or sub-state region and the NCC to spread effective practices within the Cooperative and across other Cooperatives.
• Translate evaluation findings into information useful to the Cooperative, the Multistakeholder Council, healthcare delivery organizations, and decision-makers across the State.

Evaluate the Cooperative’s implementation and impact. Each Cooperative must evaluate the implementation and impact of their activities and the initiative. Each Cooperative must evaluate:

• Implementation of the overall Cooperative.
• Improvement in organizational outcomes, including organizational capacity, for healthcare delivery organizations participating in the initiative.
• The role of health information technology and health information exchange in the implementation and sustainment efforts of the initiative.
• Adoption, implementation, and sustainment of PCOR evidence-based, patient-centered healthcare delivery improvements throughout the initiative.
• The impact of the Cooperative and its initiative. The specific measures will be determined based on the initiative and will be proposed by the applicants, but they must include information such as the number of individuals who received evidence-based, patient-centered care as a direct result of the Cooperative and its initiative and any improvement in their health status.
• Impacts on health equity. This may include examining whether the Cooperative has sufficiently served safety net healthcare delivery organizations, delivered evidence-based, patient-centered improvement(s) equitably throughout the state, or addressed disparities in healthcare or health outcomes.

Administrative Core

The Administrative Core manages, coordinates, and supports the activities of the Cooperative and the initiative. 

• Promptly forms and administers the Cooperative, including its organizational and leadership structure, governance, and responsibilities of members and member organizations.
• Is responsible for the overall management of the Cooperative, including subcontracts, compliance with grant requirements, and meeting the proposed timelines.
• Hires and supervises staff.
• Establishes, manages, and facilitates the Multistakeholder Council (see Multistakeholder Council below).
• Identifies and coordinates with other similar initiatives in the state to develop collaboration opportunities and reduce duplication.
• Cooperates and collaborates with the NCC. The Cooperative will participate in the Learning Networks created by the NCC. The NCC will serve as the point of contact to provide or coordinate technical assistance involving the NEC as needed. The Cooperative will collaborate with the NCC to communicate and disseminate resources, tools, and learnings.
• Cooperates and collaborates with the NEC. The NEC will coordinate the monitoring of the progress of the Cooperatives across AHRQ's Healthcare Extension Service. The NEC will assist with sharing best practices for monitoring across the Cooperatives (see Monitoring, Feedback, and Evaluation Core above). The NEC will conduct the formative and summative evaluation of the entire initiative across all Cooperatives as well as conducting the process evaluation on the formation and function of each Cooperative. Each Cooperative must partner with the NEC to (1) harmonize measures, instruments, and data collection across the Cooperatives, (2) share instruments and data with AHRQ and the NEC, (3) participate in evaluation activities with the NEC, (4) review evaluation reports from the NEC and identify key actions based on the report findings.
• Disseminates resources, tools, and learnings in coordination with the NCC.
• Grant recipients, with input from the Multistakeholder Council, will discuss a long-term financial and operational sustainability plan for the Cooperative and its activities by the end of the third year of the grant. 

The Administrative Core will establish the Multistakeholder Council and is responsible for providing expert advice and guidance to the Cooperative. The Multistakeholder Council must, at a minimum:

• Guide Cooperative’s initiative focused on behavioral health using a data-informed and collaborative process with a facilitator.
• Support the implementation of the Cooperative's initiative. Members of the Council will provide input during the initiative's implementation, including potential adaptations to implementation strategies to enhance its success. Proposed adaptations to the implementation strategies approved for the grant recipient must be within the original scope of the approved grant award.
• Provide guidance and support on state- and local-level barriers and facilitators to improvements that are part of the initiative. These activities may include providing recommendations to align payment policies and performance metrics, identifying workforce issues, enhancing timely and consistent data sharing, or developing healthcare delivery workflows and processes for healthcare delivery organizations.
• Support coordination with state-level efforts to improve healthcare policy, payment, and practice for safety net healthcare delivery organizations. This can include activities such as assisting with the identification of and coordination with other public and private improvement efforts occurring within the state or leveraging resources at the State and local levels to augment the Cooperative’s initiative.
• Evaluating the Cooperative's potential for long-term sustainability, including identifying opportunities for ongoing support for specific activities of the Cooperative.

Membership of the Multistakeholder Council. The Program Director(s)/Principal Investigator(s) and other key personnel from the project team will be critical participants in the Multistakeholder Council. Additional members should be determined based on the state context and the functions listed above, as well as the ability to develop the Cooperative's initiative. Each member of the Multistakeholder Council should have a clear role and purpose for participation that maps to the initiative's goals. Membership should be representative of the state’s demographic and geographic diversity. The Multistakeholder Council may establish working committees within the Council to work on specific topics, such as payment alignment or health information technology. To the extent possible, stakeholders representing organizations should have the authority to make commitments on behalf of their organizations. The members described below are required as they are instrumental in guiding and driving change in safety net healthcare delivery. It is expected that the Multistakeholder Council will include these members and additional members who can contribute to the success of the Cooperative. It is expected that the Multistakeholder Council will consist of at least 15 members. The exact size of the council will depend on the state context.

Required members for the Multistakeholder Council. Applicants must include at least one member from each category listed below for the Multistakeholder Council.

• A representative from the State Medicaid agency or agency that manages Medicaid is required to be a full and active participant in the Multistakeholder Council. Where possible, they should work to align payment and performance metrics with the initiative's improvement goals and facilitate Medicaid data sharing and analysis with the Cooperative.
• A representative from Medicaid managed care organizations (MCOs) (if applicable): If the applicant’s State Medicaid-funded services are primarily delivered through MCOs, a representative from the largest MCOs must be included.
• An executive from safety net healthcare delivery organizations will be responsible for sharing needs and priorities from their respective organizations, aligning their organization’s improvement activities with the initiative, and sharing the barriers and facilitators they encounter with the Multistakeholder Council.
• Clinicians and staff from safety net healthcare delivery organizations. These individuals will explain how evidence-based improvements and implementation strategies would function in local healthcare delivery organizations.
• Patients, families, and caregivers who receive care from safety net healthcare delivery organizations or are members of underserved populations must participate to bring unique perspectives to the Multistakeholder Council, including but not limited to their personal experience in receiving healthcare in safety net organizations, in identifying health outcomes that are important to them, and in developing patient-centered improvements and strategies.
• Other members of the Multistakeholder Council. Additional members should include stakeholders relevant to the initiative of the Cooperative and the state’s healthcare landscape and may include representatives from (1) other state and local agencies and officials (e.g., public health departments, state behavioral health agencies), agencies that purchase state employee health benefits, governor’s health office, State insurance regulators, State legislators, foundations, Tribal or county officials), (2) other major payers in the State (e.g., private health insurance plans, self-insured employers, HHS/CMS regional representatives, foundations), (3) healthcare quality improvement and practice transformation organizations, (4) organizations that support health information technology, such as health information exchanges, (5) state associations and advocacy organizations (e.g., primary care associations, healthcare professional associations, patient advocacy groups), (6) community service organizations (e.g., social service agencies, food and hunger groups, homeless and housing organizations), (7) healthcare professional educators, such as Area Health Education Centers (AHECs), (8) Cooperative Extension Office, (9) academic medical centers, public or private institutions of higher education, or other research organizations based in the state that engage in healthcare research or improvement/extension-type activities.
• The AHRQ Program Official and other AHRQ staff may participate in the Multistakeholder Council as needed to provide support to the recipient.

Initiative: Behavioral Health

Each Cooperative must conduct an initiative focused on behavioral health to accelerate the dissemination and implementation of patient-centered healthcare delivery improvements based on PCOR evidence and reduce disparities in safety net healthcare delivery organizations.

The initiative should incorporate evidence-based improvements and corresponding implementation strategies based on PCOR findings that work at multiple levels to achieve a specific outcome. These activities should incorporate attention to future sustainability.

The initiative must address the current behavioral health crisis with the selected topic based on state data and stakeholder priorities. Applicants must specify the behavioral health focus of this initiative, including the evidence-based, patient-centered improvement(s) to be implemented in safety net healthcare delivery organizations. Applicants must describe a process by which the implementation of the evidence-based improvement(s) will be refined throughout the initiative based on input from the Multistakeholder Council, the Healthcare Extension Agents, and data from the Monitoring, Feedback, and Evaluation core.  The focus may be on a specific behavioral health condition or a strong behavioral health component or how behavioral healthcare is delivered or integrated into the medical safety net. When choosing their focus, applicants must use state data, PCOR evidence, data on health and healthcare disparities, and consultation with current or anticipated members of their Multistakeholder Council to determine their priorities. Applicants should describe their stakeholder engagement process to support their selection of initiative focus. An initiative may focus on a single area or combination that will accelerate the implementation of PCOR evidence in practice, including aligning payment, developing workforce, enhancing technology, or improving work performance and processes. Cooperatives should align and coordinate with other state and federal initiatives working on the same behavioral health issue.

Examples of Initiatives Responsive to this NOFO

Below are some examples of initiatives that would be responsive to this NOFO. Applicants should consider interventions that could be transformational in nature, providing whole-person, person-centered care, potential for addressing health-related social needs often contributing to mental health and behavioral healthcare treatment, and tailoring interventions across the life course.This list is not exhaustive of all possible initiatives that are responsive to this NOFO. 

Example Initiative: Unhealthy Alcohol Use Screening and Intervention. State data show that unhealthy alcohol use is a leading cause of death and disability. After conferring with the primary care association, medical professional associations, and the Medicaid agency, the applicant has learned that many safety net clinicians are unaware of effective screening and treatment options and of resources in their community. To reduce the rate of unhealthy alcohol use among adults in the state, the recipient will:

• Adapt existing resources for screening and brief intervention for unhealthy alcohol use for safety net healthcare delivery organizations.
• Send healthcare extension agents to train health system and practice champions in implementing these resources and help them develop linkages to recovery support organizations in the community for referrals.
• Provide additional training to develop the peer support workforce to integrate within healthcare delivery organizations.
• Engage the Multistakeholder Council to work on expanding the number of inpatient treatment centers in the State that accept Medicaid.
• Provide training and technical assistance to increase the number of clinicians that provide evidence-based whole-person care to individuals with unhealthy alcohol use. Training will focus on taking into consideration the impact of other health behaviors, physical health, and social determinants on unhealthy alcohol use, and the provision of evidence-based medications for alcohol use disorder.

Example Initiative: Integrated Screening and Treatment for Depression and Anxiety. Reports from the four largest health systems in the State indicate that only a small portion of the adult population are being screened for depression, anxiety, and suicide risk per recommendations of the U.S. Preventive Services Task Force. Screening rates are lowest in Medical Shortage Areas where residents have lower incomes and are more likely to be uninsured or publicly insured. After convening stakeholders, including the Medicaid agency, major health systems, self-insured employers, small primary care practices, mental health advocacy groups, patients with depression and family members, community mental health centers, and leaders from immigrant communities, the applicant has concluded that this topic is a priority for their State to address and that stigma and lack of trust are barriers to screening and treatment. To decrease the rates of depression and anxiety among adults in the state, the recipient will:

• Use healthcare extension agents to help healthcare delivery organizations implement integrated screening and provide evidence-based resources for treating depression and anxiety.
• Work with community leaders to develop a culturally and linguistically appropriate awareness campaign to encourage participation in screening and treatment.
• Train community health workers employed by health systems to conduct screenings and follow up on referrals for treatment.
• Members of the Multistakeholder Council will identify and address workforce shortages in behavioral health to support the increased need for treatment generated by the systematic screening effort.

Example Initiative: Implementing the Collaborative Care Model. Studies in the State have demonstrated that immigrants, Hispanic persons, and African American persons seek mental health services at lower rates, and they have fewer completed referrals than White persons. There is also a documented shortage of mental health clinicians who serve Medicaid beneficiaries and the uninsured. The State’s Community Mental Health Association, the State’s Refugee Coordinator, several networks of rural and community health centers, and two Medicaid managed care plans have agreed to implement the Collaborative Care Model, which is effective and efficient and to reduce mental health disparities. The recipient will:

• Engage the Multistakeholder Council in increasing the behavioral health workforce and its diversity.
• Engage the Multistakeholder Council to set standards and reimbursement levels for the Collaborative Care Model and align payment policies across several payers within the State.
• Implement mental health shared care plans so that all primary care and behavioral health clinicians on the Collaborative Care Model Team can access the care plan electronically.
• Develop and have healthcare extension agents deliver training and coaching to provide the skills and tools to implement culturally appropriate collaborative care across a range of underserved populations.

See Section VIII. Other Information for award authorities and regulations.

Investigators proposing clinical trials may refer to the Research Methods Resources website for information about developing statistical methods and study designs.

Section II. Award Information

These projects are being funded pursuant to 42 USC 299b-37 which authorizes AHRQ to make these awards to support the agency's dissemination of comparative clinical effectiveness research findings

All applications submitted and AHRQ grants made in response to this NOFO are subject to 45 CFR Part 75 (Uniform Administrative Requirements, Cost Principles and Audit Requirements for HHS Awards; https://www.ecfr.gov/cgi-bin/text-idx?node=pt45.1.75), the HHS Grants Policy Statement (see https://www.ahrq.gov/funding/policies/hhspolicy/index.html), and the terms and conditions set forth in the Notice of Award.

Section III. Eligibility Information

1. Eligible Applicants

Higher Education Institutions

• Public/State Controlled Institutions of Higher Education
• Private Institutions of Higher Education

The following types of Higher Education Institutions are always encouraged to apply for AHRQ support as Public or Private Institutions of Higher Education:

• Hispanic-serving Institutions
• Historically Black Colleges and Universities (HBCUs)
• Tribally Controlled Colleges and Universities (TCCUs)
• Alaska Native and Native Hawaiian Serving Institutions
• Asian American Native American Pacific Islander Serving Institutions (AANAPISIs)

Nonprofits Other Than Institutions of Higher Education

• Nonprofits with 501(c)(3) IRS Status (Other than Institutions of Higher Education)
• Nonprofits without 501(c)(3) IRS Status (Other than Institutions of Higher Education)

For-Profit Organizations

• Small Businesses
• For-Profit Organizations (Other than Small Businesses)

Local Governments

• State Governments
• County Governments
• City or Township Governments
• Special District Governments
• Indian/Native American Tribal Governments (Federally Recognized)
• Indian/Native American Tribal Governments (Other than Federally Recognized)

Federal Governments

• Eligible Agencies of the Federal Government
• U.S. Territory or Possession

Other

• Independent School Districts
• Public Housing Authorities/Indian Housing Authorities
• Native American Tribal Organizations (other than Federally recognized tribal governments)
• Faith-based or Community-based Organizations
• Regional Organizations

HHS grants policy requires that the grant recipient perform a substantive role in the conduct of the planned project or program activity and not merely serve as a conduit of funds to another party or parties. If consortium/contractual activities represent a significant portion of the overall project, the applicant must justify why the applicant organization, rather than the party(s) performing this portion of the overall project, should be the recipient and what substantive role the applicant organization will play. Justification can be provided in the Specific Aims or Research Strategy section of the PHS398 Research Plan Component sections of the SF424 (R&R) application.  There is no budget allocation guideline for determining substantial involvement; determination of substantial involvement is based on a review of the primary project activities for which grant support is provided and the organization(s) that will be performing those activities. 

Foreign components, as defined in the HHS Grants Policy Statement via https://www.hhs.gov/sites/default/files/grants/grants/policies-regulations/hhsgps107.pdf may participate in projects as member of consortia or as subcontractors only.

Non-domestic (non-U.S.) Entities (Foreign Organization) are not eligible to apply.

Non-domestic (non-U.S.) components of U.S. Organizations are not eligible to apply.

Applicant organizations

Applicant organizations must complete and maintain the following registrations as described in the How to Apply- Application Guide to be eligible to apply for or receive an award. All registrations must be completed prior to the application being submitted. Registration can take 6 weeks or more, so applicants should begin the registration process as soon as possible. 

• System for Award Management (SAM) – Applicants must complete and maintain an active registration, which requires renewal at least annually. The renewal process may require as much time as the initial registration. SAM registration includes the assignment of a Commercial and Government Entity (CAGE) Code for domestic organizations which have not already been assigned a CAGE Code.
  • NATO Commercial and Government Entity (NCAGE) Code – Foreign organizations must obtain an NCAGE code (in lieu of a CAGE code) in order to register in SAM.
  • Unique Entity Identifier (UEI) - A UEI is issued as part of the SAM.gov registration process. The same UEI must be used for all registrations, as well as on the grant application.
• eRA Commons - Once the unique organization identifier is established, organizations can register with eRA Commons in tandem with completing their Grants.gov registration; all registrations must be in place by time of submission. eRA Commons requires organizations to identify at least one Signing Official (SO) and at least one Program Director/Principal Investigator (PD/PI) account in order to submit an application.
• Grants.gov – Applicants must have an active SAM registration in order to complete the Grants.gov registration.

Program Directors/Principal Investigators (PD(s)/PI(s))

All PD(s)/PI(s) must have an eRA Commons account.  PD(s)/PI(s) should work with their organizational officials to either create a new account or to affiliate their existing account with the applicant organization in eRA Commons. If the PD/PI is also the organizational Signing Official, they must have two distinct eRA Commons accounts, one for each role. Obtaining an eRA Commons account can take up to 2 weeks.

Any individual(s) with the skills, knowledge, and resources necessary to carry out the proposed research as the Program Director(s)/Principal Investigator(s) (PD(s)/PI(s)) is invited to work with his/her organization to develop an application for support.  Individuals from diverse backgrounds, including underrepresented racial and ethnic groups, individuals with disabilities, and women are always encouraged to apply for AHRQ support.

For institutions/organizations proposing multiple PDs/PIs, visit the Multiple Program Director/Principal Investigator Policy and submission details in the Senior/Key Person Profile (Expanded) Component of the SF424 (R&R) Application Guide. The AHRQ multiple PDs/PIs policy can be found at https://grants.nih.gov/grants/guide/notice-files/NOT-HS-16-018.html.

PD/PI(s) Level of Effort: For the overall Cooperative, a single PD/PI must devote at least 20% minimum FTE (i.e., at least 8 hours per week) in each given year of the project. If multiple PD(s)/PI(s) are proposed, each PD/PI must devote at least 10% minimum FTE (i.e., at least 4 hours per week). If any effort is in-kind, this should be explained in the budget justification, and a letter of support from an authorized institutional official is required. 

2. Cost Sharing

This NOFO does not require cost sharing.

While there is no cost sharing requirement included in this NOFO, AHRQ welcomes applicant institutions, including any collaborating institutions, to devote resources to this effort. An indication of institutional support from the applicant and its collaborators indicates a greater potential of success and sustainability of the project. Examples of institutional support would include: donated equipment and space, institutional funded staff time and effort, or other resource investments. Applicant institutions should indicate institutional support by outlining the specific contributions to the project and providing assurances that their organization and any collaborators are committed to providing these funds and resources to the project. This information can be included at the end of the budget justification section of the application, but institutional support dollars are not to be shown/included in the detailed budget request.

3. Additional Information on Eligibility

Applicant organizations may NOT submit more than one application.

AHRQ will not accept duplicate or highly overlapping applications under review at the same time. 

Applications that describe proposed improvements in healthcare policy, payment, and practice work to be conducted in more than one state will be deemed non-responsive and will not be reviewed. 

Section IV. Application and Submission Information

1. Requesting an Application Package

The application forms package specific to this opportunity must be accessed through ASSIST or an institutional system-to-system solution. A button to apply using ASSIST is available in Part 1 of this NOFO. See the administrative office for instructions if planning to use an institutional system-to-system solution.

2. Content and Form of Application Submission

It is critical that applicants follow the Multi-Project (M) Instructions in the How to Apply - Application Guide, except where instructed in this notice of funding opportunity to do otherwise and where instructions in the Application Guide are directly related to the Grants.gov downloadable forms currently used with most AHRQ opportunities. Conformance to the requirements in the Application Guide is required and strictly enforced. Applications that are out of compliance with these instructions may be delayed or not accepted for review.

Letter of Intent

Although a letter of intent is not required, is not binding, and does not enter into the review of a subsequent application, the information that it contains allows AHRQ staff to estimate the potential review workload and plan the review. 

In addition, by sending a letter of intent, an applicant is giving AHRQ permission to share the information in the letter of intent with other submitters from your State. AHRQ strongly urges potential applicants in a State to collaborate on a single application. 

By the date listed in Part 1. Overview Information, prospective applicants are asked to submit a letter of intent that includes the following information:

• Descriptive title of proposed activity
• Name(s), address(es), and telephone number(s) of the PD(s)/PI(s)
• Names of other key personnel
• Participating institution(s)
• Number and title of this funding opportunity

The letter of intent should be sent to:

Matthew Simpson, MD, MPH 
Division of Practice Improvement
Center for Evidence and Practice Improvement
Agency for Healthcare Research and Quality
Email: [email protected]  

Page Limitations

All page limitations described in the How to Apply- Application Guide and the Table of Page Limits must be followed.

Instructions for the Submission of Multi-Component Applications

The following section supplements the instructions found in How to Apply- Application Guide and should be used for preparing a multi-component application.

The application should consist of the following components:

• Overall: required
• Engagement Core: required, maximum of 1
• Monitoring Core: required, maximum of 1
• Administrative Core: required, maximum of 1
• Initiative: required, maximum of 1

Pre-application Technical Assistance Conference Calls

AHRQ encourages applicants to check the following webpage for resources for this NOFO:   AHRQ’s Healthcare Extension Service Initiative | Agency for Healthcare Research and Quality. AHRQ encourages applicants to take advantage of any TA webinars that may be held by AHRQ program staff. Participation is optional and is not required to apply. Information about a TA webinar will be published through the NIH Guide and posted on the AHRQ website. 

Overall Component

When preparing the application, use Component Type ‘Overall’.

All instructions in the How to Apply - Application Guide must be followed, with the following additional instructions, as noted.

SF424(R&R) Cover (Overall)

Complete entire form.

PHS 398 Cover Page Supplement (Overall)

Follow standard instructions.

Research & Related Other Project Information (Overall)

Follow standard instructions.

Project/Performance Site Locations (Overall)

Enter primary site only.

A summary of Project/Performance Sites in the Overall section of the assembled application image in eRA Commons compiled from data collected in the other components will be generated upon submission.

Research and Related Senior/Key Person Profile (Overall)

Include only the Project Director/Principal Investigator (PD/PI) and any multi-PDs/PIs (if applicable to this NOFO) for the entire application.

A summary of Senior/Key Persons followed by their Biographical Sketches in the Overall section of the assembled application image in eRA Commons will be generated upon submission.

Budget (Overall)

The only budget information included in the Overall component is the Estimated Project Funding section of the SF424 (R&R) Cover.

Budget Component: Special Instructions for AHRQ applications.

AHRQ is not using the Modular Grant Application and Award Process. Recipients applying for funding from AHRQ are to ignore application instructions concerning the Modular Grant Application and Award Process and prepare applications using instructions for the Research and Related Budget Components of the SF 424 (R&R). Applications submitted in the Modular format will not be reviewed.

Budget Allocation:

• PI(s) Level of Effort: For the overall Cooperative, a single PD/PI must devote at least 20% minimum FTE (i.e., at least 8 hours per week) in each year of the project. If multiple PD(s)/PI(s) are proposed, each PD/PI must devote at least 10% minimum FTE (i.e., at least 4 hours per week). If any effort is in-kind, this should be explained in the budget justification, and a letter of support from an authorized institutional official is required.
• There are no requirements for the level of effort for each core.
• Travel: Applicants must budget for up to four key personnel to travel to the Washington, DC area once each year to meet with individuals from the NCC, NEC, AHRQ staff, other recipients, and any invited guests for a two-day meeting.
• Evaluation liaison: Applicants must designate an Evaluation Liaison to collaborate with AHRQ and the NEC on all evaluation matters. The Evaluation Liaison must be designated as key personnel and have at least 25% FTE dedicated to Evaluation Liaison activities. If the PD(s)/PI(s) or other key personnel will serve in this role, FTE requirements are cumulative.
• Multistakeholder Council: Applicants should budget for reasonable and allowable costs for participation in Multistakeholder Council meetings, where applicable. (see https://www.hhs.gov/sites/default/files/grants/grants/policies-regulations/hhsgps107.pdf.)

A budget summary in the Overall section of the assembled application image in eRA Commons compiled from detailed budget data collected in the other components will be generated upon submission.

PHS 398 Research Plan (Overall)

Specific Aims: Clearly indicate the state you will be working in to meet the objectives of the NOFO, and describe the overall focus of the Cooperative and proposed initiative. Summarize the expected outcome(s) of the Cooperative as a whole, including the impact that the results of the proposed initiative will have in the state, particularly as it relates to reducing disparities for safety net populations. Briefly describe how the Cooperative is structured and how the cores and initiative alone and together fit into the overall goals. 

Research Strategy: This section should summarize the structure and the overall strategy for the design and approach of the Cooperative. This section should also describe the coordination with other federally funded initiatives, state initiatives, as well as with the NCC and the NEC. The Research Strategy must consist of the following sections:

State-based Healthcare Extension Cooperative Overview.

• How the cores contribute individually and collectively to achieve the goals of this NOFO.
• Experience and capacity of investigators to engage in the proposed work, including relationships with key stakeholders.

Responsiveness to State Healthcare Environment. In this section, applicants must describe characteristics of healthcare in their state to demonstrate that the proposed work will address known challenges and to build sustainable learning and improvement systems at the state level to accelerate implementation of evidence-based improvements in healthcare policy, payment, and practice and reduce healthcare disparities especially among Medicaid, uninsured, and medically underserved people. Applicants must also describe current healthcare disparities in their state and how their proposed work may address those disparities. Relevant information may include:

• The state’s population, demographics, healthcare insurance coverage, quality, and health outcomes. For states with an American Indian or Native Alaskan population, applicants should describe the healthcare environment for these communities.
• The state of healthcare quality in the safety net, including metrics that demonstrate a gap between current and evidence-based practice.
• Disparities in healthcare access, delivery, and outcomes in uninsured individuals, Medicaid recipients, and racial and ethnic minorities including tribal members.
• The state’s Medicaid environment, including managed care arrangements.
• The current state of healthcare for the behavioral health focus that the applicant has selected, including current payment policies and incentives, workforce policies and characteristics, health information technology, and gaps between evidence-based practice and actual care delivery.
• Existing quality improvement support to safety net healthcare delivery organizations in the state.
• Existing initiatives within the state, including federally funded state initiatives and a plan to ensure coordination, rather than duplication, with these initiatives. 

Letters of Support: Letters of support from partner organizations and entities should specify the nature of collaboration and their role in the Cooperative. Applications must include letter(s) of support from an institutional official that endorses the proposed Cooperative and describe the available institutional resources that will support the activities of the Cooperative. Letters from individuals who will serve as consultants or collaborators on the project, but with no specified levels of efforts, should also be included. Do not include letters from individuals who will be supported by the grant who are named in the application.  Letters of support, recommendation, or affirmation from any entity or individual not directly participating in the project should not be included. (i.e., general letters of support for the project).

Resource Sharing Plan:
Individuals are required to comply with the instructions for the Resource Sharing Plans as provided in the SF424 (R&R) Application Guide, with the following modification: Data Management Plan should NOT be submitted under Other Plans attachment, it is to be submitted under Resource Sharing plan as per AHRQ DMP policy.

Submission of a data management plan is required. AHRQ applicants are reminded to refer to NOT-HS-20-011: The Agency for Healthcare Research and Quality Data Management Plan Policy (https:/grants.nih.gov/grants/guide/notice-/NOT-HS-20-011.html for additional information on how to incorporate their data management plan into the resource sharing plan.

Appendix:

Only limited items are allowed in the Appendix. Follow all instructions for the Appendix as described in How to Apply- Application Guide; any instructions provided here are in addition to the How to Apply - Application Guide instructions.

PHS Human Subjects and Clinical Trials Information (Overall)

When involving human subjects research, clinical research, and/or NIH-defined clinical trials follow all instructions for the PHS Human Subjects and Clinical Trials Information form in the How to Apply - Application Guide, with the following additional instructions:

If you answered “Yes” to the question “Are Human Subjects Involved?” on the R&R Other Project Information form, there must be at least one human subjects study record using the Study Record: PHS Human Subjects and Clinical Trials Information form or a Delayed Onset Study record within the application. The study record(s) must be included in the component(s) where the work is being done, unless the same study spans multiple components. To avoid the creation of duplicate study records, a single study record with sufficient information for all involved components must be included in the Overall component when the same study spans multiple components.

Study Record: PHS Human Subjects and Clinical Trials Information

All instructions in the How to Apply - Application Guide must be followed.

Delayed Onset Study

Note: Delayed onset does NOT apply to a study that can be described but will not start immediately (i.e., delayed start). All instructions in the How to Apply- Application Guide must be followed.

PHS Assignment Request Form (Overall)

All instructions in the How to Apply- Application Guide must be followed.

Administrative Core

When preparing your application, use Component Type ‘Admin Core.’

All instructions in the SF424 (R&R) Application Guide must be followed, with the following additional instructions, as noted.

SF424 (R&R) Cover (Administrative Core)

Complete only the following fields:

• Applicant Information
• Type of Applicant (optional)
• Descriptive Title of Applicant’s Project
• Proposed Project Start/Ending Dates

PHS 398 Cover Page Supplement (Administrative Core)

Research & Related Other Project Information (Administrative Core)

Human Subjects: Answer only the ‘Are Human Subjects Involved?’ and 'Is the Project Exempt from Federal regulations?’ questions.

Project Narrative:  Do not complete. Note: ASSIST screens will show an asterisk for this attachment indicating it is required. However, eRA systems only enforce this requirement in the Overall component and applications will not receive an error if omitted in other components.

Project /Performance Site Location(s) (Administrative Core)

List all performance sites that apply to the specific component.

Note: The Project Performance Site form allows up to 300 sites, prior to using additional attachment for additional entries.

Research & Related Senior/Key Person Profile (Administrative Core)

• In the Project Director/Principal Investigator section of the form, use Project Role of ‘Other’ with Category of ‘Project Lead’ and provide a valid eRA Commons ID in the Credential field.
• In the additional Senior/Key Profiles section, list Senior/Key persons that are working in the component.
• Include a single Biographical Sketch for each Senior/Key person listed in the application regardless of the number of components in which they participate. When a Senior/Key person is listed in multiple components, the Biographical Sketch can be included in any one component.
• If more than 100 Senior/Key persons are included in a component, the Additional Senior Key Person attachments should be used.   

Budget (Administrative Core)

Budget forms appropriate for the specific component will be included in the application package.

Travel Funds: The budget should include funds to support travel for members of the Multistakeholder Council to attend meetings.

Note: The R&R Budget form included in many of the component types allows for up to 100 Senior/Key Persons in section A and 100 Equipment Items in section C prior to using attachments for additional entries. All other SF424 (R&R) instructions apply.

PHS 398 Research Plan (Administrative Core)

Specific Aims: Clearly state how the Administrative Core will provide leadership for the Cooperative and coordinate the proposed activities and maintain internal information flow. This includes managing and coordinating interaction among the PD/PI(s), the cores, personnel at the applicant institution as well as outside institutions, the Multistakeholder Council, stakeholder organizations, appropriate institutional administrative personnel, and the staff of the awarding agency.

Research Strategy:  In this section, applicants must describe the structure, governance, and operations of the proposed Cooperative. This includes descriptions of the following:

• Clearly indicate the state that the applicant will be working in to meet the goals of the NOFO.
• Structure, leadership, and governance of the Cooperative. AHRQ anticipates that multiple organizations may need to form a partnership for this cooperative agreement, which may include multiple subawards, a multiple PI arrangement, and funding to additional organizations and individuals. Applicants must describe the roles and responsibilities of each organization and key personnel and any history of working together. Applicants must include an organizational chart and describe the governance and management of the Cooperative.
• Staffing. Describe specific expertise of the Overall PDs/PIs, Leaders for each Core, and other Key Personnel that makes them appropriate for their proposed roles, without duplicating information in biosketches. For the Overall PD(s)/PI(s), describe prior experience leading multi-institutional endeavors. Describe how this team has previously collaborated. Include a description of proposed partnerships between organizations and include evidence of prior collaborative projects, if applicable, and how their expertise is complementary and will strengthen the Cooperative. Include plans for hiring any staff needed for the cores and initiatives.
• Multistakeholder Council. Applicants must demonstrate their:
  • capacity to organize and manage the Multistakeholder Council, and to work collaboratively across key state agency, payer, clinical, and community-based partners to provide expert advice and recommendations for system change across the State.
  • ability to serve as a facilitator or identify a facilitator that will be able to recruit and work with all types of stakeholders.
  • ability to develop a governance policy for the Multistakeholder Council that specifies data and evidence that will be used by the Multistakeholder Council to inform decisions and the process by which decisions are made. 
• The applicant must describe the activities the Multistakeholder Council will undertake, in keeping with those stated in the Requirements section for this NOFO.
• Demonstrate that their Multistakeholder Council will be demographically and geographically diverse and include the full range of those individuals and organizations that drive healthcare improvement in the State, including those who represent community perspectives and those with lived experiences. Applicants must demonstrate that the State Medicaid agency plays a central role in the Council and that other key players in healthcare improvement in the State are involved.
• The Cooperative’s relationship with other organizations and initiatives, including how the Cooperative will coordinate implementation support throughout the state and complement – not duplicate – other state and federal initiatives. Applicants that are building upon existing entities or initiatives in the state must describe what specific enhancements will be funded through this cooperative agreement, how they were identified, and how they are expected to contribute to the objectives of this NOFO. Grants may not be used to supplant funds already being spent in the state to increase the delivery of evidence-based interventions.
• The applicant must describe how they will coordinate with state-level convenings of State Medicaid Agencies, payer partners and other stakeholders in Innovation Models from the Centers for Medicare & Medicaid Services Innovation Center (e.g., Making Care Primary Model, States Advancing All-Payer Health Equity Approaches and Development Model).
• The Cooperative’s finances, including in-kind support (which is highly encouraged) and how the Cooperative will ensure equitable distribution of funds among partners and organizations. AHRQ expects the initiative to be inclusive of organizations that are not traditionally AHRQ recipients, such as community-based organizations, and patient organizations. Applicants must describe how funding will flow to such partners in a way that ensures their full participation.
• Operational or Work Teams that will carry out the work of the Cooperative, including staffing, contracting, and hiring plans.
• Project Timeline, including a detailed timeline and a Gantt Chart (or other similar graphic timeline) documenting when all major aspects of the proposed work will be conducted and completed.
• Mitigation strategies, including the potential challenges, barriers, and facilitators to establishing a Cooperative and proposed strategies to address them.
• Collaboration with the National Coordinating Center, including a commitment to participate in Learning Networks and technical assistance activities.
• Collaboration with the National Evaluation Center, including a commitment to harmonize measures across the initiative, share instruments and data with the NEC and AHRQ, and participate in evaluation activities by the NEC.
• Collaboration with AHRQ: Describe plans to engage with AHRQ on key activities and decisions.
• Description of how the Multistakeholder Council members will prepare for operations after the end of this award (e.g., diversifying funding sources). Applicants may find Finding Sustainable Funding for Primary Care Extension Programs a useful resource.

Letters of Support: Provide letters of support from the Institution(s) and partners that are included in the Cooperative.

The application must include letters of support from collaborating organizations and individuals which document specific contributions, including but not limited to a description of the precise nature of past and proposed collaborations, products, services, and other activities that will be provided by and to the applicant through the proposed collaboration.

Applicants must submit a letter of support from the State Medicaid Agency. Letters of support from the State’s Medicaid Agency must:

• Describe the commitment to participate in the Multistakeholder Council.
• Identify specific individuals within the State Medicaid Agency who will participate in the Cooperative.
• Detail the role that these individuals and the State Medicaid Agency will have within the Cooperative.

Resource Sharing Plan:

Individuals are required to comply with the instructions for the Resource Sharing Plans as provided in the SF424 (R&R) Application Guide,

PHS Human Subjects and Clinical Trials Information (Administrative)

When involving human subjects research, clinical research, and clinical trials follow all instructions for the PHS Human Subjects and Clinical Trials Information form in the SF424 (R&R) Application Guide, with the following additional instructions:

If you answered “Yes” to the question “Are Human Subjects Involved?” on the R&R Other Project Information form, you must include at least one human subjects study record using the Study Record: PHS Human Subjects and Clinical Trials Information form or a Delayed Onset Study record.

Study Record: PHS Human Subjects and Clinical Trials Information

All instructions in the SF424 (R&R) Application Guide must be followed

Delayed Onset Study

Note: Delayed onset does NOT apply to a study that can be described but will not start immediately (i.e., delayed start). All instructions in the SF424 (R&R) Application Guide must be followed

Engagement, Training, Education, and Assistance Core

When preparing your application, use Component Type ‘Core.’

All instructions in the SF424 (R&R) Application Guide must be followed, with the following additional instructions, as noted.

SF424 (R&R) Cover (Engagement, Training, Education, and Assistance Core)

Complete only the following fields:

• Applicant Information
• Type of Applicant (optional)
• Descriptive Title of Applicant’s Project
• Proposed Project Start/Ending Dates

PHS 398 Cover Page Supplement (Engagement, Training, Education, and Assistance Core)

Research & Related Other Project Information (Engagement, Training, Education, and Assistance Core)

Human Subjects: Answer only the ‘Are Human Subjects Involved?’ and 'Is the Project Exempt from Federal regulations?’ questions.

Project Narrative:  Do not complete. Note: ASSIST screens will show an asterisk for this attachment indicating it is required. However, eRA systems only enforce this requirement in the Overall component and applications will not receive an error if omitted in other components.

Project /Performance Site Location(s) (Engagement, Training, Education, and Assistance Core)

List all performance sites that apply to the specific component.

Note: The Project Performance Site form allows up to 300 sites, prior to using additional attachment for additional entries.

Research & Related Senior/Key Person Profile (Engagement, Training, Education, and Assistance Core)

ASSIST will default to “Project Lead”. If you would like to use a different category, then replace “Project Lead” below with a different Category (e.g., Core Lead).

• In the Project Director/Principal Investigator section of the form, use Project Role of ‘Other’ with Category of ‘Project Lead’ and provide a valid eRA Commons ID in the Credential field.
• In the additional Senior/Key Profiles section, list Senior/Key persons that are working in the component.
• Include a single Biographical Sketch for each Senior/Key person listed in the application regardless of the number of components in which they participate. When a Senior/Key person is listed in multiple components, the Biographical Sketch can be included in any one component.
• If more than 100 Senior/Key persons are included in a component, the Additional Senior Key Person attachments should be used.   

Budget (Engagement, Training, Education, and Assistance Core)

Budget forms appropriate for the specific component will be included in the application package.

Note: The R&R Budget form included in many of the component types allows for up to 100 Senior/Key Persons in section A and 100 Equipment Items in section C prior to using attachments for additional entries. All other SF424 (R&R) instructions apply.

PHS 398 Research Plan (Engagement, Training, Education, and Assistance Core)

Specific Aims:    

Research Strategy: In this section applicants must describe their approach to the following activities:

Engage safety net healthcare delivery organizations and clinicians to establish and maintain relationships or build upon previous relationships. Applicants must describe:

• How the Cooperative’s engagement strategies will attract safety net healthcare delivery organizations and clinicians with varying degrees of organizational readiness.
• How the Cooperative will draw on existing learning and improvement networks such as quality collaboratives.
• How the Cooperative will coordinate within states where there are other state-level learning communities. Examples of state-level learning communities include, but are not limited to, learning communities that are formed as part of Innovation Models from the Centers for Medicare & Medicaid Services Innovation Center (e.g., Making Care Primary Model, States Advancing All-Payer Health Equity Approaches and Development Model).
• The potential challenges, barriers, and facilitators to engage safety net organizations and proposed strategies to address them.

Design and deliver implementation support, including:

• Describe how healthcare extension agents will aid with the implementation of the selected healthcare delivery improvements and implementation strategies as part of the initiative.
• Describe how healthcare extension agents will assist safety net healthcare delivery organizations with the development of an implementation plan, including the ability to tailor the implementation plan to the organization, clinicians, staff, and patient populations served by the organization.
• Describe how healthcare extension agents will work with healthcare delivery organizations, including the number and type of safety net organizations and clinicians that may be engaged, with what levels of intensity, at what points in time, and for how long.
• Describe the range of implementation support the Cooperative will provide for the initiative. Support may include education & training, practice facilitation, health IT support, local learning opportunities, expert consultation, quality measurement standardization and support, financial management guidance, community resource identification, tele-mentoring, task analysis, and workforce development.

Facilitate learning across the state or sub-state region: Applications must describe the approach to facilitating learning across the state or sub-state region, including:

• How the Cooperative will learn from the healthcare extension agents, healthcare delivery organizations, clinicians, and staff about local or regional successes and challenges with implementation of the initiative.
• How the Cooperative will share this information with healthcare extension agents, healthcare delivery organizations, clinicians, and staff to iteratively improve the initiative.
• How the Cooperative will share this information with the NCC.
• How the Cooperative will share PCOR evidence, evidence-based resources and learnings from other state and national initiatives with healthcare extension agents, healthcare delivery organizations, clinicians, and staff in their state or sub-state region.

Letters of support from partner organizations and entities should specify the nature of collaboration and their role in the Engagement, Training, Education, and Assistance Core. Applications must include letter(s) of support from an institutional official that endorse the proposed approach for the Engagement, Training, Education, and Assistance Core and describe the available institutional resources that will support the activities of the Engagement, Training, Education, and Assistance Core. Letters from individuals who will serve as consultants or collaborators on the project, but with no specified levels of efforts, should also be included. Do not include letters from individuals who will be supported by the cooperative agreement and are named in the application.

Resource Sharing Plan:

Individuals are required to comply with the instructions for the Resource Sharing Plans as provided in the SF424 (R&R) Application Guide,

PHS Human Subjects and Clinical Trials Information (Engagement, Training, Education, and Assistance Core)

When involving human subjects research, clinical research, and clinical trials follow all instructions for the PHS Human Subjects and Clinical Trials Information form in the SF424 (R&R) Application Guide, with the following additional instructions:

If you answered “Yes” to the question “Are Human Subjects Involved?” on the R&R Other Project Information form, you must include at least one human subjects study record using the Study Record: PHS Human Subjects and Clinical Trials Information form or a Delayed Onset Study record.

Study Record: PHS Human Subjects and Clinical Trials Information

All instructions in the SF424 (R&R) Application Guide must be followed

Delayed Onset Study

Note: Delayed onset does NOT apply to a study that can be described but will not start immediately (i.e., delayed start). All instructions in the SF424 (R&R) Application Guide must be followed

Monitoring, Feedback, and Evaluation Core

When preparing your application, use Component Type ‘Core.’

All instructions in the SF424 (R&R) Application Guide must be followed, with the following additional instructions, as noted.

SF424 (R&R) Cover (Monitoring, Feedback, and Evaluation Core)

Complete only the following fields:

• Applicant Information
• Type of Applicant (optional)
• Descriptive Title of Applicant’s Project
• Proposed Project Start/Ending Dates

PHS 398 Cover Page Supplement (Monitoring, Feedback, and Evaluation Core)

Research & Related Other Project Information (Monitoring, Feedback, and Evaluation Core)

Human Subjects: Answer only the ‘Are Human Subjects Involved?’ and 'Is the Project Exempt from Federal regulations?’ questions.

Project Narrative:  Do not complete. Note: ASSIST screens will show an asterisk for this attachment indicating it is required. However, eRA systems only enforce this requirement in the Overall component and applications will not receive an error if omitted in other components.

Application guide states that Project Narrative is required.  However, it is only required for the Overall component.  If you would like the applicant to provide a project narrative for this component, update the above instructions accordingly. Specific names provided for Other Attachments must be no more than 50 characters including spaces.

Project /Performance Site Location(s) (Monitoring, Feedback, and Evaluation Core)

List all performance sites that apply to the specific component.

Note: The Project Performance Site form allows up to 300 sites, prior to using additional attachment for additional entries.

Research & Related Senior/Key Person Profile (Monitoring, Feedback, and Evaluation Core)

ASSIST will default to “Project Lead”. If you would like to use a different category, then replace “Project Lead” below with a different Category (e.g., Core Lead).

• In the Project Director/Principal Investigator section of the form, use Project Role of ‘Other’ with Category of ‘Project Lead’ and provide a valid eRA Commons ID in the Credential field.
• In the additional Senior/Key Profiles section, list Senior/Key persons that are working in the component.
• Include a single Biographical Sketch for each Senior/Key person listed in the application regardless of the number of components in which they participate. When a Senior/Key person is listed in multiple components, the Biographical Sketch can be included in any one component.
• If more than 100 Senior/Key persons are included in a component, the Additional Senior Key Person attachments should be used.   

Budget (Monitoring, Feedback, and Evaluation Core)

Budget forms appropriate for the specific component will be included in the application package.

Note: The R&R Budget form included in many of the component types allows for up to 100 Senior/Key Persons in section A and 100 Equipment Items in section C prior to using attachments for additional entries. All other SF424 (R&R) instructions apply.

PHS 398 Research Plan (Monitoring, Feedback, and Evaluation Core)

Specific Aims: Succinctly describe the specific objectives and goals of the Monitoring, Feedback, and Evaluation Core. In addition, list in priority order, the broad activities, and services of the Monitoring, Feedback, and Evaluation Core. In addition, state the Core's relationship to the other Cores in the Cooperative, the initiative in the application, and the National Evaluation Center.

Research Strategy: In this section applicants must describe their monitoring, feedback, and evaluation plans, including:

• Data sources including state-level data
• The approach to identifying PCOR evidence and corresponding implementation strategies and sharing this information with the Multistakeholder Council for the initiative.
• The approach to analyzing and sharing state data with the Multistakeholder Council.
• The approach to monitoring and sharing Cooperative activities and performance.
• The approach to evaluating the process of Cooperative formation and growth, the engagement of stakeholders, the processes and outcomes of the Multistakeholder Council, the processes and outcomes of the Engagement, Training, Education, and Assistance Core. Describe process, implementation, and outcome measures; data sources and collection; and analysis plan.
• Describe how health equity and disparities will be incorporated throughout monitoring and evaluation activities.
• Describe how feedback will be delivered to improve the processes and operations of the Cooperative and its initiative.
• A commitment to work with AHRQ’s NEC on the evaluation, including sharing monitoring and evaluation data and cooperating with qualitative data collection activities. 

Letters of support from partner organizations and entities should specify the nature of collaboration and their role in the Monitoring, Feedback, and Evaluation Core. Applications must include letter(s) of support from an institutional official that endorse the proposed approach for the Monitoring, Feedback, and Evaluation Core and describe the available institutional resources that will support the activities of the Monitoring, Feedback, and Evaluation Core. Letters from individuals who will serve as consultants or collaborators on the project, but with no specified levels of efforts, should also be included. Do not include letters from individuals who will be supported by the award and are named in the application.  

Resource Sharing Plan:

Individuals are required to comply with the instructions for the Resource Sharing Plans as provided in the SF424 (R&R) Application Guide,

The PHS Human Subjects and Clinical Trials Information form replaces the Human Subjects section of the Research Plan form. NOFOs that do not allow clinical trials use this form for human subjects. See https://nih-extramural-intranet.od.nih.gov/d/sites/default/files/PHSHumanSubjectsandClinicalTrialsInformationForm-Internal_Use_Only.pptx for more information.

PHS Human Subjects and Clinical Trials Information (Monitoring, Feedback, and Evaluation Core)

When involving human subjects research, clinical research, and clinical trials follow all instructions for the PHS Human Subjects and Clinical Trials Information form in the SF424 (R&R) Application Guide, with the following additional instructions:

If you answered “Yes” to the question “Are Human Subjects Involved?” on the R&R Other Project Information form, you must include at least one human subjects study record using the Study Record: PHS Human Subjects and Clinical Trials Information form or a Delayed Onset Study record.

Study Record: PHS Human Subjects and Clinical Trials Information

All instructions in the SF424 (R&R) Application Guide must be followed

Delayed Onset Study

Note: Delayed onset does NOT apply to a study that can be described but will not start immediately (i.e., delayed start). All instructions in the SF424 (R&R) Application Guide must be followed

Initiative: Behavioral Health

When preparing your application, use Component Type ‘Project.’

All instructions in the SF424 (R&R) Application Guide must be followed, with the following additional instructions, as noted.

SF424 (R&R) Cover (Initiative: Behavioral Health)

Complete only the following fields:

• Applicant Information
• Type of Applicant (optional)
• Descriptive Title of Applicant’s Initiative
• Proposed Initiative Start/Ending Dates

PHS 398 Cover Page Supplement (Initiative: Behavioral Health)

Research & Related Other Project Information (Initiative: Behavioral Health)

Human Subjects: Answer only the ‘Are Human Subjects Involved?’ and 'Is the Project Exempt from Federal regulations?’ questions.

Project Narrative:  Do not complete. Note: ASSIST screens will show an asterisk for this attachment indicating it is required. However, eRA systems only enforce this requirement in the Overall component and applications will not receive an error if omitted in other components.

Application guide states that Project Narrative is required.  However, it is only required for the Overall component.

Project /Performance Site Location(s) (Initiative: Behavioral Health)

List all performance sites that apply to the specific component.

Note: The Project Performance Site form allows up to 300 sites, prior to using additional attachment for additional entries.

Research & Related Senior/Key Person Profile (Initiative: Behavioral Health)

ASSIST will default to “Project Lead”. If you would like to use a different category, then replace “Project Lead” below with a different Category (e.g., Core Lead).

• In the Project Director/Principal Investigator section of the form, use Project Role of ‘Other’ with Category of ‘Project Lead’ and provide a valid eRA Commons ID in the Credential field.
• In the additional Senior/Key Profiles section, list Senior/Key persons that are working in the component.
• Include a single Biographical Sketch for each Senior/Key person listed in the application regardless of the number of components in which they participate. When a Senior/Key person is listed in multiple components, the Biographical Sketch can be included in any one component.
• If more than 100 Senior/Key persons are included in a component, the Additional Senior Key Person attachments should be used.   

Budget (Initiative: Behavioral Health)

Budget forms appropriate for the specific component will be included in the application package.

Note: The R&R Budget form included in many of the component types allows for up to 100 Senior/Key Persons in section A and 100 Equipment Items in section C prior to using attachments for additional entries. All other SF424 (R&R) instructions apply.

PHS 398 Research Plan (Initiative: Behavioral Health)

Specific Aims: List the Aims of the proposed project. State the individual project's relationship to the Cooperative's overall goals and milestones and how it relates to other projects or cores.   

Research Strategy: This section should provide a detailed discussion of all aspects of the required behavioral health initiative. Recipients should consult with the Multistakeholder Council after award and may change specifics of the Initiative based on stakeholders’ input. Applicants must address the following:

• Explain the behavioral health focus of the initiative and how healthcare delivery will be changed if the proposed aims are achieved, with specific goals and improvement targets.
• Explain why and how the behavioral focus was selected, including use of State data and PCOR findings and engagement of current or future members of the Multistakeholder Council.
• Describe the scientific premise for the proposed initiative, including consideration of the strengths and weaknesses of published PCOR or preliminary data crucial to the support of the initiative.
• Discuss how the proposed initiative will address disparities.
• Describe in detail the proposed evidence-based approach to implementing the initiative, including specific goals and strategies. Applicants may draw upon many sources of PCOR evidence, such as AHRQ's Evidence Reports resources.
• Include a timeline for implementing the initiative with major milestones.
• Discuss plans for collaborations with community partners.
• If applicable, describe proposed strategies for recruiting healthcare delivery organizations.
• If applicable, describe the focus of training and workforce development
• If applicable, describe how implementation support resources will be developed, tested, and shared. AHRQ encourages stakeholder engagement and human-centered design in the development and testing of resources.  

Resource Sharing Plan:

Individuals are required to comply with the instructions for the Resource Sharing Plans as provided in the SF424 (R&R) Application Guide,

The PHS Human Subjects and Clinical Trials Information form replaces the Human Subjects section of the Research Plan form. NOFOs that do not allow clinical trials use this form for human subjects. See https://nih-extramural-intranet.od.nih.gov/d/sites/default/files/PHSHumanSubjectsandClinicalTrialsInformationForm-Internal_Use_Only.pptx for more information.

PHS Human Subjects and Clinical Trials Information (Initiative: Behavioral Health)

When involving human subjects research, clinical research, and clinical trials follow all instructions for the PHS Human Subjects and Clinical Trials Information form in the SF424 (R&R) Application Guide, with the following additional instructions:

If you answered “Yes” to the question “Are Human Subjects Involved?” on the R&R Other Project Information form, you must include at least one human subjects study record using the Study Record: PHS Human Subjects and Clinical Trials Information form or a Delayed Onset Study record.

Study Record: PHS Human Subjects and Clinical Trials Information

All instructions in the SF424 (R&R) Application Guide must be followed

Note: Delayed onset does NOT apply to a study that can be described but will not start immediately (i.e., delayed start).All instructions in the SF424 (R&R) Application Guide must be followed.

3. Unique Entity Identifier and System for Award Management (SAM)

See Part 2. Section III.1 for information regarding the requirement for obtaining a unique entity identifier and for completing and maintaining active registrations in System for Award Management (SAM), NATO Commercial and Government Entity (NCAGE) Code (if applicable), eRA Commons, and Grants.gov

4. Submission Dates and Times

Part I. Overview Information contains information about Key Dates and times. Applicants are encouraged to submit applications before the due date to ensure they have time to make any application corrections that might be necessary for successful submission. When a submission date falls on a weekend or Federal holiday, the application deadline is automatically extended to the next business day.

Organizations must submit applications to Grants.gov (the online portal to find and apply for grants across all Federal agencies) using ASSIST or other electronic submission systems. Applicants must then complete the submission process by tracking the status of the application in the eRA Commons, NIH’s electronic system for grants administration. NIH and Grants.gov systems check the application against many of the application instructions upon submission. Errors must be corrected and a changed/corrected application must be submitted to Grants.gov on or before the application due date and time.  If a Changed/Corrected application is submitted after the deadline, the application will be considered late.

Applicants are responsible for viewing their application before the due date in the eRA Commons to ensure accurate and successful submission. 

Information on the submission process and a definition of on-time submission are provided in How to Apply- Application Guide.

5. Intergovernmental Review (E.O. 12372)

This initiative is not subject to intergovernmental review.

6. Funding Restrictions

For efficient grant administration, AHRQ grant administration procedures will be used and conducted in accordance with the terms and conditions, cost principles, and other considerations described in the HHS Grants Policy Statement. The Grants Policy Statement can be found at http://www.ahrq.gov/funding/grants/policies/hhspolicy.html.

Grant funds may NOT be used for the purchase of food of any kind (refreshments, meals, etc.). AHRQ will not award funds to support the cost of food.

These awards will not be made under expanded authorities; therefore, pre-award costs are not allowable.

NOTE: No-Cost Extensions will not be allowed.

7. Other Submission Requirements and Information

Applications must be submitted electronically following the instructions described in the SF424 (R&R) Application Guide.  Paper applications will not be accepted. 

Applicants must complete all required registrations before the application due date. Section III. Eligibility Information contains information about registration.

For assistance with your electronic application or for more information on the electronic submission process, visit How to Apply – Application Guide. If you encounter a system issue beyond your control that threatens your ability to complete the submission process on-time, you must follow the Dealing with System Issues guidance. For assistance with application submission, contact the Application Submission Contacts in Section VII.

Important reminders:

All PD(s)/PI(s) and component Project Leads must include their eRA Commons ID in the Credential field of the Senior/Key Person Profile form. Failure to register in the Commons and to include a valid PD/PI Commons ID in the credential field will prevent the successful submission of an electronic application to AHRQ.

The applicant organization must ensure that the unique entity identifier provided on the application is the same identifier used in the organization’s profile in the eRA Commons and for the System for Award Management. Additional information may be found in the SF424 (R&R) Application Guide.

See more tips for avoiding common errors.

The applicant should pay particular attention to the SF424 (R&R) application guide instructions https://grants.nih.gov/grants/how-to-apply-application-guide/forms-f/general-forms-f.pdf) concerning letters of support. Letters of support, recommendation, or affirmation from any entity or individual not directly participating in the project should not be included.

Upon receipt, applications will be evaluated for completeness and compliance with application instructions by the Center for Scientific Review, and for responsiveness by AHRQ. Applications that are incomplete or non-compliant will not be reviewed.

Institutional Review Board (IRB) approval of human subjects is not required prior to peer review of an application (see https://grants.nih.gov/grants/guide/notice-files/NOT-HS-00-003.html). However, initiation of IRB review, if necessary or applicable, is strongly encouraged to assure timely commencement of research.

Although there is no immediate acknowledgement of the receipt of an application, applicants are generally notified of the review and funding assignment within eight (8) weeks.

Please be sure that you observe the total cost, project period, and page number limitations specified above for this NOFO. Application processing may be delayed or the application may be rejected if it does not comply with these requirements.

Post Submission Materials

Applicants are required to follow the instructions for post-submission materials, as described in the policy. Any instructions provided here are in addition to the instructions in the policy.

Priority Populations

AHRQ is committed to the inclusion of priority populations in health services research. The overall portfolio of health services research that AHRQ conducts and supports shall include the populations specifically named in AHRQ’s authorizing legislation: inner city; rural; low income; minority; women; children; elderly; and those with special health care needs, including those who have disabilities, need chronic care, or need end-of-life health care. 42 U.S.C. 299(c)(1). AHRQ also includes in its definition of priority populations those groups identified in Section 2(a) of Executive Order 13985 as members of underserved communities: Black, Latino, and Indigenous and Native American persons, Asian Americans and Pacific Islanders and other persons of color; members of religious minorities; lesbian, gay, bisexual, transgender, and queer (LGBTQ+) persons; persons with disabilities; persons who live in rural areas; and persons otherwise adversely affected by persistent poverty or inequality.

AHRQ will broadly implement this inclusion policy across the research that AHRQ supports and conducts so that the portfolio of research is inclusive of all populations. AHRQ intends that these populations be included in studies such that the research design explicitly allows conduct of valid analyses. The policy applies to all grant applications. Investigators should review the document entitled, AHRQ Policy on the Inclusion of Priority Populations, which is available at https://grants.nih.gov/grants/guide/notice-files/NOT-HS-21-015.html. Applicants under this NOFO must consider and discuss including priority populations in research design as specified in this Notice.

Public Access to AHRQ-Funded Scientific Publications

Investigators should review the document titled AHRQ Announces new Policy for Public Access to AHRQ-Funded Scientific Publications , which is available at (http://grants.nih.gov/grants/guide/notice-files/NOT-HS-16-008.html). For all research arising from AHRQ support, this policy requires that AHRQ-funded authors submit an electronic version of the author’s final peer-reviewed accepted manuscript to the National Library of Medicine's PubMed Central (PMC) to be made publicly available within 12 months of the publisher’s date of publication.

AHRQ Data Management Plan Policy

Investigators should review the document titled AHRQ Data Management Plan (DMP) Policy, which is available at (https://grants.nih.gov/grants/guide/notice-files/NOT-HS-20-011.html). This policy requires applicants for AHRQ new/competing grants and research contracts to include a DMP for managing, storing and disseminating the primary data, samples, physical collections, and other supporting materials created or gathered in the course of research funded by AHRQ, or state why data management is not possible, as a component of their grant application or research contract application.

Plan for Sharing Research Data

The precise content of the data-sharing plan will vary, depending on the data being collected and how the investigator is planning to share the data. Applicants who are planning to share data should describe briefly the expected schedule for data sharing; the format of the final dataset; the documentation to be provided; whether or not any analytic tools also will be provided; whether or not a data-sharing agreement will be required and, if so, a brief description of such an agreement (including the criteria for deciding who can receive the data and whether or not any conditions will be placed on their use); and the mode of data sharing (e.g., under its own auspices by mailing a disk or posting data on its institutional or personal website or through a data archive or enclave). Investigators choosing to share under their own auspices may wish to enter into a data-sharing agreement. References to data sharing may also be appropriate in other sections of the application.

The reasonableness of the data sharing plan or the rationale for not sharing research data will be assessed by the reviewers. However, reviewers will not factor the proposed data sharing plan into the determination of scientific merit or the priority score.

Data Confidentiality

The AHRQ confidentiality statute, 42 USC 299c-3(c), requires that information that is obtained in the course of AHRQ supported activities and that identifies individuals or establishments be used only for the purpose for which it was supplied. Information that is obtained in the course of AHRQ-supported activities and that identifies an individual may be published or released only with the consent of the individual who supplied the information or is described in it. There are civil monetary penalties for violation of the confidentiality provision of the AHRQ statute. 42 USC 299c-3(d). In the Human Subjects section of the application, applicants must describe procedures for ensuring the confidentiality of the identifying information to be collected (see NOT-HS-18-012: Confidentiality in AHRQ-Supported Research). The description of the procedures should include a discussion of who will be permitted access to this information, both raw data and machine-readable files, and how personal identifiers and other identifying or identifiable data will be restricted and safeguarded. Identifiable patient health information collected by recipient under this NOFO will also be obtained and managed in accordance with the HIPAA Privacy Rule, 45 CFR Parts 160 and 164.

The recipient should ensure that computer systems containing confidential data have a level and scope of security that equals or exceeds that established by the HIPAA Security Rules if applicable (see HIPAA website in prior paragraph) and that established by the Office of Management and Budget (OMB) in OMB Circular No. A-130, Appendix III - Security of Federal Automated Information Systems. The applicability and intended means of applying these confidentiality and security standards to subcontractors and vendors, if any, should be addressed in the application.

Sharing Research Resources: Rights in Data

Unless otherwise provided in grant awards, AHRQ recipients may copyright, or seek patents for, as appropriate, final and interim products and materials developed in whole or in part with AHRQ support, including, but not limited to, methodological tools, measures, software with documentation, literature searches, and analyses. Such copyrights and patents are subject to a royalty-free, non-exclusive, and irrevocable AHRQ license to reproduce, publish, use, or disseminate for any purpose consistent with AHRQ’s statutory responsibilities and to authorize others to do so for any purpose consistent with AHRQ’s statutory responsibilities. In accordance with its legislative dissemination mandate, AHRQ purposes may include, subject to statutory confidentiality protections, making project materials, databases, results, and algorithms available for verification or replication by other researchers. In addition, subject to AHRQ budget constraints, final products may be made available to the health care community and the public by AHRQ or its agents if such distribution would significantly increase access to a product and thereby produce substantial or valuable public health benefits. Ordinarily, to accomplish distribution, AHRQ publicizes research findings but relies on recipients to publish research results in peer-reviewed journals and to market grant-supported products. AHRQ requests that recipients notify the Office of Communications (OC) when an AHRQ-funded research article has been accepted for publication in a peer-reviewed journal. Researchers should submit manuscripts that have been accepted for publication in a peer-reviewed journal to [email protected] at least four to six weeks in advance of the journal’s expected publication date.

Regulations applicable to AHRQ recipients concerning intangible rights and copyright can be found at 45 CFR 75.322.

Section V. Application Review Information

1. Criteria

The mission of AHRQ is to produce evidence to make health care safer, higher quality, more accessible, equitable, and affordable, and to work with the U.S. Department of Health and Human Services (HHS) and other partners to make sure that the evidence is understood and used.

AHRQ's priority areas of focus are detailed here: https://www.ahrq.gov/funding/policies/nofoguidance/index.html.

As part of this mission, applications are submitted to AHRQ to support health services research which are evaluated for scientific and technical merit through the AHRQ peer review system.

Applications that are complete and responsive to the NOFO will be evaluated for scientific and technical merit by an appropriate objective group convened in accordance with standard AHRQ peer-review procedures that are described in 42 CFR Part 67, Subpart A. Incomplete and/or non-responsive applications or applications not following instructions given in this NOFO will not be reviewed. Only the review criteria described below will be considered in the review process.

Merit Review Criteria: Merit Review Criteria, as described below, will be considered in the review process.

A proposed Clinical Trial application may include study design, methods, and intervention that are not by themselves innovative but address important questions or unmet needs. Additionally, the results of the clinical trial may indicate that further clinical development of the intervention is unwarranted or lead to new avenues of scientific investigation.

Reviewers will provide an overall impact score to reflect their assessment of the likelihood for the project to exert a sustained, powerful influence on the research field(s) involved, in consideration of the following review criteria and additional review criteria (as applicable for the project proposed).

Reviewers will consider each of the review criteria below in the determination of scientific merit and give a separate score for each. An application does not need to be strong in all categories to be judged likely to have major scientific impact. For example, a project that by its nature is not innovative may be essential to advance a field.

Significance

Does the project address an important problem or a critical barrier to progress in the field? Is the prior research that serves as the key support for the proposed project rigorous? If the aims of the project are achieved, how will scientific knowledge, technical capability, and/or clinical practice be improved? How will successful completion of the aims change the concepts, methods, technologies, treatments, services, or preventative interventions that drive this field?

How will successful completion of the proposed work result in new, sustainable capacity to increase the delivery of PCOR evidence-based improvements in the state?

How will successful completion of the proposed work reduce disparities within the State in the delivery of PCOR evidence-based interventions to safety net populations?

How does the proposed work support a significant increase, as opposed to a modest incremental improvement, in the state’s capacity to disseminate and implement PCOR evidence-based improvements for safety net organizations?

In addition, for applications involving clinical trials

Are the scientific rationale and need for a clinical trial to test the proposed hypothesis or intervention well supported by preliminary data, clinical and/or preclinical studies, or information in the literature or knowledge of biological mechanisms? For trials focusing on clinical or public health endpoints, is this clinical trial necessary for testing the safety, efficacy or effectiveness of an intervention that could lead to a change in clinical practice, community behaviors or health care policy? For trials focusing on mechanistic, behavioral, physiological, biochemical, or other biomedical endpoints, is this trial needed to advance scientific understanding?

Investigator(s)

Are the PD(s)/PI(s), collaborators, and other researchers well suited to the project? If Early Stage Investigators or those in the early stages of independent careers, do they have appropriate experience and training? If established, have they demonstrated an ongoing record of accomplishments that have advanced their field(s)? If the project is collaborative or multi-PD/PI, do the investigators have complementary and integrated expertise; are their leadership approach, governance and organizational structure appropriate for the project?

Do the PD(s)/PI(s) have experience working in the state and with key stakeholders in the state including payors and healthcare delivery organizations that address the health needs of people who are underserved?

Is the single PD/PI devoting at least 20% minimum FTE (i.e., at least 8 hours per week) in each given year of the project? Are the multiple PD(s)/PI(s) each devoting at least 10% minimum FTE (i.e., at least 4 hours per week)? 

Is the Liaison to the NEC devoting at least 25% FTE to evaluation liaison activities? 

In addition, for applications involving clinical trials

With regard to the proposed leadership for the project, do the PD/PI(s) and key personnel have the expertise, experience, and ability to organize, manage and implement the proposed clinical trial and meet milestones and timelines? Do they have appropriate expertise in study coordination, data management and statistics? For a multicenter trial, is the organizational structure appropriate and does the application identify a core of potential center investigators and staffing for a coordinating center?

Innovation

Does the application challenge and seek to shift current research or clinical practice paradigms by utilizing novel theoretical concepts, approaches or methodologies, instrumentation, or interventions? Are the concepts, approaches or methodologies, instrumentation, or interventions novel to one field of research or novel in a broad sense? Is a refinement, improvement, or new application of theoretical concepts, approaches or methodologies, instrumentation, or interventions proposed?

In addition, for applications involving clinical trials

Does the design/research plan include innovative elements, as appropriate, that enhance its sensitivity, potential for information or potential to advance scientific knowledge or clinical practice?

Approach

Are the overall strategy, methodology, and analyses well-reasoned and appropriate to accomplish the specific aims of the project? Have the investigators included plans to address weaknesses in the rigor of prior research that serves as the key support for the proposed project? Have the investigators presented strategies to ensure a robust and unbiased approach, as appropriate for the work proposed? Are potential problems, alternative strategies, and benchmarks for success presented? If the project is in the early stages of development, will the strategy establish feasibility and will particularly risky aspects be managed? Have the investigators presented adequate plans to address relevant biological variables, such as sex, for studies for human subjects?

If the project involves human subjects and/or  clinical research, are the plans to address:

1) the protection of human subjects from research risks, and
2) inclusion (or exclusion) of individuals on the basis of sex/gender, race, and ethnicity, as well as the inclusion or exclusion of individuals of all ages (including children and older adults), justified in terms of the scientific goals and research strategy proposed?

 To what extent has the applicant demonstrated a clear understanding of the context of healthcare delivery in the state, including safety net healthcare delivery organizations and geographic diversity, and the need for this program and the planned activities. 

In addition, for applications involving clinical trials

Does the application adequately address the following, if applicable

Study Design

Is the study design justified and appropriate to address primary and secondary outcome variable(s)/endpoints that will be clear, informative and relevant to the hypothesis being tested? Is the scientific rationale/premise of the study based on previously well-designed preclinical and/or clinical research? Given the methods used to assign participants and deliver interventions, is the study design adequately powered to answer the research question(s), test the proposed hypothesis/hypotheses, and provide interpretable results? Is the trial appropriately designed to conduct the research efficiently? Are the study populations (size, gender, age, demographic group), proposed intervention arms/dose, and duration of the trial, appropriate and well justified?

Are potential ethical issues adequately addressed? Is the process for obtaining informed consent or assent appropriate? Is the eligible population available? Are the plans for recruitment outreach, enrollment, retention, handling dropouts, missed visits, and losses to follow-up appropriate to ensure robust data collection? Are the planned recruitment timelines feasible and is the plan to monitor accrual adequate? Has the need for randomization (or not), masking (if appropriate), controls, and inclusion/exclusion criteria been addressed? Are differences addressed, if applicable, in the intervention effect due to sex/gender and race/ethnicity?

Are the plans to standardize, assure quality of, and monitor adherence to, the trial protocol and data collection or distribution guidelines appropriate? Is there a plan to obtain required study agent(s)? Does the application propose to use existing available resources, as applicable?

Data Management and Statistical Analysis

Are planned analyses and statistical approach appropriate for the proposed study design and methods used to assign participants and deliver interventions? Are the procedures for data management and quality control of data adequate at clinical site(s) or at center laboratories, as applicable? Have the methods for standardization of procedures for data management to assess the effect of the intervention and quality control been addressed? Is there a plan to complete data analysis within the proposed period of the award?

Environment

Will the scientific environment in which the work will be done contribute to the probability of success? Are the institutional support, equipment and other physical resources available to the investigators adequate for the project proposed? Will the project benefit from unique features of the scientific environment, subject populations, or collaborative arrangements?

To what extent do letters of support from collaborating organizations and individuals indicate substantial engagement and document specific contributions of the partner during the proposed collaboration? 

In addition, for applications involving clinical trials

Does the application adequately address the following, if applicable

If proposed, are the administrative, data coordinating, enrollment and laboratory/testing centers, appropriate for the trial proposed?

Does the application adequately address the capability and ability to conduct the trial at the proposed site(s) or centers? Are the plans to add or drop enrollment centers, as needed, appropriate?

If international site(s) is/are proposed, does the application adequately address the complexity of executing the clinical trial?

If multi-sites/centers, is there evidence of the ability of the individual site or center to: (1) enroll the proposed numbers; (2) adhere to the protocol; (3) collect and transmit data in an accurate and timely fashion; and, (4) operate within the proposed organizational structure?

Additional Review Criteria - Overall

As applicable for the project proposed, reviewers will evaluate the following additional items while determining scientific and technical merit, and in providing an overall impact score, but will not give separate scores for these items.

Review Criteria - Engagement, Training, Education, and Assistance Core

How effectively will the applicant’s proposed approach facilitate learning across the state or sub-state region?

How effectively does the applicant’s proposed approach utilize healthcare extension agents to provide support for dissemination and implementation of PCOR evidence-based improvements?

Review Criteria Monitoring, Feedback, and Evaluation Core

How likely is it that the monitoring and feedback activities will enable the Cooperative to refine and improve its Cores and the initiative?

How likely is it that the evaluation will provide valid and useful information for state and national stakeholders?

Are the evaluation questions clear, meaningful, and consistent with the objectives of this NOFO?

Review Criteria - Administrative Core

How well does the applicant’s proposed approach fulfill the requirements of the Administrative Core?

How effectively will the applicant’s proposed approach create a Multistakeholder Council that can provide guidance and support for the Cooperative's initiative?

How effectively does the applicant’s approach create a Multistakeholder Council that includes participation from safety net healthcare delivery organizations and patients, families, and caregivers that represent the state’s diversity?

Review Criteria - Initiative

How likely is it that the approach of the Initiative will accelerate PCOR evidence-based improvement?    

How effectively will the proposed Initiative address the needs and priorities of the state?

Data Management Plan

The reviewers will comment on whether the Data Management Plan is reasonable

Inclusion of Priority Populations

Peer reviewers will assess the adequacy of plans to address the needs of AHRQ priority populations.

Peer reviewers must include their assessment of the proposed inclusion plan for priority populations in evaluating the overall scientific and technical merit of the application and assigning the impact score.

In evaluating the overall impact of the application, the review groups will:

• Evaluate the application for the presence or absence of the inclusion plan based on the proposed research objectives.
• Evaluate the adequacy of the proposed plan for the inclusion of priority populations.
• Evaluate the proposed justification for the exclusion of priority populations when a requirement for inclusion is described as inappropriate with respect to the purpose of the research.
• Evaluate the plans for outreach and recruitment of study participants, including priority populations, where appropriate.
• Evaluate the proposed plan for study design, execution, and outcome assessments so that study results will be relevant to one or more priority populations, where appropriate.
• Assess the plan as being acceptable or unacceptable with regard to the appropriateness of the inclusion or exclusion of priority populations in the proposed research.

Degree of Responsiveness

Reviewers will assess how well the application addresses the purpose and objectives of this NOFO. How responsive is the application to the special eligibility criteria, including the project requirements, noted in the NOFO?

Budget and Period of Support

The committee will evaluate whether the proposed budget is reasonable, and whether the requested period of support is appropriate in relation to the proposed research.

Resubmissions

Not Applicable

Renewals

Not Applicable

Revisions

Not Applicable

Additional Review Considerations - Overall

None

Applications from Foreign Organizations

Not Applicable

2. Review and Selection Process

Applications that are complete and responsive to the NOFO will be evaluated for scientific and technical merit by an appropriate Scientific Review Group convened in accordance with standard AHRQ peer review procedures that are described in 42 CFR Part 67, Subpart A. Incomplete and/or non-responsive applications or applications not following instructions given in this NOFO will not be reviewed.

As part of the scientific peer review, all applications:

• May undergo a selection process in which only those applications deemed to have the highest scientific and technical merit (generally the top half of applications under review) will be discussed and assigned an overall impact score.
• Will receive a written critique.

The following will be considered in making funding decisions:

• Scientific and technical merit of the proposed project as determined by scientific peer review.
• Availability of funds.
• Responsiveness to goals and objectives of the NOFO.
• Relevance and fit within AHRQ research priorities, as well as overall programmatic and geographic balance of the proposed project to program priorities

3. Anticipated Announcement and Award Dates

After the peer review of the application is completed, the PD/PI will be able to access their Summary Statement (written critique) via the eRA Commons. Refer to Part 1 for dates for peer review, advisory council review, and earliest start date.

Information regarding the disposition of applications is available in the HHS Grants Policy Statement (see https://www.ahrq.gov/funding/policies/hhspolicy/index.html).

Section VI. Award Administration Information

1. Award Notices

If the application is under consideration for funding, AHRQ Division of Grants Management staff will request "Just-In-Time" information from the applicant. Just-In-Time information generally consists of information on other support, any additional information necessary to address administrative and budgetary issues, and certification of IRB approval of the project's proposed use of human subjects. For details regarding IRB approval, applicants may refer to the "AHRQ Revised Policy for Institutional Review Board (IRB) Review of Human Subjects Protocols in Grant Applications" (https://grants.nih.gov/grants/guide/notice-files/not-hs-00-003.html). Applicant should also be aware of the AHRQ policy for use of single IRB for cooperative research, 45 CFR 46.114 (b)” https://grants.nih.gov/grants/guide/notice-files/NOT-HS-20-005.html".

IIf all administrative and programmatic issues are resolved, a formal notification in the form of a Notice of Award (NoA) will be provided to the applicant organization for successful applications. The NoA signed by the AHRQ grants management officer is the authorizing document and will be sent via email to the e-mail address designated by the recipient organization during the eRA Commons registration process.

Recipients must comply with any funding restrictions described in Section IV.6. Funding Restrictions.

Any application awarded in response to this NOFO will be subject to the UEI, SAM Registration, and Transparency Act requirements.

Individual awards are based on the application submitted to, and as approved by, the AHRQ and are subject to the AHRQ-specific terms and conditions identified in the NoA.

2. Administrative and National Policy Requirements

All AHRQ grant and cooperative agreement awards are subject to HHS’s “Uniform Administrative Requirements, Cost Principles, and Audit Requirements for HHS Awards,” (http://www.ecfr.gov/cgi-bin/text-idx?node=pt45.1.75, and the HHS Grants Policy Statement (see http://www.ahrq.gov/funding/policies/hhspolicy/index.html), and the terms and conditions set forth in the Notice of Award.

All applicants will be subject to a term and condition that applies the terms of 48 CFR section 3.908 to the award and requires that recipients inform their employees in writing of employee whistleblower rights and protections under 41 U.S.C. 4712 in the predominant native language of the workforce.

As necessary, additional Terms and Conditions will be incorporated into the NoA.

If you are successful and receive a Notice of Award, in accepting the award, you agree that the award and any activities thereunder are subject to all provisions of 45 CFR Part 75, currently in effect or implemented during the period of the award, other Department regulations and policies in effect at the time of the award, and applicable statutory provisions.

If you receive an award, HHS may terminate it if any of the conditions in 2 CFR 200.340(a)(1)-(4) are met. No other termination conditions apply.

There is a prohibition on certain telecommunications and video surveillance services or equipment that became effective on or after August 13, 2020.

If you receive an award, you must follow all applicable nondiscrimination laws. You agree to this when you register in SAM.gov. You must also submit an Assurance of Compliance (HHS-690). To learn more, see the HHS Office for Civil Rights website.

Below are available HHS resources on Health Literacy:

• HHS Health.gov: Health Literate Care Model
• AHRQ: Health Literacy Universal Precautions Toolkit

For additional guidance regarding how the provisions apply to AHRQ grant programs, please contact the Scientific/Research Contact that is identified in Section VII under Agency Contacts of this NOFO.

In accordance with the statutory provisions contained in Section 872 of the Duncan Hunter National Defense Authorization Act of Fiscal Year 2009 (Public Law 110-417), AHRQ awards will be subject to the Federal Recipient Performance and Integrity Information System (FAPIIS) requirements. FAPIIS requires Federal award making officials to review and consider information about an applicant in the designated integrity and performance system (currently FAPIIS) prior to making an award. An applicant, at its option, may review information in the designated integrity and performance systems accessible through FAPIIS and comment on any information about itself that a Federal agency previously entered and is currently in FAPIIS. The Federal awarding agency will consider any comments by the applicant, in addition to other information in FAPIIS, in making a judgement about the applicant’s integrity, business ethics, and record of performance under Federal awards when completing the review of risk posed by applicants as described in 45 CFR Part 75.205 “Federal awarding agency review of risk posed by applicants.” This provision will apply to all AHRQ grants and cooperative agreements except fellowships.

The following Terms and Conditions will be incorporated into the award notice and will be provided to the recipient at the time of award.

Terms and Conditions of Cooperative Agreement Award

The following special terms of award are in addition to otherwise applicable OMB administrative guidelines, DHHS grant administration regulations at 45 CFR Parts 75, and other DHHS, PHS, and AHRQ grant administration policy statements. AHRQ will use these procedures in evaluating and administering this cooperative agreement.

The administrative and funding instrument used for this program is the cooperative agreement. A cooperative agreement is an "assistance" mechanism (rather than an "acquisition” mechanism), in which substantial AHRQ programmatic involvement with the recipient is anticipated during the performance of the activities. Under a cooperative agreement, the AHRQ purpose is to support and stimulate the recipients' activities by involvement in and otherwise working jointly with the award recipient in a partnership role; it is not to assume direction, prime responsibility, or a dominant role in the activities. Consistent with this concept, the dominant role and prime responsibility resides with the grant recipient and the PD(s)/PI(s) for the project as a whole, although specific tasks and activities may be shared between the recipient and AHRQ as described in the NOFO. Cooperative activities are intended to strengthen the individual recipient activities through the facilitation of data sharing, data access and communications.

All cooperative activities that include significant government involvement will require prior approval by AHRQ.

Activities conducted under this award that involve the collection of information e.g., conducting surveys or requesting responses to uniform questions from nine or more persons, establishments or other entities, with certain exceptions, are currently required to be cleared by OMB under the Paperwork Reduction Act (PRA). (44 USC 3501-3521). PRA review and approval is required in cooperative agreements if AHRQ has significant input or control over the data collection activity. Submissions for clearance under the PRA are through AHRQ and HHS. Therefore, impacted recipients should include the time in their proposed timelines to develop materials and receive necessary clearances. It typically takes at least 6 months from date of initial submission to AHRQ and sometimes much longer if submissions are incomplete or the justification for the proposed data collection plans are questioned during the clearance process. Information collection that requires PRA clearance may not begin until recipients receive written notification via e-mail from AHRQ that clearance has been obtained.

obtained. Detailed information on the PRA can be found at Paperwork Reduction Act (PRA) of 1995 | Guidance Portal (hhs.gov)

Program Director/Principal Investigator (PD/PI) Responsibilities

The PD(s)/PI(s) will have the primary responsibility for operating the Cooperative in accordance with the terms and conditions of the Notice of Award, and cooperating with other key parties, including the AHRQ Program Official, other recipients, the NCC, and the NEC.

The PD(s)/PI(s) will be responsible for sharing issues with AHRQ and the NCC as it relates to the formation and operation of the Cooperative.

The PD(s)/PI(s) will be responsible for collaborating with AHRQ staff, the NEC, and the NCC in the publication and dissemination of program results and the eventual release to the scientific and healthcare communities of methods, tools, results, and other resources.   

The PD(s)/PI(s) will participate in monthly teleconferences with the Program Official and representatives from the NEC, NCC, or other AHRQ personnel as appropriate. The PD(s)/PI(s) will attend an annual meeting with AHRQ and other recipients, which is held in the Washington, D.C. area.

Learning Networks of State-based Healthcare Extension Cooperatives will be created to bring together recipients, NCC staff, NEC staff, and AHRQ staff to discuss progress on the Healthcare Extension Service, identify common challenges and engage in problem solving. Each PD/PI and any key personnel for the Cooperative's cores are expected to participate in the learning networks.

In addition to the annual progress report, the recipient is required to submit quarterly progress reports to AHRQ. The recipient is required to submit a logic model within the first six months of award.  Instructions on reporting requirements will be provided at the time of award.

AHRQ Responsibilities

AHRQ program staff will have substantial programmatic involvement that is above and beyond the normal stewardship role in awards, as described below.

Cooperative activities are intended to strengthen individual projects and at the same time generate collaboration across the projects. Specific cooperative aims and activities in carrying out individual projects may be shared among the recipients and with the NCC, the NEC, and the AHRQ program officials.

AHRQ staff will provide advice and support to the recipient and will assist in the cooperative work of the project beyond the usual program stewardship for grants.

The Program Official will maintain regular contact with the PD(s)/PI(s) to consult on key project decisions, help to troubleshoot implementation barriers and challenges, and confirm that projects are proceeding according to project timelines and plans. The Program Official will coordinate with the recipient, the NEC, and the NCC to disseminate project findings to research and policy audiences. Progress will be reviewed quarterly.

AHRQ will:

• Review the development of project timelines and project plans and assess progress.
• Work closely with recipients and the NEC to ensure harmonization of cross-recipient metrics for evaluation.
• Coordinate and facilitate collaboration and engagement with stakeholders.
• Facilitate the development of common frameworks, tool kits, and other products for implementation and evaluation activities.
• Participate in conference calls with recipients and annual in-person meetings.
• Work closely with recipients and other federal partners to ensure dissemination of products.
• Review and provide input on written documents, including information and materials for the activities conducted, prior to submission for publication or public dissemination.

Additionally, AHRQ program staff will be responsible for the normal scientific and programmatic stewardship of the award and will be named in the award notice.

Collaborative Responsibilities

Awardees will be required to work collaboratively with each other and with AHRQ to share information and develop common resources as noted above. Awardees and AHRQ will also participate in periodic meetings including monthly teleconferences and annual in-person meetings.

For details regarding annual progress report submission, refer to https://www.ahrq.gov/funding/grant-mgmt/noncomp.html. If instructions on the AHRQ website are different from the RPPR Instructions, follow the instructions on the AHRQ website. Annual progress reports are due 3 months before the start date of the next budget period of the award.

Recipients are required to submit expenditure data on the Federal Financial Report (FFR; SF 425) annually.

Expenditure data is to be reported on the Federal Financial Report (FFR; SF 425). AHRQ requires annual financial expenditure reports for ALL grant programs as described in the HHS Grants Policy Statement (https://www.ahrq.gov/funding/policies/hhspolicy/index.html). AHRQ implementation of the FFR retains a financial reporting period that coincides with the budget period of a particular project. However, the due date for annual FFRs is 90 days after the end of the calendar quarter in

which the budget period ends. For example, if the budget period ends 4/30/2023, the annual FFR is due 9/30/2023 (90 days after the end of the calendar quarter of 6/30/2023).

A final Progress Report, final Federal Financial Report, and Final Invention Statement are required when an award ends. All final reports are due within 120 days of the project period end date. For further details regarding grant closeout requirements, refer to http://www.ahrq.gov/funding/grant-mgmt/index.html#Closeout.

The Federal Funding Accountability and Transparency Act of 2006 (Transparency Act), includes a requirement for recipients of Federal grants to report information about first-tier subawards and executive compensation under Federal assistance awards issued in FY2011 or later. All recipients of applicable AHRQ grants and cooperative agreements are required to report to the Federal Subaward Reporting System (FSRS) available at www.fsrs.gov on all subawards over the threshold. See the 2 CFR Part 170 (https://www.ecfr.gov/current/title-2/subtitle-A/chapter-I/part-170) for additional information on this reporting requirement.

In accordance with the regulatory requirements provided at 45 CFR 75.113 and 2 CFR Part 200.113 and Appendix XII to 45 CFR Part 75 and 2 CFR Part 200, recipients that have currently active Federal grants, cooperative agreements, and procurement contracts from all Federal awarding agencies with a cumulative total value greater than $10,000,000 for any period of time during the period of performance of a Federal award, must report and maintain the currency of information reported in the System for Award Management (SAM) about civil, criminal, and administrative proceedings in connection with the award or performance of a Federal award that reached final disposition within the most recent five-year period. The recipient must also make semiannual disclosures regarding such proceedings. Proceedings information will be made publicly available in the designated integrity and performance system (currently FAPIIS). This is a statutory requirement under section 872 of Public Law 110-417, as amended (41 U.S.C. 2313). As required by section 3010 of Public Law 111-212, all information posted in the designated integrity and performance system on or after April 15, 2011, except past performance reviews required for Federal procurement contracts, will be publicly available. Full reporting requirements and procedures are found in Appendix XII to 45 CFR Part 75 and 2 CFR Part 200 – Award Term and Condition for Recipient Integrity and Performance Matters.

Program planning and performance reporting requirements:

Recipient performance will be measured based on success in the following Program goals:

Reach: Who was reached by the project?

• Performance measures:
• Number and type of stakeholders participating in the Multistakeholder Council
• Number, type, and size of safety net healthcare delivery organizations served by grant-supported healthcare extension services
• Timeline: Annual

Structure and Process: What strategies were implemented and how?

• Performance measures:
• Number of Multistakeholder Council meetings conducted and number of participants attending
• Timeline: Report Annually
• Number and type of healthcare extension agents hired or employed
• Number and type of policy, payment, or practice improvement activities planned and implemented
• Timeline: Report Annually
• Number and type of monitoring activities conducted and impact on program activities
• Timeline: Report Annually
• Costs and resources (personnel and non-personnel) associated with implementing healthcare extension service
• Timeline: Report annually (if possible) and cumulative at 5 years

Impact: What was the impact of implemented improvements?

• Performance measures:
• Improvement in outcome and equity measures relevant to projects selected by Cooperatives
• Timeline: Report annually
• Experience/satisfaction of organizations and individuals reached by extension services.
• Decision-making informed by patient-centered outcomes research
• Patient-centered outcomes research implemented in clinical practice
• Use of behavioral health services  targeted by state-based Healthcare Extension Service (percentage of Medicaid recipients in the state receiving evidence-based service (e.g., percent of adult Medicaid recipients screened for depression and anxiety)
• Timeline: Data collected through year 5, reach targets

Section VII. Agency Contacts

We encourage inquiries concerning this funding opportunity and welcome the opportunity to answer questions from potential applicants.

eRA Service Desk (Questions regarding ASSIST, eRA Commons, application errors and warnings, documenting system problems that threaten submission by the due date, and post-submission issues)

Finding Help Online: https://www.era.nih.gov/need-help  (preferred method of contact)
Telephone: 301-402-7469 or 866-504-9552 (Toll Free)

General Grants Information (Questions regarding application instructions, application processes, and NIH grant resources)
Email: [email protected] (preferred method of contact)
Telephone: 301-480-7075

Grants.gov Customer Support (Questions regarding Grants.gov registration and Workspace)
Contact Center Telephone: 800-518-4726
Email: [email protected]

Matthew Simpson, MD, MPH 
Division of Practice Improvement
Center for Evidence and Practice Improvement
Agency for Healthcare Research and  Quality
Email: [email protected]

Examine your eRA Commons account for review assignment and contact information (information appears two weeks after the submission due date).

Xavier Bogle, PhD
Scientific Review Officer
Division of Scientific Review 
Office of Extramural Research, Education, and Priority Populations 
Agency for Healthcare Research and Quality 
Email: [email protected] 
 

Name:  Janene Dyson
Office of Management Services
Division of Grants Management
Agency for Healthcare Research and Quality
Telephone: 301-427-1491
Email: [email protected]
 

Section VIII. Other Information

Recently issued AHRQ policy notices may affect your application submission. A full list of policy notices published by AHRQ is provided in the NIH Guide for Grants and Contracts. Notices can also be found at AHRQ Grants Policy Notices (https://www.ahrq.gov/funding/policies/hhspolicy/index.html).

This program is described in the Assistance Listings (formerly called the Catalog of Federal Domestic Assistance) at https://sam.gov/content/home and is not subject to the intergovernmental review requirements of Executive Order 12372 or Health Systems Agency review.

Awards are made under the authority of 42 USC 299 et seq., and in accordance with 45 CFR Part 75 and other referenced applicable statutes and regulations. All awards are subject to the terms and conditions, cost principles, and other considerations described in the HHS Grants Policy Statement. The HHS Grants Policy Statement can be found at http://www.ahrq.gov/funding/policies/hhspolicy/index.html