Notice2024-05585
Agency Information Collection Activities: Submission for OMB Review; Comment Request
Primary source
Metadata and text below are from the Federal Register, a public-domain U.S. government work. Always verify the official published version before relying on it for any legal matter.
Published
March 15, 2024
Issuing agencies
Health and Human Services DepartmentSubstance Abuse and Mental Health Services Administration
Full Text
<html>
<head>
<title>Federal Register, Volume 89 Issue 52 (Friday, March 15, 2024)</title>
</head>
<body><pre>
[Federal Register Volume 89, Number 52 (Friday, March 15, 2024)]
[Notices]
[Pages 18952-18954]
From the Federal Register Online via the Government Publishing Office [<a href="http://www.gpo.gov">www.gpo.gov</a>]
[FR Doc No: 2024-05585]
-----------------------------------------------------------------------
DEPARTMENT OF HEALTH AND HUMAN SERVICES
Substance Abuse and Mental Health Services Administration
Agency Information Collection Activities: Submission for OMB
Review; Comment Request
Periodically, the Substance Abuse and Mental Health Services
Administration (SAMHSA) will publish a summary of information
collection requests under OMB review, in compliance with the Paperwork
Reduction Act (44 U.S.C. chapter 35). To request a copy of these
documents, call the SAMHSA Reports Clearance Officer at
<a href="/cdn-cgi/l/email-protection#82f1e3efeaf1e3f2f0e3c2f1e3efeaf1e3aceaeaf1ace5edf4"><span class="__cf_email__" data-cfemail="1a697b7772697b6a687b5a697b7772697b34727269347d756c">[email protected]</span></a>.
Proposed Project: 2023-2026 Advancing Wellness and Resilience in
Education and Trauma Informed Services in Schools Cross-Site
Evaluation--New Collection
The Substance Abuse and Mental Health Services Administration
(SAMHSA) Center for Mental Health Services (CMHS) is requesting
clearance for data collection that is part of a national cross-site
evaluation of process, outcomes, and impact for the Advancing Wellness
and Resilience in Education (hereinafter referred to as Project AWARE)
and Trauma-Informed Services in Schools (TISS) programs.
The purpose of the Project AWARE-TISS Cross-Site Evaluation is to
better understand how each program is implemented, the extent to which
they facilitate collaboration between education agencies and mental
health systems, and how each program contributes to access and referral
to mental health services and improved outcomes for youth.
The AWARE-TISS Cross-Site Evaluation incorporates four evaluation
components to provide a robust understanding of the implementation
(process), outcomes, and associated impacts of the AWARE and TISS
Programs and includes program-specific components to ensure
programmatic differences and commonalities are understood. With this
integrated evaluation design, SAMHSA maintains the ability to evaluate
and report on each program separately, while additionally benefiting
from the ability to understand the overarching impact of both programs
collectively.
Approval is being requested for data collection associated with a
Process Evaluation and an Outcome Evaluation. Several program specific
sub-studies and cross-program impact analyses will also be conducted to
assess implementation and outcomes overall as well as those outcomes
specific to high-need subpopulations and under-resourced communities. A
behavioral health equity and cultural equity lens will be applied to
each area of evaluation to ensure a culturally specific understanding
of intervention implementation, outcomes, and impacts.
The Process Evaluation will contain two studies (Implementation and
Sustainability Study and Systems Change Study) that examine strategies
common to both programs related to program implementation facilitators
and barriers, workforce development, and grantees' plans to sustain
critical program components beyond their grant period. This assessment
of common elements will provide a means to compare the implementation
strategies that are successful across both AWARE and TISS grantees and
identify successes and challenges in changing systems, policies,
service provision, and school climate; increasing behavioral health
equity in access and service delivery; and increasing social and
emotional development and well-being in school-aged children and youth.
The Process Evaluation will also address implementation of program-
specific components.
For AWARE, the evaluation will document how the grantees implement
the three-tiered public health model in schools, inclusive of (Tier 1)
universal prevention and mental health promotion; (Tier 2) secondary
prevention and brief intervention services; and (Tier 3) tertiary
intervention and behavioral health treatment along with the referral
pathways to increase access to mental health promotion, prevention, and
intervention. The evaluation will assess the grantee collaborative
efforts and grantee activities intended to increase workforce capacity
to identify the signs and symptoms of mental illness and ability to
refer to appropriate services promptly.
For TISS, the Process Evaluation will focus on examining what
innovative strategies the grantees use to increase access to trauma
informed services for school-aged youth and how the collaborative
efforts of grantees and their partners develop/improve a school-based
system for identification, referral, early intervention, treatment, and
supportive services. Additionally, the Process Evaluation will assess
the implementation of training to improve school capacity to address
trauma support needs and engagement of families and communities to
increase awareness of the effects of trauma on children and youth.
The Outcome Evaluation will include two studies that examine
important facets of the AWARE and TISS programs: (1) identification and
referral infrastructure (Identification and Referral Study); and (2)
youth resiliency and outcomes (Youth Resiliency and Outcomes Study).
Both studies will provide critical information about the effectiveness
of the AWARE and TISS programs in establishing and enhancing school-
based mental health supports for students.
Program specific sub-studies, inclusive of two TISS case studies
and an AWARE Suicide Awareness and Prevention Sub-Study, will be
conducted to provide more extensive contextual and implementation
information related to the AWARE and TISS programs.
Finally, in addition to assessing the process and outcomes of each
of the AWARE and TISS programs, we will conduct two cross-program
analyses that examine the associated impacts of the both programs on
the establishment and enhancement of school-based mental health
supports for students (Cross-Program Impact Analysis) and the
relationships of program and contextual factors with outcomes
(Behavioral Health Equity Cross-Study Analysis).
The proposed multimethod approach considers allowable and required
activities, variation in the partnerships and provider networks/
infrastructure, program settings, populations being served, the range
of program implementation plans and goals, existing data systems, and
grant infrastructures that support implementation and evaluation
participation. In addition, the design considers the stage of
implementation of currently funded grantees to seamlessly integrate
cohorts appropriately into the evaluation studies.
Fourteen primary data collection activities compose the AWARE-TISS
Cross-Site Evaluation.
Instrument Descriptions
[ssquf] Implementation Survey (IS): The IS is a web-based survey
that includes questions on protocols, policies, and structures present
as part of schools'
[[Page 18953]]
AWARE and TISS implementation processes; school/community integration;
barriers and facilitators to implementation, and sustainability
capacity. The survey also includes questions to gather program-specific
information--for example, implementation of the pyramid model and
suicide prevention policies in the case of AWARE grantees and details
on trauma-informed services in the case of TISS grantees. The IS will
be completed by project coordinator and program staff representatives
annually. IS data will inform the Implementation and Sustainability
Study, AWARE Suicide Awareness and Prevention Sub-Study and Behavioral
Health Equity Cross-Study Analysis.
[ssquf] Implementation Key Informant Interview (IKII):
Supplementing IS findings, IKIIs will be conducted to obtain in-depth
information about AWARE and TISS program implementation and
sustainability based on the perspectives of grantee program staff and
local mental health system partner staff. In each year of the 3-year
data collection period, individual semi-structured interviews will be
conducted with key representatives of each grantee's collaborative
partnership group. Questions will focus on partnership development,
coordination, and shared decision-making; perspectives on
implementation including challenges, strategies, and successes;
contextual, systems, or other factors that affect implementation; and
approaches to planning for program sustainability. Interviews will be
conducted in person during training and technical assistance (TTA) site
visits or virtually when needed. IKII data will inform the
Implementation and Sustainability Study, TISS Case Studies and
Behavioral Health Equity Cross-Study Analysis.
[ssquf] Youth and Family Focus Group--Youth (YFFG-Y) and Youth and
Family Focus Group--Family (YFFG-F): The YFFG-Y and YFFG-F will be
conducted with youth (aged 14-18 or older if appropriate) who attend
schools implementing the AWARE or TISS programs and/or their parents/
family representatives. The moderator guides will be semi-structured
and include open-ended questions to understand experiences and
perspectives related to school climate, positive supports, youth or
parent engagement, student resiliency and coping skills, awareness of
school-based programs or resources to promote mental health literacy
and meet mental health needs, mental health resource availability, and
satisfaction with the program. Youth and family focus groups will be
conducted annually and will include youth or parents representing a
sample of AWARE and TISS grantees per year, such that all grantees will
participate in the focus groups at least once during the evaluation.
The YFFG-Y and YFFG-F will inform the Implementation and Sustainability
Study and Behavioral Health Equity Cross-Study Analysis. Data collected
through the YFFG-Y will also inform the Youth and Resiliency Outcomes
Study.
[ssquf] Collaboration and Partnership Survey (CPS): CPS is a web-
based survey that assesses communication, working relationships,
leadership, role-expectations, resources, and partner engagement/
commitment. Respondents will also be asked whether their organization
currently has a formal, signed memorandum of agreement with the grantee
and what changes to policy and infrastructure have been made in the
past year. State and local entities, including project coordinators,
school administrators, and mental health providers, identified as
partners by AWARE and TISS Grantees will be considered for
participation. The CPS will be administered annually and will inform
the Systems Change Study.
[ssquf] Training Summary Form (TSF): TSF is a web-based form that
will be used annually by AWARE and TISS grantees to document training
and educational seminars. It will include training dates, length of
time of training (in hours), topic of the training, training
objectives, format of training delivery (in-person, webinar, online
asynchronous, etc.), intended audience, and number of training
participants. It is estimated that grantees will conduct up to 10
trainings annually for different groups (e.g., teachers, mental health
professionals, instructional support personnel). The TSF will inform
the Systems Change Study and AWARE Suicide Awareness and Prevention
Sub-Study.
[ssquf] Participant Feedback Form (PFF): The PFF is a web-based
form that assesses perceptions of immediate and longer-term benefits in
training areas that research has linked to effective implementation and
practice change. The PFF will be completed annually by grantee training
participants after training events to gather perception of the training
experience and perceived feasibility of using the information. The PFF
will inform the Systems Change Study.
[ssquf] AWARE Pre-Post Training Survey (APPTS) and TISS Pre-Post
Training Survey (TPPTS): The APPTS and TPPTS are web-based surveys
intended to be taken before and after AWARE or TISS grantee trainings
across the 3-year data collection period. The APPTS will be completed
by a sample of training participants per AWARE grantee annually and
assesses knowledge, attitudes, and beliefs related to identifying
students in need of mental health services and referring them for
mental health services, mental health literacy, attitudes, beliefs
(including stigma), and self-efficacy to provide support and referrals
to youth experiencing mental health symptoms. The TPPTS will be
completed by sample of training participants per TISS grantee annually
and assesses trainee's knowledge of and self-efficacy to use trauma-
informed strategies in their work. The APPTS and TPPTS will inform the
Systems Change Study.
[ssquf] Workforce Follow-up Survey (WFS): The WFS is a web-based
survey that assesses barriers and facilitators to training use and the
extent to which participants identified students in need of mental
health services and referred them to services. The WFS will be
administered to approximately 50% of AWARE and TISS training
participants that also completed the APPTS or TPPTS. The WFS will be
completed 3- and 12-months after training events and will be used to
measure behavioral changes and longer-term impact on systems and
communities. The WFS will inform the Systems Change Study.
[ssquf] Student Climate and Safety Survey (STCSS), School Staff
Climate and Safety Survey (SSCSS), and Parent Climate and Safety Survey
(PCSS): The STCSS, SSCSS, and PCSS are web-based surveys assessing
school climate and safety among students attending grantee LEAs,
parents of students, school personnel, and LEA staff. Surveys will be
administered in year one and in year three of the evaluation and assess
availability and utilization of referral for services (for students,
parents, and school staff), trauma-informed practices (for school
staff), respect for diversity (for school staff), racial climate (for
students). The STCSS, SSCSS, and PCC will inform the Systems Change
Study.
[ssquf] Student Identification and Referral Form (SIRF): The SIRF
is a web-based form that gathers existing data detailing each how youth
in need of mental health, substance use, or trauma-specific support
services were identified because of an AWARE or TISS program, whether
and to which services youth were referred, and resulting services
received. Establishing identification and referral systems, including
coordination with support service providers equipped to meet the needs
of youth, is a core component of AWARE and TISS grant requirements. The
SIRF will be completed by grantee program staff for up to 100 youth
annually per grantee as
[[Page 18954]]
part of a record review for each youth identified and referred to
support services. Information about the initial identification,
including the location and pathway to identification (e.g., individual,
screening tool, staff role), is obtained, along with information about
referrals and support services received following identification. The
form also includes deidentified demographic information about the youth
receiving the identification, referral, and follow-up care. SIRF data
can be extracted from case records of school-based care coordinators or
mental health providers, or other existing data sources, including any
school staff, support service provider, and family members who make a
mental health, substance use, or trauma-related identification and
referral. No personal identifiers are requested on the SIRF. SIRF data
will inform the Identification and Referral Study and Behavioral Health
Equity Cross-Study Analysis.
The estimated response burden to collect this information
associated with the AWARE-TISS Cross-Site Evaluation is as follows
annualized over the requested 3-year clearance period is presented
below. Annual Burden (hours) and Total Cost ($) are rounded to the
nearest whole number.
---------------------------------------------------------------------------
\1\ BLS OES May 2022 National Industry-Specific Occupation
Employment and Wage Estimates average annual salary for Community
and Social Service Specialists, All Other (code 21-1099); <a href="https://www.bls.gov/oes/current/oes_nat.htm#21-0000">https://www.bls.gov/oes/current/oes_nat.htm#21-0000</a>.
\2\ BLS OES May 2022 National Industry-Specific Occupation
Employment and Wage Estimates average annual salary for Community
and Social Service Assistants (code 21-1093); <a href="https://www.bls.gov/oes/current/oes_nat.htm#21-0000">https://www.bls.gov/oes/current/oes_nat.htm#21-0000</a>.
Total and Annualized Averages: Respondents, Responses, and Hours
--------------------------------------------------------------------------------------------------------------------------------------------------------
Total Burden per Annual
Instrument Type of respondent Number of Responses per number of response burden Hourly wage Total cost
respondents respondent responses (hours) (hours) rate ($) ($)
--------------------------------------------------------------------------------------------------------------------------------------------------------
IS............................... Project Coordinator. 143 1 143 0.5 72 \1\ $35.52 $2,557
IS............................... Program Staff....... 15 1 15 0.5 8 \2\ 21.71 174
IKII............................. Project Coordinator. 94 1 94 1 94 35.52 3,339
IKII............................. Mental Health 141 1 141 1 141 \3\ 69.39 9,784
Provider.
IKII............................. School Administrator 47 1 47 1 47 \4\ 54.21 2,548
YFFG-Y........................... Youth............... 79 1 79 1.5 119 \5\ 7.25 863
YFGG-F........................... Parent of Youth..... 79 1 79 1.5 119 7.25 863
CPS.............................. Project Coordinator. 143 1 143 0.25 36 35.52 1,279
CPS.............................. Program Staff....... 47 1 47 0.25 12 21.71 261
CPS.............................. School Administrator 47 1 47 0.25 12 54.21 651
TSF.............................. Program Staff....... 47 10 470 0.15 71 21.71 1,541
PFF.............................. Program Trainee..... 2,775 1 2,775 0.15 416 \6\ 26.81 11,153
APPTS............................ Program Trainee..... 4,000 2 8,000 0.25 2,000 26.81 53,620
TPPTS............................ Program Trainee..... 750 2 1,500 0.25 375 26.81 10,054
WFS.............................. Program Trainee..... 2,391 2 4,782 0.25 1,196 26.81 32,065
PCSS............................. Parent of Youth..... 282 1 282 0.4 113 7.25 819
STCSS............................ Youth............... 282 1 282 0.4 113 7.25 819
SSCSS............................ School Staff........ 282 1 282 0.5 141 \7\ 30.20 4,258
SSCSS............................ School Administrator 188 1 188 0.5 94 54.21 5,096
SIRF............................. Program Staff....... 47 100 4,700 0.5 2,350 21.71 51,019
------------------------------------------------------------------------------------------------
Total........................ .................... 11,879 .............. 24,096 ........... 7,529 ........... 192,763
--------------------------------------------------------------------------------------------------------------------------------------------------------
Written comments and recommendations for the proposed information
collection should be sent within 30 days of publication of this notice
to <a href="http://www.reginfo.gov/public/do/PRAMain">www.reginfo.gov/public/do/PRAMain</a>. Find this particular information
collection by selecting ``Currently under 30-day Review--Open for
Public Comments'' or by using the search function.
---------------------------------------------------------------------------
\3\ BLS OES May 2022 National Industry-Specific Occupation
Employment and Wage Estimates average annual salary for Healthcare
Diagnosing or Treating Practitioners (code 29-1000); <a href="https://www.bls.gov/oes/current/naics5_541720.htm#29-0000">https://www.bls.gov/oes/current/naics5_541720.htm#29-0000</a>.
\4\ BLS OES May 2022 National Industry-Specific Occupation
Employment and Wage Estimates average annual salary for Educational
Administrators, All Other (code 11-9039); <a href="https://www.bls.gov/oes/current/naics5_541720.htm#11-0000">https://www.bls.gov/oes/current/naics5_541720.htm#11-0000</a>.
\5\ <a href="https://www.usa.gov/minimum-wage">https://www.usa.gov/minimum-wage</a>.
\6\ BLS OES May 2022 National Industry-Specific Occupation
Employment and Wage Estimates average annual salary for Community
and Social Service Occupations (code 21-0000); <a href="https://www.bls.gov/oes/current/oes_nat.htm#21-0000">https://www.bls.gov/oes/current/oes_nat.htm#21-0000</a>.
\7\ BLS OES May 2022 National Industry-Specific Occupation
Employment and Wage Estimates average annual salary for Educational,
Guidance, and Career Counselors and Advisors (code 21-2012); <a href="https://www.bls.gov/oes/current/naics5_541720.htm#21-0000">https://www.bls.gov/oes/current/naics5_541720.htm#21-0000</a>.
Alicia Broadus,
Public Health Advisor.
[FR Doc. 2024-05585 Filed 3-14-24; 8:45 am]
BILLING CODE 4162-20-P
</pre><script data-cfasync="false" src="/cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js"></script></body>
</html>Indexed from Federal Register on March 15, 2024.
This is legal information, not legal advice. Laws vary by jurisdiction and change frequently. Always verify current law with official sources and consult a licensed attorney in your jurisdiction for advice on your specific situation.