Substance Abuse & Mental Health Services Administration

The Substance Abuse and Mental Health Services Administration (SAMHSA)

Service to Science Subcontracts

Kids around a table

On behalf of SAMHSA, the CAPT awards subcontracts to innovative substance abuse prevention programs through the Service to Science Initiative Request for Proposals on Building Evaluation Capacity for Evidence-Based Interventions, a competitive proposal solicitation and review process. The purpose of the subcontracts is to help programs that have participated in Service to Science further refine their evaluation efforts.

Selected programs receive up to $30,000 per program per year, depending upon fund availability. Funded organizations have used subcontract funding to enhance evaluation research designs, develop and administer assessment tools, include reliable and valid measures of outcome and intervening variables, and run more complex analyses of collected evaluation data, among many other enhancements.

Since 2005, SAMHSA has awarded Service to Science subcontracts to nearly 200 programs across the nation. Below are links to descriptions of awardees and evaluation enhancements implemented under the subcontract.

FY2014 Subcontract Awardees

Program

Populations

Approach

Enhancements

The After School Program

Loup City, NE

Children in kindergarten through sixth grade

A socio-emotional and academic skills-building program that aims to prevent substance abuse by addressing the following risk factors: poor academic scores, emotional and behavioral problems, and child safety

Use a validated tool to evaluate outcomes, use a parent survey and pre-test and post-test surveys, use electronic attendance collection that includes dosage data, and perform a comparison study at the end of the school year

AMAZE

St. Paul, MN

Young people and the adults who teach and care for them

An educational program that aims to reduce the occurrence of risk factors for substance abuse (e.g., social isolation, aggression toward peers, violence and trauma) by promoting safe, caring, and inclusive schools and communities

Develop and field-test two survey instruments with participating teachers to measure the impact of the program’s three-hour anti-bias education teacher training

Anishnaabek Healing Circle: Sowing the Seeds of Recovery

Sault Ste Marie, MI

American Indian adults and adolescents (ages 12 and older) in Michigan

A series of digital stories told by people from Michigan tribal communities who are in recovery from addiction, which aims to engage and educate tribal communities about the healing journey of recovery and prevent or delay the onset of substance abuse

Complete refinements to the written logic model, begin work on a digital logic model to find an effective approach to convey to the Anishnaabek community members what the Sowing the Seeds of Recovery initiative is about, and refine the computer-based Anishnaabek Cultural Assessment

Asian American Family Enrichment Network

Rosemead, CA

Chinese and Korean immigrant parents or primary caregivers

A linguistically appropriate, culturally competent, and skills-based parenting educational program that aims to reduce or prevent youth substance abuse by increasing the emotional and behavioral self-efficacy of immigrant parents to enhance the safety and healthy development of their intermediate and high school-age children

Implement an evaluation design that will collect pre- and post-intervention data from both an intervention group and a comparison group, collect data to assess the impact of potential moderator variables (e.g., program dosage and implementation fidelity) on program effectiveness, and implement a youth questionnaire with the children of participating immigrant parents

Community Mobilization Video Project

Watertown, MA

Low-income, minority youth ages 12 to 17 who are living in and around public housing developments

An educational and community-mobilization program that aims to promote positive change in attitudes and behaviors regarding sexual behavior and alcohol, tobacco, and other drug use by implementing peer leadership programs using video and other media enhancements

Develop a survey that assesses condom use and alcohol, tobacco, and other drug use, as well as related knowledge and attitudes, and also measures how well CMVP works to develop critical-thinking skills around interpreting media messages in order to enable participants to make healthier choices; and conduct focus groups with former CMVP participants to understand more concretely how and when shifts in thinking happen

Date but Wait ("D8BTW8")

Tahlequah, OK

Native American youth in grade 9

A 60- to 90-minute classroom program that aims to expand and incorporate multi-tiered prevention strategies to reduce the consequences of engaging in sexual activity, violence, and substance abuse

Incorporate a three-step approach that includes a pre-survey before the initial program content is delivered, a post-survey upon the conclusion of the program, and a final survey to be delivered 30 days following the initial program presentation

Doorway to a Sacred Place

Anchorage, AK

Alaska Native peoples

A guide for Alaska Native peoples to complement the existing Critical Incident Stress Management crisis models. The guide includes four different traditional healing techniques that may be adapted by individual tribes; the Teaching Circles module can be used to discuss with youth and families difficult topics, such as substance abuse.

Use pre- and post-test measures for the associated training, collecting follow-up data from those who accessed the guide or corresponding training to determine if and how the strategies outlined in the guide have been used in the community, and provide feedback to behavioral health directors on the outcomes of the evaluation findings

Environmental Learning for Kids

Denver, CO

Culturally diverse, low-income, at-risk youth ages 8 to 25

A nonprofit science-based outdoor education intervention that aims to increase the chances that youth will develop self-esteem, science knowledge, and leadership skills, and that they will successfully navigate the downtime, risk factors, and negative behaviors that can lead to drug and alcohol abuse, by providing carefully constructed, science-based access to the natural environment

Develop a consistent dosage metric to capture differences in exposure to the program’s components among participating youth and that can be compared to results from various assessment instruments; analyze evaluation data about youths’ exposure to ELK programs; and formalize evaluation data collection, management, and analysis to track information about dosage, assessment results, and long-term outcomes

Family Connections

Evansville, IN

At-risk youth ages 14 to 18 and their parents or caregivers

An educational program that aims to reduce teen alcohol, tobacco, and other drug use by helping families to better handle conflict and strengthen communication, management, and monitoring strategies

Implement an experimental design, implement reliable and validated outcome measures, analyze program outcomes at three time periods (i.e., pre-, post-, and three-month follow-up), implement standardized fidelity measures, and increase capacity for participant screening

Gathering of Native Americans in Urban Areas

Oakland, CA

Native youth ages 10 to 18 living in urban areas

A culturally-based youth behavioral health prevention program that aims to prevent substance abuse and mental illness through a curriculum focused on building cultural teachings and identity

Refine the GONA fidelity tool, develop a research protocol for the GONA retrospective study, pilot and revise the GONA retrospective study, and apply for Institutional Review Board approval for the GONA retrospective study

HATCH

Houston, TX

LGBTQ youth and their allies ages 13 to 20

A peer support/social network program that aims to prevent and reduce substance abuse by decreasing social isolation and providing a safe social environment

Review and strengthen the evaluation tool, review and strengthen data collection criteria, establish data collection and analysis procedures, gather qualitative factors, and publish findings

Make Parenting a Pleasure

Eugene, OR

Parents of children, ages 0 to 8

A comprehensive research-based curriculum designed to strengthen parenting skills and provide support to highly stressed parents, with the aim of reducing child abuse, trauma, and future substance abuse, and positively affecting both cognitive and social-emotional development in children.

Conduct a clinical trial of the efficacy of the curriculum, including a pre-test survey, a final post-test survey, and performing data analysis 

Mobilizing the Community

Marlborough, MA

Adolescents, ages 12 to 17

A research-based, youth-led prevention program that aims to address the problem of underage drinking by changing attitudes and norms that support or encourage underage drinking, as well as promoting readiness and efficacy to refrain from or discourage drinking

Plan logistics for data collection and analysis, develop data collection instruments, develop data entry systems, create a detailed analysis plan, document how to collect and record data for each component of the evaluation, pilot-test the evaluation of the Policy Task Force, train staff to implement the evaluation enhancements

Responsibility Toolkit

Columbia, SC

Management, employees, and patrons of on-premise alcohol retail establishments

A communication campaign that aims to reduce or prevent injury and deaths in the county due to drinking by increasing on-premise employee participation in responsible beverage service training and reducing over-service to intoxicated patrons

Develop tools to measure over-service within establishments as well as patron and employee responses to materials in the toolkit; enhance the current Toolkit delivery script used by the officer; training volunteers to collect baseline data on over-service; using a comprehensive evaluation design that includes a comparison group and pre- and post-tests; train officers to record information accurately; track the impact of supporting communications and media strategies; report findings to Task Force and community stakeholders

Safe Out

Phoenix, AZ

Adult LGBTQ population

An educational and community mobilization program that aims to reduce excessive alcohol consumption by implementing a marketing campaign that uses traditional and social media, pursuing policy change, and partnering with local LGBTQ-friendly bars to train servers and bartenders on responsible beverage service.

Conduct a prevalence survey of the LGBTQ population in the Phoenix Metropolitan Area to understand the impact of current program efforts on alcohol use, expand current evaluation processes to measure impact on illicit drug use and alcohol use, solicit the community’s perceptions on Safe Out’s marketing efforts (social and print media) through focus groups and interviews, and conduct an in-depth analysis of the responsible beverage service training delivered to identified LGBTQ-friendly bar staff

School Community Intervention & Prevention

Lincoln, NE

Children and adolescents, ages 4 to 18

An early problem identification and referral program that aims to reduce or prevent youth substance abuse by addressing, supporting, and assisting students and families experiencing difficulties related to substance abuse and related behavioral health problems.

Develop and implement a quasi-experimental research study and enhance and implement consumer evaluations with parents, students, and teachers.

Student and Family Advisory

Princeton, NJ

Students in middle and high schools and their parents or caregivers, teachers, and administrators

A social support program that aims to reduce youth substance abuse and a constellation of other risk behaviors by increasing connection to pro-social peers, faculty advisors, and school

Develop the post-program survey; administer pre- and post-program surveys; execute an evaluation design that includes a comparison school not receiving the program; develop, finalize, and implement fidelity monitoring instruments for faculty advisor trainings; and finalize and implement fidelity monitoring instruments for program sessions.

Teck John Baker Youth Leaders Program

Kotzebue, AK

Young people, ages 4 to 25

A peer-helper program that aims to prevent substance abuse, bullying, violence, and suicide and promote school retention and an improved school climate overall by: identifying young people who are respected by their peers, training them to recognize when peers are struggling, and teaching them to reach out to those peers and refer them to service providers

Build staff capacity, develop systems for continual evidence-based reflection and program improvements, and assess the effectiveness of program components and the program overall

Tobacco Use Prevention and Control Program

Koror, Palau

Pregnant women and nursing mothers in Palau

A communication campaign that aims to prevent tobacco use through a national social marketing campaign

Obtain qualitative and quantitative information from women of childbearing age; administer surveys throughout Palau communities; conduct a self-administered survey; provide incentives to participants of the survey; conduct focus groups; collect and analyze data to be subsequently presented to stakeholders, published in local media, and used to create an effective social-marketing plan; and recommend that the Family Health Unit incorporate survey questions into their Well-Baby and PRAMS surveillance systems

Valley Hi Community Mobilization Project

Sacramento, CA

Youth, ages 9 to 18, in Valley High School and Samuel Jackman Middle School

An educational and community mobilization prevention program that aims to prevent substance abuse by providing opportunities for young community members to participate in safe and constructive activities during out-of-school hours.

Use the Time Series Design with Comparison Group approach to collect data at regular intervals before and after the intervention, and to collect data from a comparison community that did not receive the same or similar interventions as the Valley Hi community; and enrich the VHCMP’s overall evaluation capacity through specific professional development trainings in the areas of quantitative analysis and evaluation methodologies.

Wiconi Ohitika Youth Suicide Prevention Project

Fort Totten, ND

Native American adolescents and young adults

An educational and community mobilization campaign that aims to reduce risk factors contributing to high rates of substance abuse and suicide in the tribal community by increasing young peoples’ connections to family and community through cultural strengthening activities

Create an evaluation workgroup that meets monthly, conduct focus groups and individual interviews with youth and elders, develop an instrument to measure program outcomes (e.g., increased knowledge of seven values, increased coping skills, reduced intent to use substances, reduced depression, increased connectedness) and administer to individuals who had participated in the focus group, disseminate to the community the results of the enhanced evaluation, and submit an article for publication.

YESS Institute

Denver, CO

9th and 10th graders at risk for dropping out of school

A comprehensive, wrap-around student engagement and peer-mentoring program that aims to reduce substance abuse by re-engaging youth in learning and providing them with the social-emotional and academic support they need to successfully graduate

Conduct an in-depth analysis of the impact of the YESS peer-mentoring model on interrupting the school-to-prison pipeline—with a strong focus on discipline, attendance (including excused and unexcused absences), and substance abuse; apply a quasi-experimental propensity matching study design; and seek to achieve publication in a peer-reviewed journal

Youth Education and Support Program

East Lansing, MI

Middle school youth in grades 6 through 8

A psychoeducational program that aims to prevent or delay the onset of substance abuse and depression

Develop a stronger community-university evaluation team, add a youth outcome substance abuse measure to examine how the educational intervention affected student-reported drug use behaviors, incorporate follow-up data collection, train program fidelity observers, collect qualitative data from parents or guardians, complete psychometric testing using the Knowledge of Mental Illness and Recovery scale, and develop a first draft of a new coping scale for youth

Youth Smart Program

Majuro, Marshall Islands

Youth with limited parental guidance who have dropped out of school or are at risk of dropping out

A multi-service and educational program that provides youth with trainings and activities related to life skills, basic academics, and cultural traditions and that offers their caregivers parenting skills training and group and family counseling

Develop and distribute written surveys for all past participants, conduct interviews with a representative sample of past participants, conduct focus groups with schools, perform a document analysis of past program documentation, and design and establish a database to track all aspects of the program that are currently not being recorded

FY2013 Subcontract Awardees

Program

Populations

Approach

Enhancements

21 Reasons

Augusta, ME

Adolescents

A program that applies a multi-method approach to reducing youth substance abuse (e.g., media advocacy, social norms marketing, social support, parenting education)

Implement pre-/post-evaluation comparing exposed and unexposed participants

Adventures in a Caring Community

Tesuque, NM

Pre-adolescent children (including Latinos/as)

An experiential strengths-based resiliency program emphasizing connections between substance abuse, bullying, and interpersonal violence

Modify logic model; strengthen pre-/post-intervention assessment survey instruments; identify process and fidelity outcome measures; improve data analysis strategies

Countering Pro-Marijuana Influences

Vista, CA

Adolescents and young adults

A policy advocacy program aimed at restricting the sale of drug paraphernalia and enacting ordinances to prevent proliferation of marijuana dispensaries

Identify comparison communities; conduct an interrupted time-series analysis comparing data from the intervention and comparison communities

Creating Lasting Family Connections

Louisville, KY

Low-income parents and their children (including African-American women and fathers who have been incarcerated)

A family-strengthening curriculum for parents and their children that aims to prevent and reduce alcohol and other drug use

Augment ongoing meditational analyses of two program implementations: one targeting African-American females and another for fathers in re-entry and recovery

Earlier Screening and Brief Intervention Beyond the Judicial System

Austin, TX

Young adults

A motivational intervention to reduce risky behavior before violation of the law and to reinforce positive behavior among low-risk drinkers

Increase response rates to the Alcohol Use Disorders Identification Test by providing incentives; administer the post-test survey and conduct a matched-pairs analysis

Family-Based Recovery

New Haven, CT

Infants/toddlers and their parents (particularly homeless families)

A program that applies an in-home substance abuse and parent-child attachment model to prevent intergenerational transmission of substance abuse

Field-test two measures of child well-being; pilot a fidelity measure; refine prospective research design

Hippodrome Improvisational Teen Theatre

Gainesville, FL

Children and adolescents (particularly low-income)

An arts-based program that combines substance abuse prevention education with theatre techniques, youth-led performance, service learning, and peer education

Pilot-test pre-/post-intervention assessment tools; conduct pilot study using a quasi-experimental research design; begin drafting article for publication based on pilot study results

Honor the Code

Syracuse, NY

Adolescents and key school intermediaries (e.g., coaches, parents, teachers)

An educational and support program for coaches and student athletes to ensure consistent enforcement and adherence to athletic codes, specifically related to substance abuse

Assess program reach and impact by conducting key informant interviews, surveying a representative random sample of all student athletes, and conducting focus groups and brief interviews with students following exposure

INTERRUPTED - High Risk Youth Intervention Program

Harrisburg, PA

Adolescents

A psycho-educational curriculum that emphasizes the four components of behavior (i.e., acting, thinking, feeling, physiology) and relationships to prevent the onset of substance abuse

Adapt and implement pre-/post-intervention assessment tools; develop and implement a fidelity checklist; assess program effectiveness using a regression discontinuity evaluation design

Maajtaag Minobmaadzid Program

Sault Ste. Marie, MI

Native American women and their infants

A Healthy Start home-visitation program focused on strengthening perinatal systems to prevent substance abuse and other problems that pose risks to mothers and their infants

Conduct focus groups and key informant interviews to clarify the service delivery model; analyze existing process and outcome data; develop, pilot, and revise data collection and screening tools

Marshfield CARES

Marshfield, WI

Adolescents and young adults as well as key intermediaries (e.g., alcohol retailers)

An outreach and technical assistance program that encourages alcohol retail outlets to adopt a range of polices and practices to reduce youth access to alcohol and deter problem drinking among adults

Refine the program's logic model; develop and administer tools for measuring numbers of confiscated false identification cards; revise the participant (i.e., key intermediaries) survey and conduct individual interviews

Media Detective Parent Night

Durham, NC

Young children and their parents

A school-based substance use prevention workshop that helps students gain and practice media literacy skills

Implement pilot study to collect preliminary data, assess fidelity of implementation, and prepare for a more rigorous evaluation design

Medicine Education Program

Gardena, CA

Older adults (including Latinos/as)

A program that helps older adults understand medication risks and develop the confidence and skills required to work with their doctors to plan appropriate medication use

Implement experimental research design, randomly assigning participants to intervention and control groups; identify a local evaluator to assist in developing a data collection system

Minobimaadiziiwin Coalition

Lac du Flambeau, WI

Native American adolescents and their families

A volunteer-based initiative that hosts family-focused cultural events as alternatives to alcohol, educates families, and engages businesses in monitoring and restricting youth access to alcohol

Hone items on outcomes assessment tools to reduce burden on respondents; use data management systems that allow for easier analysis and presentation of outcomes

Northland Coalition's System for Change

Kansas City, MO

Adolescents and young adults

A multifaceted prevention program that focuses on social marketing and social norming, education, information dissemination, and environmental change

Create and administer online survey of the Coalition's members, based on community input; collect five years of outcomes data from the Coalition and a comparison coalition; disseminate case-comparison findings

Passport to Peace

Wilton Manors, FL

Children (ages 7-11) and their parents

An educational program that focuses on problem-solving, communication, and anger-management skills among students to reduce risk factors for later substance abuse, as well as bullying and violence

Assess fidelity of program implementation; examine differences in pro-social behaviors, bullying, and perceptions of classroom climate between participants and nonparticipants using a quasi-experimental research design

Project WOW! Youth Center

Newark, NJ

Lesbian, gay, bisexual, and transgender adolescents and young adults (including African-Americans and Latinos/as)

An educational and counseling program to prevent and reduce substance abuse and its consequences, namely risky or unprotected sex, and the occurrence of sexually transmitted infections

Provide evaluation training to program leaders; collect data using mixed qualitative and quantitative methods to identify which program activities to prioritize and which outcomes to focus on in the evaluation; conduct an online outcome evaluation pilot survey

Proyecto Manejando el Coraje Prevenimos la Violencia

Naranjito, Puerto Rico

Children (specifically Latinos/as)

A violence and substance abuse prevention project that uses a cognitive behavioral approach to improve self-regulatory behaviors

Conduct pre-/post-test evaluation of participants, parents, and teachers to determine whether the program is being delivered as intended and achieving intended outcomes

Sault Tribe Alive Youth Project

Sault Ste. Marie, MI

Native American youth

A tribal youth suicide prevention and early intervention program targeting the prevention of risk factors such as substance abuse and bullying

Implement a case-study approach combining focus groups and interviews to evaluate the contributions of the project's Board to the development and implementation of prevention activities

Students Leading Students

Waterford, MI

Adolescents

A student and adult advisor training program that empowers and equips youth with knowledge, skills, and resources to design and implement evidence-based youth development and prevention activities

Administer pre-/post-intervention assessment tool piloted during TA phase of Service to Science with 30 high school chapters; analyze data collected; draft article on findings for publication

The Curriculum of Educational Athletics

Franklin, MA

Adolescents and key intermediaries such as parents, teachers and coaches

A program offering workshops, trainings, and conferences to help students build connections to schools, teams, and communities and engage in substance-free activities

Develop and implement pre-/post-intervention surveys with three schools that participate in the program and three that do not (for comparison) to assess program effectiveness

We're Not Buying It! 2.0

East Brunswick, NJ

Pre-adolescents

A media literacy program to prevent or delay the onset of alcohol, marijuana, and non-medical prescription drug use

Develop pre-/post-intervention assessment instruments; implement experimental evaluation design; assess fidelity to the program using a revised tool; conduct focus groups with participants to identify impacts not revealed by the formal instrument

Wicozani Patintanpi

Winner, SD

Native American adolescents

An experiential learning program focusing on the 12 Lakota virtues, comprising a 22-week curriculum and 4-day cultural camps, targeting the reduction of substance abuse and related risk behaviors

Contract with an external evaluator and assemble internal evaluation team members; identify evaluation stakeholders; draft evaluation mission statement and detailed outcome evaluation plan

Youth to Youth

Columbus, OH

Adolescents

A community-based drug prevention and youth leadership program that facilitates peer-to-peer education, support, and social norming strategies

Administer pre-/post-participation reflection surveys developed during the TA phase of Service to Science; analyze survey data collected; develop and implement six-month follow-up surveys and analyze data

FY2012 Subcontract Awardees

Program

Populations

Approach

Enhancements

4Results Mentoring

Vancouver, WA

 

 

 

Association of Village Pride Leadership Development

Fayetteville, GA

 

 

 

DeWill 2 Live

Koror, PW

 

 

 

Discovering Our Story

Portland, OR

 

 

 

Diversion to Assets

Augusta, ME

 

 

 

Emergency Mobile Psychiatric Services

Hartford, CT

 

 

 

Focus on Consequences for Adolescents

Buffalo, NY

 

 

 

Healthy and Whole

Suquamish, WA

 

 

 

I'm Allergic to Stupid Decisions

Medford, MA

 

 

 

Ichishkiin Culture and Language as Protective Factors

Eugene, OR

 

 

 

Kentucky Fetal Alcohol Spectrum Disorder Prevention Enhancement Site

Lexington, KY

 

 

 

Lakota Circles of Hope

Rapid City, SD

 

 

 

Maehnowesekivah Wellness Center Prevention Programs

Gresham, WI

 

 

 

Majuro Cooperative Schools Substance Abuse Prevention

Majuro, MH

 

 

 

Mentoring Programs at Helping Services

Dubuque, IA

 

 

 

Metro Jackson Peer Educators Program

Jackson, MS

 

 

 

Native American Therapeutic Horsemanship Program

Dallas, OR

 

 

 

Nurses for Newborns

Nashville, TN

 

 

 

PACT Kaneohe Community Family Center

Kaneohe, HI

 

 

 

Phoenix Rising Poetry and Spoken Word Program

Denver, CO

 

 

 

Red Ribbon Certification Program

Miami, FL

 

 

 

Safe Workplaces

Carlsbad, NM

 

 

 

FY2011 Subcontract Awardees

Program

Populations

Approach

Enhancements

Discovery Dating

Green Bay, WI

Native Americans

A healthy relationship development tool for Native Americans, based on the theory of personal agency, which provides a process for exploring personal values, identifying others' character traits, and making informed decisions

Developed and piloted survey instruments; established preliminary agreements with organizations to serve as a comparison group; and documented program activities, processes, and goals to enhance fidelity

Ebiil Nature and Culture Camp

Koror, PW

Young people in Palau

Promotes resiliency and ethnic pride among young people in Palau through community-based education focused on traditional knowledge and skills for promoting protection of the natural environment

Drafted a case study for later submission to a peer-reviewed journal for publication; developed evaluation tools and guides and provided assistance on their use for pilot-testing, collection, analysis, and interpretation; and used the results to assist in discussions with program participants

FACE IT

West Palm Beach, FL

Alcohol- or drug-involved youth, ages 12-18

An educational skills- and family-based substance abuse prevention and early intervention program developed and administered by the school district that targets alcohol- or drug-involved youth, ages 12-18

Purchased data analysis software and trained staff on its use; finalized pretest/posttest protocols and began collecting data; finalized and pilot-tested follow-up surveys and protocols

Four Tales of Overdose Survival

Boston, MA

Young and middle-age adults

A social marketing intervention for young and middle-age adults developed and delivered by the state's Department of Public Health that uses graphic "novellas" depicting overdose reversal and management

Hired consultants to identify appropriate evaluation design and to assist with data analysis and reporting; purchased incentives for participants; coordinated study implementation; completed cleaning and analysis of data

Illinois Teen Institute

Springfield, IL

Teens

Develops teens as peer educators to be advocates for alcohol, tobacco, and drug prevention, strengthens community partnerships to support and encourage healthy lifestyle changes, and fosters prevention leadership skills

Provided incentives to increase responses during the six-month follow-up and contracted with an external evaluator to assist with short-term evaluation capacity, including data entry from the pretest/posttest and six-month follow-up surveys

IMPACT

Irving, TX

Youth

Empowers and mobilizes volunteers to prevent underage drinking and other youth substance abuse by using a combination of strategies to create community-level change

Consulted with an evaluation expert to design and apply an improved methodology for conducting the program's Community Assessment Survey, develop and implement a complementary Key Stakeholder Panel Survey, and prepare a community-friendly report of findings

Individual Prevention Services

Riverside, CA

Individuals abusing substances

A county-wide program that intervenes with individuals of all ages who are experiencing substance abuse problems but who have not reached a level of severity where diagnosis or treatment is indicated

Increased sample size of target population; collected data on longer-term outcomes; included comparison group data; collected additional qualitative data; developed a presentation and publication on findings; cleaned, integrated, and analyzed additional data; and strengthened evaluation capacity of program staff

Metro Denver Partners

Denver, CO

At-risk youth

A mentoring program for at-risk youth targeting increased bonding to pro-social adults, the prevention of juvenile delinquency and substance use and abuse, and increased healthy attitudes against substance abuse

Developed an instrument to measure youth and mentor perceptions of the mentoring relationship; developed response booklets to aid in data entry and cost; added additional process measures and analyses to existing activities; and developed and pilot-tested a quasi-experimental study design and protocols

One Voice Youth to Youth

Dover, NH

Youth

Formed by the police department as part of the town's comprehensive drug prevention plan, the program is based on the knowledge-skills-action model of youth empowerment

Developed and employed various checklists to ensure fidelity, communication, and consistency; tracked participation through monthly activity logs and compared progress to activities outlined in action plans; developed a pretest/posttest participant survey; assessed participants' presentation skills; and conducted focus groups with youth at two sites

Prevention Program for Latino Youth

Atlanta, GA

Latino youth, ages 10- to 15-years-old

A multi-component, after-school program for Latino youth ages 10- to 15-years-old consisting of skills-based education, academic tutoring, family meetings, community service, and arts activities

Conducted semi-structured in-person interviews with two after-school program directors and developed and implemented three surveys: a cultural survey; an alcohol, tobacco, and other drug survey; and a facilitator survey

Recognize

Meridian, ID

Adolescents

A holistic prevention and leadership development program for adolescents that addresses specific substances abused and the protective factors that lead to non-use in the individual, peer, family, and community domains

Strengthened internal evaluation capacity regarding cleaning and preparation of data for analysis, writing articles for submission to peer-reviewed journals, and developing an application for NREPP recognition; and consulted with an external evaluator to design a quasi-experimental evaluation, implement data collection systems, conduct data analysis, and assist in the preparation of articles and applications for other funding

RESCUE Youth Prevention Program

Houston, TX

At-risk youth, ages 6-17

A two-tiered program for at-risk youth ages 6-17 residing in a primarily African American community, which includes in- and out-of-school prevention education activities and information dissemination

Developed and implemented evidence-based evaluation tools for determining overall program effectiveness and assessing the relative effectiveness of in-school and after-school components; developed a client-tracking database system; consulted with an evaluator to assist in the evaluation design; and prepared an article on findings

STEPS

Albany, NY

First-year students and athletes

A comprehensive screening and brief intervention strategy to reduce alcohol use and its negative consequences among first-year students, student athletes, and students seeking health care on campus

Implemented and evaluated the efficacy of a small-group adaptation of the BASICS intervention; obtained additional data related to behavioral outcomes by using comparison groups; further analyzed process data; and prepared, reviewed, and submitted articles for publication in peer-reviewed journals

SHAPE Healthy Choices

Detroit, MI

Older adult African-American women

A two-day workshop for older adult African-American women—including homeless women—that is facilitated by trained outreach workers and targets the prevention of substance abuse and unsafe sex

Employed outside evaluation experts to implement a randomized controlled trial for comparing the results of three experimental groups, conduct subsequent data analysis, and assist in identifying curriculum changes needed prior to submitting an application for NREPP recognition

Student and Family Education

Sioux Falls, SD

At-risk adolescents

An interactive, video-supplemented instructional program for at-risk adolescents that focuses on strengthening self-management, decision-making, interpersonal, and refusal skills

Applied principal components analysis to gain empirical insight into the data and instrument; developed procedures for collecting matched pretest/posttest data; collected control group data; monitored program implementation and fidelity; and integrated a regression discontinuity analysis into the evaluation design

Therapeutic Adventure for Native American Youth

Albuquerque, NM

Youth

An adventure-based, experiential and culturally-appropriate model that promotes youth development through a structured sequence of challenge activities over three months

Developed and administered staff feedback surveys; conducted two small focus groups with staff; implemented a staff post-training outcome survey; observed, and conducted interviews with, youth participants; conducted a fidelity assessment; analyzed data collected from youth at intake, mid-term, and exit; and analyzed data from interviews with youth at post-discharge

Tobacco Prevention and Control

Saipan, Mariana Islands

Adults and minors

A social marketing or communication campaign designed to prevent and reduce tobacco use by adults and minors, reduce risk of second hand smoke, and reduce sales of tobacco to minors

Revised intake and follow-up forms and developed new data collection instruments; created a database system; and trained staff on entering, maintaining, and running reports on data in the database Note: this program did not complete the subcontract statement of work even with a six-month no-cost extension, but is committed to completing all enhancements.

The TRUST Group

New City, NY

LGBTQ youth

A psycho-educational weekly support group for LGBTQ youth that provides an alcohol- and drug-free environment supporting resolution of personal and family problems and offering positive social activities

Contracted with an external evaluator to design and implement a more rigorous evaluation of the program; tracked attendance (dosage) and matched attendance to intake, 3-month, and 6-month follow-up to demonstrate relationship between dosage and desired outcomes

Waan Aelon in Majel

Majuro, Marshall Islands

Youth who have left school

A group- and individual-counseling program for youth who have left school and lack the skills and education to be successful in employment, school, and life

Purchased and set up databases for collecting data from trainees; developed and revised data collection instruments and procedures (making use of culturally relevant and tailored outcome measurement tools) to be used with trainees and teaching plans

Warrior Down Re-entry Program

Nampa, ID

Formerly incarcerated Native Americans

Provides reentry, relapse, and recidivism prevention services for Native American men and women reentering the society from probation and parole systems and long-term treatment

Developed, pilot-tested, and revised the program's assessment battery, including: its initial baseline instrument, a new qualitative follow-up checklist, a multicultural validation instrument for that checklist, and a group facilitation process evaluation instrument

Youth Friends

Girard, KS

Youth, grades K-12

Provides mentoring services to youth, grades K-12, in school settings and at school-sanctioned events as well as TA to the district's schools on recruiting, screening, training, and pacing of adult volunteer mentors

Refined initial evaluation questions; determined survey procedures and protocols; identified and secured approval for pilot districts; finalized survey instrument designs (and conducted reliability and validity analyses of measures in the survey) and translated into Spanish; submitted for Institutional Review Board review; trained data collection personnel; administered survey; and collected, analyzed, and reported on data

Youth, Individual, and Family Early Intervention

New Albany, IN

At-risk individuals

Provides activities supporting life skills development, promoting self-awareness, and improving poor decision-making among those identified as at-risk for substance use and abuse

Redesigned pretest/posttest tool; developed participant and family member feedback surveys; streamlined processes for data collection; incorporated measures for assessing risk level of participants; enhanced existing database; developed follow-up evaluation instruments; provided incentives during follow-up; and developed an online system for storing and accessing data