Protocol for the pragmatic evaluation of the Department of the Air Force’s personal financial readiness program

Abstract: Federal policy mandates that United States military members receive numerous financial trainings across their career to improve their financial literacy and equip them to make informed financial decisions that, ultimately, promote positive individual and family well-being. Connected to this mandate, systematic evaluation efforts of the Department of the Air Force’s Personal Financial Readiness program were initiated to identify program outcomes and downstream results while simultaneously informing program improvements and modifications. When situated in a discussion of evaluation theory and design practices, documenting these outcome and process evaluation protocols can provide valuable insight for scientist-practitioners designing multi-site program evaluations in the context of real-world constraints, as is often the case for large institutions, including the military. The evaluation design includes a prospective cohort design for the outcome evaluation with surveys completed before and after training and 3- and 6-months following training. The surveys provide data on short-, mid-, and long-term outcomes. Data collected for the process evaluation, include targeted surveys and interviews with individuals conducting and participating in the training. Together, this protocol illustrates a theory-informed evaluation design of a complex, multi-site set of trainings utilizing diverse data collection methods to conduct a rigorous outcome and process evaluation.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    The impact of exposure to morally injurious events on posttraumatic stress symptoms among Israeli combat Veterans: a longitudinal moderated mediation model of moral injury outcomes and dispositional forgiveness

    Abstract: Background: Exposure to potentially morally injurious events (PMIEs) during military service can lead to moral injury (MI) outcomes and posttraumatic stress symptoms (PTSS). This longitudinal study examined the relationships between PMIE exposure, MI outcomes, and PTSS among Israeli combat veterans, and the potential protective role of dispositional forgiveness in these associations. Method: Participants were 169 Israeli combat veterans who participated in a six-year longitudinal study with four measurement points (T1: 12 months before enlistment, T2: Six months following enlistment- pre-deployment, T3: 18 months following enlistment- post-deployment, and T4: 28 months following discharge). Participants’ characteristics were assessed via semi-structured interviews (T1) and validated self-report measures (T2-T4) between 2019-2024. Results: Approximately 36% of participants reported exposure to PMIEs during service, with 13% exceeding the clinical threshold for probable PTSD at T4. PMIE-Betrayal at T3 was positively associated with MI outcomes of shame and trust violation at T4. The indirect effect of PMIEs on PTSS through MI outcome-Shame depended on forgiveness levels. Among veterans with low forgiveness, higher exposure to PMIE-Betrayal was associated with increased MI shame, which was linked to more severe PTSS. Conversely, for those with high forgiveness, exposure to PMIE-Self and Other was associated with decreased MI shame and subsequently reduced PTSS. Conclusion: Dispositional forgiveness moderates the relationship between PMIE exposure and MI outcomes, particularly shame, which mediates the development of PTSS. These findings highlight forgiveness as a potential target for intervention in treating moral injury and preventing PTSS among combat veterans.