Protocol for the pragmatic evaluation of the Department of the Air Force’s personal financial readiness program

Abstract: Federal policy mandates that United States military members receive numerous financial trainings across their career to improve their financial literacy and equip them to make informed financial decisions that, ultimately, promote positive individual and family well-being. Connected to this mandate, systematic evaluation efforts of the Department of the Air Force’s Personal Financial Readiness program were initiated to identify program outcomes and downstream results while simultaneously informing program improvements and modifications. When situated in a discussion of evaluation theory and design practices, documenting these outcome and process evaluation protocols can provide valuable insight for scientist-practitioners designing multi-site program evaluations in the context of real-world constraints, as is often the case for large institutions, including the military. The evaluation design includes a prospective cohort design for the outcome evaluation with surveys completed before and after training and 3- and 6-months following training. The surveys provide data on short-, mid-, and long-term outcomes. Data collected for the process evaluation, include targeted surveys and interviews with individuals conducting and participating in the training. Together, this protocol illustrates a theory-informed evaluation design of a complex, multi-site set of trainings utilizing diverse data collection methods to conduct a rigorous outcome and process evaluation.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Relationship satisfaction change among UK service personnel: Associations with socio-demographics, military factors, and mental health

    Abstract: The unique demands of military life can adversely impact romantic relationships; however, research has mainly focused on these adverse outcomes at one-time point, overlooking changes over time or potential positive outcomes. Using a subsample of 3,845 male and female military personnel and veterans from a large UK dataset, this study examined positive and negative changes in relationship satisfaction between two-time points (2007–2009; 2014–2016). Most participants reported no change in their relationship satisfaction, suggesting stability − 8% reported a positive change and 10% a negative change. Positive change was associated with being in a long-term relationship, alcohol misuse remission, and persistent alcohol misuse. Negative change was associated with the onset of mental health problems (probable PTSD, CMD, or alcohol misuse) and having children under 18. Some factors, like increasing age, childhood family relationship adversity, and mental health problems, were associated with both positive and negative changes in relationship satisfaction. This study highlights the complexity of factors associated with relationship satisfaction among military personnel and veterans, with some experiencing positive changes, as well as negative changes over time.