Mindfulness-based teaching competency assessment: Comparing self-assessment with expert evaluation in the Veterans Administration – Compassionate awareness learning module program

Abstract: Background: Meditation, including Mindfulness-Based Interventions (MBI), is a required Complementary and Integrative Health intervention at the US Department of Veterans Affairs (VA). Training VA clinicians to provide MBI at scale must address fidelity concerns and the assessment of clinician competency. Objective: The psychometric properties of the Mindfulness-Based Intervention: Teaching Assessment Criteria (MBI:TAC), a widely used tool for assessing facilitator competence, continue to be explored. To support the dissemination of MBI, the utility of using the MBI:TAC for self-assessment for clinicians in a national training program was evaluated. Methods: In a training cohort of VA clinicians (n = 39), participant self evaluations on 2 domains of the MBI:TAC are compared to the competency scores of 2 expert evaluators as based on the observations of a 10-minute exercise. Additionally, the inter-rater reliability between the 2 experts was explored. Results: Intraclass Correlation for the 2 expert evaluators for Guiding Practice was significant (ρ =.83, P =.003), but was not significant for Embodiment of Mindfulness (ρ =.34, P =.186). Self-evaluation scores were not significantly correlated to expert rater scores such that participants rate their level of competence higher than expert scores. Conclusion: The MBI:TAC, while an essential tool in teacher training, may not produce accurate scores when used for self-assessment. Instruction from a senior teacher is needed for accurate scoring. Interrater reliability may be improved with enhanced domain operationalization and training. Implications for MBI training are explored.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Relationship satisfaction change among UK service personnel: Associations with socio-demographics, military factors, and mental health

    Abstract: The unique demands of military life can adversely impact romantic relationships; however, research has mainly focused on these adverse outcomes at one-time point, overlooking changes over time or potential positive outcomes. Using a subsample of 3,845 male and female military personnel and veterans from a large UK dataset, this study examined positive and negative changes in relationship satisfaction between two-time points (2007–2009; 2014–2016). Most participants reported no change in their relationship satisfaction, suggesting stability − 8% reported a positive change and 10% a negative change. Positive change was associated with being in a long-term relationship, alcohol misuse remission, and persistent alcohol misuse. Negative change was associated with the onset of mental health problems (probable PTSD, CMD, or alcohol misuse) and having children under 18. Some factors, like increasing age, childhood family relationship adversity, and mental health problems, were associated with both positive and negative changes in relationship satisfaction. This study highlights the complexity of factors associated with relationship satisfaction among military personnel and veterans, with some experiencing positive changes, as well as negative changes over time.