Cross-validation of the trail making test as a non-memory-based embedded performance validity test among Veterans with and without cognitive impairment

Abstract: OBJECTIVE: This study cross-validated multiple Trail Making Test (TMT) Parts A and B scores as non-memory-based embedded performance validity tests (PVTs) for detecting invalid neuropsychological performance among veterans with and without cognitive impairment. METHOD: Data were collected from a demographically and diagnostically diverse mixed clinical sample of 100 veterans undergoing outpatient neuropsychological evaluation at a Southwestern VA Medical Center. As part of a larger battery of neuropsychological tests, all veterans completed TMT A and B and four independent criterion PVTs, which were used to classify veterans into valid (n = 75) and invalid (n = 25) groups. Among the valid group 47% (n = 35) were cognitively impaired. RESULTS: Among the overall sample, all embedded PVTs derived from TMT A and B raw and demographically corrected T-scores significantly differed between validity groups (ηp(2) = .21-.31) with significant areas under the curve (AUCs) of .72-.78 and 32-48% sensitivity (≥91% specificity) at optimal cut-scores. When subdivided by cognitive impairment status (i.e., valid-unimpaired vs. invalid; valid-impaired vs. invalid), all TMT scores yielded significant AUCs of .80-.88 and 56%-72% sensitivity (≥90% specificity) at optimal cut-scores. Among veterans with cognitive impairment, neither TMT A or B raw scores were able to significantly differentiate the invalid from the valid-cognitively impaired group; however, demographically corrected T-scores were able to significantly differentiate groups but had poor classification accuracy (AUCs = .66-.68) and reduced sensitivity of 28%-44% (≥91% specificity). CONCLUSIONS: Embedded PVTs derived from TMT Parts A and B raw and T-scores were able to accurately differentiate valid from invalid neuropsychological performance among veterans without cognitive impairment; however, the demographically corrected T-scores generally were more robust and consistent with prior studies compared to raw scores. By contrast, TMT embedded PVTs had poor accuracy and low sensitivity among veterans with cognitive impairment, suggesting limited utility as PVTs among populations with cognitive dysfunction.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Qualitative analysis of the lived experience of reproductive and pediatric health care in the military health care system

    Abstract: Introduction: Persistent inequities exist in obstetric and neonatal outcomes in military families despite universal health care coverage. Though the exact underlying cause has not been identified, social determinants of health may uniquely impact military families. The purpose of this study was to qualitatively investigate the potential impact of social determinants of health and the lived experiences of military individuals seeking maternity care in the Military Health System. Materials and methods: This was an Institutional Review Board-approved protocol. Nine providers conducted 31 semi-structured interviews with individuals who delivered within the last 5 years in the direct or purchased care market. Participants were recruited through social media blasts and clinic flyers with both maximum variation and homogenous sampling to ensure participation of diverse individuals. Data were coded and themes were identified using inductive qualitative research methods. Results: Three main themes were identified: Requirements of Military Life (with subthemes of pregnancy notification and privacy during care, role of pregnancy instructions and policies, and role of command support), Sociocultural Aspects of the Military Experience (with subthemes of pregnancy as a burden on colleagues and a career detractor, postpartum adjustment, balancing personal and professional requirements, pregnancy timing and parenting challenges, and importance of friendship and camaraderie in pregnancy), and Navigating the Healthcare Experience (including subthemes of transfer between military and civilian care and TRICARE challenges, perception of military care as inferior to civilian, and remote duty stations and international care). Conclusions: The unique stressors of military life act synergistically with the existing health care challenges, presenting opportunities for improvements in care. Such opportunities may include increased consistency of policies across services and commands. Increased access to group prenatal care and support groups, and increased assistance with navigating the health care system to improve care transitions were frequently requested changes by participants.

    Physical Health Peer reviewed