Importance of validity testing in psychiatric assessment: evidence from a sample of multimorbid post-9/11 Veterans

Abstract: OBJECTIVE: Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures. METHOD: Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures. RESULTS: Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's d = .60-.69), processing speed (Cohen's d = .68), working memory (Cohen's d = .98), and visual memory (Cohen's d = .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; β = 0.16; p = .0002), and worse self-reported depression (β = 0.17; p = .0001), anxiety (β = 0.15; p = .0007), sleep (β = 0.10; p = .0233), and functional outcomes (β = 0.15; p = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (p's < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (AUC = 0.83; 95% CI = 0.76, 0.91). CONCLUSION: PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Access to outpatient occupational therapy services after inpatient psychiatric hospitalization in the Veterans Health Administration

    Abstract: IMPORTANCE: Veterans with occupational performance (e.g., activities of daily living [ADL]) limitations who are receiving inpatient psychiatric care may benefit from outpatient occupational therapy upon discharge, but access disparities have not been investigated. OBJECTIVE: To investigate whether ADL limitations, an indicator of need, are associated with outpatient occupational therapy utilization after inpatient psychiatric hospitalization in the Veterans Health Administration (VHA) and whether this relationship differs by facility characteristics. DESIGN: Secondary analysis of VHA medical record data. Modified Poisson regression was used to model outpatient occupational therapy utilization (yes or no) as a function of ADL limitations, facility characteristics, and sociodemographic and clinical characteristics. Interactions were used to estimate whether the relationship between ADL limitations and outpatient occupational therapy utilization differs across facility characteristics. SETTING: VHA outpatient setting. PARTICIPANTS: Veterans who received VHA inpatient psychiatric care from 2015 to 2020 and lived