Developing the Interrater Reliability of the Modified EMDR Fidelity Checklist

While EMDR treatment fidelity measures have been cited in past research, none have been subject to any empirical investigation of reliability.

Article Abstract

“Although treatment fidelity measures for eye movement desensitization and reprocessing (EMDR) have been cited in past research, none have been subject to any empirical investigation of reliability. This three-phase study aimed to quantify the interrater reliability of a measure of EMDR treatment fidelity. First, two raters refined the reprocessing section of the EMDR Fidelity Checklist (Leeds, 2016) by developing a descriptive item-by-item scoring system to improve interpretation and reliability. The resultant checklist was piloted on recordings of five EMDR session recordings from the Laugharne et al. (2016) study. The checklist was then revised. Next, the raters used the checklist to assess 15 other recorded EMDR sessions from the same study. The intraclass correlations (ICCs) were in the excellent range for all subscales and total session scores (i.e., >0.75), with an exception of the Desensitization subscale, ICC = 0.69 (0.08, 0.90). Finally, individual items in that subscale were evaluated, finding that five items did not contribute to the ICC. When these were removed/revised, the ICC for this subscale moved into the excellent range, ICC = 0.81(0.43, 0.94). The findings of this study indicate that this checklist may be a reliable measure of treatment fidelity for single reprocessing EMDR sessions with the possible exception of the Body Scan phase. Future research using the checklist with raters who were not involved in checklist development is needed to confirm the generalizability of these findings.”

—Description from publisher

Article Access

Open Access

Cooper, R. Z., Smith, A. D., Lewis, D., Lee, C. W., & Leeds, A. M. (2019). Developing the Interrater Reliability of the Modified EMDR Fidelity Checklist. Journal of EMDR Practice and Research, 13(1), 32–50. https://doi.org/10.1891/1933-3196.13.1.32

About the Journal

The Journal of EMDR Practice and Research is a peer-reviewed publication devoted to integrative, state-of-the-art papers about Eye Movement Desensitization and Reprocessing. It is a broadly conceived interdisciplinary journal that stimulates and communicates research and theory about EMDR, and their application to clinical practice. The Journal of EMDR Practice and Research is the Official Publication of the EMDR International Association.