Psychometric properties of Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) in Colombia and Peru
DOI:
https://doi.org/10.13129/2282-1619/mjcp-3056Keywords:
CORE-OM, psychometric properties, outcome measure, Latin-AmericaAbstract
This study attempts to adapt and validate the Spanish version of The Clinical Outcomes in Routine Evaluation–Outcome Measure CORE-OM questionnaire for Colombian and Peruvian populations. A linguistic and cultural adaptation of the CORE-OM Spanish version was created via cognitive interviews of potential users (Colombians n=28; Peruvians n=8). Then the questionnaire was applied along with the SOS and OQ-45 tests to 270 participants, divided in clinical (n=60), and non-clinical (n=210) samples, from three Colombian cities and one city in Peru. Some students made a retest application (n=26) 15 to 30 days after the first one. The CFA conducted showed a four-factor structure (χ2/df=2.09; RMSEA=0.064; RMR=.069) that included well-being, problems/symptoms, general functioning, and risk. The Spanish version of CORE-OM showed excellent acceptability (96%; omission rate 0.14%), good internal consistency (α >.70 in most of the scales and samples), acceptable test-retest reliability (Spearman rho>0.70; p<.001) and convergent validity (all domains r > .4; p < 0.01, except subjective well-being) in both populations. Significant differences were found in the scores between the clinical and non-clinical sample; although, the clinical sample presented higher scores. These results validate the 1-point cut-off score of between clinical and non-clinical populations.
References
Barkham, M., Evans, C., Margison, F., McGrath, G., Mellor-Clark, J. & Milne, D. (1998). The rationale for developing and implementing core batteries in service settings and psychotherapy outcome research. Journal of Mental Health, 7, 35 – 47. https://doi.org/10.1080/09638239818328
Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark & J., Evans, C. (2001) Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184–196. http://dx.doi.org/10.1037/0022-006X.69.2.184
Barkham, M., Gilbert, N., Connell, J., Marshall, C. & Twigg, E. (2005). Suitability and utility of the CORE-OM and CORE-A for assessing severity of presentig problems in psychological therapy services based in primary and secondary care settings. The British Journal of Psychiatry, 186(3), 239 – 246. https://doi.org/10.1192/bjp.186.3.239
Baumgartner, T. A., & Chung, H. (2001) Confidence limits for intraclass reliability coefficients. Measurement in Physical Education and Exercise Science, 5(3), 179-188. https://doi.org/10.1207/S15327841MPEE0503_4
Biasi, V., Patrizi, N., Mosca, M. & De Vincenzo, C. (2017). The effectiveness of university counselling for improving academic outcomes and well-being. British Journal of Guidance & Counselling, 45(3), 248–257. https://doi.org/10.1080/03069885.2016.1263826
Börjesson, S., & Boström, P. K. (2020). “I want to know what it is used for”: Clients’ perspectives on completing a routine outcome measure (ROM) while undergoing psychotherapy. Psychotherapy Research, 30(3), 337-347. https://doi.org/10.1080/10503307.2019.1630780
Blais, M. A., Lenderking, W. R., Baer, L., de Lorell, A., Peets, K., Leahy, L. & Burns, C. (1999). Development and initial validation of a brief mental health outcome measure. Journal of Personality Assessment, 73(3), 359–373. https://doi.org/10.1207/S15327752JPA7303_5
Brand, C., Ward, F., MacDonagh, N., Cunningham, S., & Timulak, L. (2021). A national evaluation of the Irish public health counselling in primary care service–examination of initial effectiveness data. BMC Psychiatry, 21, 227. https://doi.org/10.1186/s12888-021-03226-x
Bravo, G., & Potvin, L. (1991) Estimating the reliability of continuous measures with Cronbach’s alpha or the intraclass correlation coefficient: Toward the integration of two traditions. Journal of Clinical Epidemiology, 44(4-5), 381-390. https://doi.org/10.1016/0895-4356(91)90076-L
Cantero-Braojos, M. Á., Cabrera-León, A., López-González, M. A., & Saúl, L. A. (2019). Intervención grupal desde un enfoque sensoriomotriz para reducir la intensidad del dolor crónico. Atención Primaria, 51(3), 162-171. https://doi.org/10.1016/j.aprim.2017.07.006" target="_blank">https://doi.org/10.1016/j.aprim.2017.07.006
Cattivelli, R., Guerrini Usubini, A., Manzoni, G. M., Vailati Riboni, F., Pietrabissa, G., Musetti, A., Franceschini, C., Varallo, G., Spatola, C. A. M., Giusti, E., Castelnuovo, G. & Molinari, E. (2021). ACTonFood. Acceptance and Commitment Therapy-Based Group Treatment Compared to Cognitive Behavioral Therapy-Based Group Treatment for Weight Loss Maintenance: An Individually Randomized Group Treatment Trial. International Journal of Environmental Research and Public Health, 18(18), 9558. https://doi.org/10.3390/ijerph18189558
Collier, J. E. (2020). Applied structural equation modeling using AMOS. Basic to advanced techniques. Routledge Taylor & Francis Group. https://doi.org/10.4324/9781003018414
Connell, J., Barkham, M., & Mellor-Clark, J. (2007). CORE-OM mental health norms of students attending university counselling services benchmarked against an age-matched primary care sample. British Journal of Guidance & Counselling, 35(1), 41-57. https://doi.org/10.1080/03069880601106781
CORE System Trust (2021, June 02). About CORE and CST. https://www.coresystemtrust.org.uk/home/about-cst/
Diedenhofen, B. & Musch, J. (2016). cocron: A web interface and R package for the statistical comparison of Cronbach’s alpha coefficients. International Journal of Internet Science, 11, 51- 60. https://www.ijis.net/ijis11_1/ijis11_1_diedenhofen_and_musch.pdf
Elfström, M. L, Evans, C., Lundgren, J., Johansson, B., Hakeberg, M., & Carlsson, S. G. (2012). Validation of the Swedish version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE‐OM). Clinical Psychology & Psychotherapy, 20(5), 447- 455. https://doi.org/10.1002/cpp.1788
Errázuriz, P., Opazo, S., Behn, A., Silva, O., & Gloger, S. (2017). Spanish Adaptation and Validation of the Outcome Questionnaire OQ-30.2. Frontiers in Psychology, 8, 673. https://doi.org/10.3389/fpsyg.2017.00673
Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J. & McGrath, G. (2000). CORE: Clinical outcome measure in routine evaluation. Journal of Mental Health, 9(3), 247-255. https://doi.org/10.1080/jmh.9.3.247.255
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardized brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180(1), 51-60. https://doi.org/10.1192/bjp.180.1.51
Evans, C., Connell, J., Barkham, M., Marshall, C. &, Mellor-Clark, J. (2003). Practice-based evidence: benchmarking NHS primary care counselling services at national and local levels. Clinical Psychology & Psychotherapy, 10, 374 -388. https://doi.org/10.1002/cpp.384
Falkenström, F., Kumar, M., Zahid, A., Kuria, M. & Othieno, C. (2018). Factor analysis of the Clinical Outcomes in Routine Evaluation–Outcome Measures (CORE-OM) in a Kenyan sample. BMC Psychology, 6,48. https://doi.org/10.1186/s40359-018-0260-1
Feixas, G., Evans, C., Trujillo, A., Saúl, L. A., Botella, L., Corbella, S., González, E., Bados, A., García-Grau, E., & López-González, M. A. (2012). La versión española del CORE-OM: Clinical Outcomes in Routine Evaluation - Outcome Measure. Revista de Psicoterapia, 23(89), 109-135. https://doi.org/10.33898/rdp.v23i89.641
Hair, J. F., Black, W. C., & Barry, B. J. (2014). Multivariate Data Analysis (7th ed.) Pearson. https://www.pearson.com/uk/educators/higher-education-educators/program/Hair-Multivariate-Data-Analysis-Pearson-New-International-Edition-7th-Edition/PGM1052102.html
Halacre, M., & Jalil, R. (2017). Holistic therapy with disabled adults from a social and individual perspective: A service evaluation feasibility study. Counselling and Psychotherapy Research, 17(4), 320-329. https://doi.org/10.1002/capr.12137
Honkalampi, K., Laitila, A., Juntunen, H., Lehmus, K., Piiparinen, A., Törmänen, L., Inkinen, M., & Evans, C. (2017). The Finnish Clinical Outcome in Routine Evaluation Outcome Measure: Psychometric exploration in clinical and non‐clinical samples. Nordic Journal Psychiatry, 71(8), 589 - 597. https://doi.org/10.1080/08039488.2017.1365378
Howitt, D., & Cramer, D. (2017). Research methods in psychology (5th ed.). Pearson.
Iqbal, Z., Airey, N. D., Brown, S. R., Wright, N. M., Miklova, D., Nielsen, V., Webb , K. & Sajjad, A. (2021). Waiting list eradication in secondary care psychology: Addressing a National Health Service blind spot. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.2551
Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12-19. https://doi.org/10.1037/0022-006X.59.1.12
Jenkins, P. E., Smith, L., & Morgan, C. (2021). Can early change in eating disorder psychopathology predict outcome in guided self-help for binge eating?. Eating and Weight Disorders-Studies on Anorexia, Bulimia and Obesity, 26, 2143-2152. https://doi.org/10.1007/s40519-020-01059-3
Jokic,Begic, N., Korajlija, A. L., Jurin, T., & Evans, C. (2014). Faktorska struktura, psihometrijske karakteristike i kritična vrijednost hrvatskoga prijevoda CORE‐OM upitnika. Psihologijske Teme, 23(2), 265–288. https://hrcak.srce.hr/125093.
Juhová, D., Řiháček, T., Cígler, H., Dubovská, E., Saic, M., Černý, M., Dufek, J., & Evans, C. (2018). Česká adaptace dotazníku CORE-OM: vybrané psychometrické charakteristiky. Ceskoslovenska Psychologie, 62(1), 59-74.http://cspsych.psu.cas.cz/result.php?id=1007
Juntunen, H., Piiparinen, A., Honkalampi, K., Inkinen, M. & Laitila, A. (2015). CORE OM mittarin suomalainen validointitutkimus yleisväestössä. Psykologia,50(4), 257–276. http://www.psykologia.fi/arkisto/vanhat-numerot/vanhat-numerot-ghost/351-2015-04/tieteelliset-artikkelit/418-core-om-mittarin-suomalainen-validointitutkimus-yleisvaestossa.
Kiziela, A., Viliūnienė, R., Friborg, O., & Navickas, A. (2019). Distress and resilience associated with workload of medical students. Journal of Mental Health, 28(3), 319-323. https://doi.org/10.1080/09638237.2018.1521922
Kontunen, J., Timonen, M., Muotka, J., & Liukkonen, T. (2016). Is interpersonal counselling (IPC) sufficient treatment for depression in primary care patients? A pilot study comparing IPC and interpersonal psychotherapy (IPT). Journal of Affective Disorders, 189(1), 89-93. https://doi.org/10.1016/j.jad.2015.09.032
Kristjánsdóttir, H., Sigurðsson, B. H., Salkovskis, P., Ólason, D., Sigurdsson, E., Evans, C., Gylfadóttir, E. D., & Sigurðsson, J. F. (2013). Evaluation of the psychometric properties of the Icelandic version of the Clinical Outcomes in Routine Evaluation–Outcome Measure, its transdiagnostic utility and cross‐cultural validation. Clinical Psychology & Psychotherapy, 22(1), 64-74. https://doi.org/10.1002/cpp.1874
Lambert, M. J., Morton, J., Hatfield, D., Harmon, C., Hamilton, S. & Reid, R. C. (2004) Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire) (3rd ed.). American Professional Credentialing Services LLC.
Lambert, M. J. (2015). Outcome Research: methods for improving outcome in routine care. In: O. Gelo, A. Pritz, & B. Rieken (Eds.), Psychotherapy Research: Foundations, process and outcome (pp. 593-610). Springer. https://doi.org/10.1007/978-3-7091-1382-0_29
Londoño, N. H., Agudelo, D., Martínez, E., Anguila, D., Aguirre, D., & Mogollón, C. (2017). Cuestionario de efectividad de la psicoterapia Outcome Questionnaire. Validación en muestra clínica colombiana. Psychologia, 11(1), 97-108. https://doi.org/10.21500/19002386.3105
Lyne, K. J., Barrett, P., Evans, C., & Barkham, M. (2006). Dimensions of variation on the CORE-OM. The British Journal of Clinical Psychology, 45(2), 185-203. https://doi.org/10.1348/014466505x39106
Mækelæ, M. J., Reggev, N., Defelipe, R. P., Dutra, N., Tamayo, R. M., Klevjer, K., & Pfuhl, G. (2021). Identifying resilience factors of distress and paranoia during the COVID-19 outbreak in five countries. Frontiers in Psychology, 12, 2160. https://doi.org/10.3389/fpsyg.2021.661149
Margison, F.R., Barkham, M., Evans, C., McGrath, G., Clark, J.M., & Audin, K. (2000). Measurement and psychotherapy evidence-based practice and practice-based evidence. The British Journal of Clinical Psychology, 177, 123-130. https://doi.org/10.1192/bjp.177.2.123
Medlicott, E., Phillips, A., Crane, C., Hinze, V., Taylor, L., Tickell, A., Montero-Marin, J., & Kuyken, W. (2021). The Mental Health and Wellbeing of University Students: Acceptability, Effectiveness, and Mechanisms of a Mindfulness-Based Course. International Journal of Environmental Research and Public Health, 18(11), 6023. https://doi.org/10.3390/ijerph18116023
Meerding, W. J., Van't Spijker, A., & Van Riessen, M. (2012). Monitoren van behandelresultaat met de CORE‐OM. Tijdschrift Psychotherapie, 38, 355–367. https://doi.org/10.1007/s12485‐012‐0041‐x
Mellor-Clark, J., Connell, J., Barkham, M., & Cummins, P. (2001). Counselling outcomes in primary health care: a CORE system data profile. European Journal of Psychotherapy & Counselling, 4, 65–86. https://doi.org/10.1080/13642530110040118
Murray, A. L., McKenzie, K., Murray, K. R., & Richelieu, M. (2016). An analysis of the effectiveness of university counselling services. British Journal of Guidance & Counselling, 44(1), 130-139. https://doi.org/10.1080/03069885.2015.1043621
Murray, A. L., McKenzie, K., Murray, K. R., & Richelieu, M. (2018). Examining response shifts in the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM). British Journal of Guidance & Counselling, 48(2), 276-288. https://doi.org/10.1080/03069885.2018.1483007
Palmieri, G., Evans, C., Hansen, V., Brancaleoni, G., Ferrari, S., Porcelli, P., Reitano, F., & Rigatelli, M. (2009). Validation of the Italian version of the clinical outcomes in routine evaluation outcome measure (CORE‐OM). Clinical Psychology & Psychotherapy, 16, 444-449. https://doi.org/10.1002/cpp.646
Paz, C., Adana‐Díaz, L., & Evans, C. (2020). Clients with different problems are different and questionnaires are not blood tests: A template analysis of psychiatric and psychotherapy clients' experiences of the CORE‐OM. Counselling and Psychotherapy Research, 20(2), 274-283. https://doi.org/10.1002/capr.12290
Paz, C., Mascialino, G., & Evans, C. (2020). Exploration of the psychometric properties of the Clinical Outcomes in Routine Evaluation-Outcome Measure in Ecuador. BMC Psychology, 8, 94. https://doi.org/10.1186/s40359-020-00443-z
Paz, C., Mascialino, G., Proaño, K., & Evans, C. (2021). Psychological intervention change measurement in Latin America: Where from? Where to?. Psychotherapy Research, 31(1), 132-141. https://doi.org/10.1080/10503307.2020.1750728
Peak, J., Goranitis, I., Day, E., Copello, A., Freemantle, N., & Frew, E. (2018). Predicting health-related quality of life (EQ-5D-5 L) and capability wellbeing (ICECAP-A) in the context of opiate dependence using routine clinical outcome measures: CORE-OM, LDQ and TOP. Health and quality of life outcomes, 16(106), 1-11. https://doi.org/10.1186/s12955-018-0926-7
Rivas-Vazquez, R.A., Rivas-Vazquez, A., Blais, M.A., Rey, G.J., Rivas-Vazquez, F., Jacobo, M., & Carrazana, E. J. (2001). Development of a Spanish Version of the Schwartz Outcome Scale-10: A Brief Mental Health Outcome Measure. Journal of Personality Assessment, 77(3), 436-446. https://doi.org/10.1207/S15327752JPA7703_05
Ronconi, L., Giannerini, N., Testoni, I., Zulian, M., Guglielmin, MS. A. (2018). A structural model of well-being, spontaneity and self-efficacy: Italian validation between adolescents and young adults. Trends in Psychiatry and Psychotherapy, 40(2), 136-143. http://dx.doi.org/10.1590/2237-6089-2017-0072
Saini, P., Chopra, J., Hanlon, C. A., & Boland, J. (2021). A Case Series Study of Help-Seeking among Younger and Older Men in Suicidal Crisis. International Journal of Environmental Research and Public Health. 18, 14, 7319. https://doi.org/10.3390/ijerph18147319
Sales, C. M. D., Moleiro, C. M. M., Evans, C., & Alves, P. C. G. (2012). Versão Portuguesa do CORE‐OM: tradução, adaptação e estudo preliminar das suas propriedades psicométricas. Revista de Psiquiatria Clínica, 39(2), 54–59. https://doi.org/10.1590/S0101-60832012000200003
Sales, C. M., Neves, I. T., Alves, P. G., & Ashworth, M. (2018). Capturing and missing the patient's story through outcome measures: A thematic comparison of patient‐generated items in PSYCHLOPS with CORE‐OM and PHQ‐9. Health Expectations, 21(3), 615-619. https://doi.org/10.1111/hex.12652
Santana, M. R. M., Silva, M. M. da, Moraes, D. S. de, Fukuda, C. C., Freitas, L. H., Ramos, M. E., Fleury, H. J., & Evans, C. (2015). Brazilian Portuguese version of the CORE-OM: cross-cultural adaptation of an instrument to assess the efficacy and effectiveness of psychotherapy. Trends in Psychiatry and Psychotherapy, 37(4), 227-231. https://doi.org/10.1590/2237-6089-2015-0002
Skre, I., Friborg, O., Elgarøy, S., Evans, C., Myklebust, L. H., Lillevoll, K., Sørgaard, K., & Hansen, V. (2013). The factor structure and psychometric properties of the Clinical Outcome in Routine Evaluation–Outcome Measure (CORE‐OM) in Norwegian clinical and non clinical samples. BMC Psychiatry, 13,99. https://doi.org/10.1186/1471-244X-13-99
Sosa-Torralba, J. E., Romero-Mendoza, M. P., Medina-Mora-Icaza, M. E., Méndez-Ríos, E., & Blum-Grynberg, B. (2020) Estructura dimensional de la Escala Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) en universitarios mexicanos. Revista Evaluar, 20(1), 49-66. https://revistas.unc.edu.ar/index.php/revaluar
Stiles, W. B., Barkham, M., & Wheeler, S. (2015). Duration of psychological therapy: Relation to recovery and improvement rates in UK routine practice. The British Journal of Clinical Psychology, 207(2), 115-122. https://doi:10.1192/bjp.bp.114.145565
Stroud, J., & Griffiths, C. (2021). An evaluation of compassion‐focused therapy within adult mental health inpatient settings. Psychology and Psychotherapy: Theory, Research and Practice, 94(3), 587–602. https://doi.org/10.1111/papt.12334
Trujillo, A., Feixas, G., Bados, A., García-Grau, E., Salla, M., Medina, J. C., Montesano, A., Soriano, J., Medeiros-Ferreira, L., Cañete, J., Corbella, S., Grau, A., Lana, F., & Evans, C. (2016). Psychometric properties of the Spanish version of the Clinical Outcomes in Routine Evaluation - Outcome Measure. Neuropsychiatric Disease and Treatment, 12, 1457–1466. https://doi.org/10.2147/NDT.S103079
Uji, M., Sakamoto, A., Adachi, K., & Kitamura, T. (2012). Psychometric properties of the Japanese version of the Clinical Outcomes in Routine Evaluation–Outcome Measure. Comprehensive Psychiatry, 53(5), 600-608. https://doi.org/10.1016/j.comppsych.2011.09.006
Viliū nienė, R., Evans, C., Hilbig, J., Pakalniškienė, V., Danilevičiūtė, V., Laurinaitis, E., & Navickas, A. (2013). Translating the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) into Lithuanian. Nordic Journal of Psychiatry, 67(5), 305-311. https://doi.org/10.3109/08039488.2012.745599
Wickramasekera, N., & Tubeuf, S. (2020). Measuring quality of life for people with common mental health problems. Journal of Mental Health. https://doi.org/10.1080/09638237.2020.1818190
Zeldovich, M., & Alexandrowicz, R. (2019). Comparing outcomes: The Clinical Outcome in Routine Evaluation from an international point of view. International Journal of Methods in Psychiatric Research, 28(3), e1774. https://doi.org/10.1002/mpr.1774
Zibetti, M. R., Serralta, F. B., & Evans, C. (2021). Longitudinal Distress among Brazilian University Workers during Pandemics. International Journal of Environmental Research and Public Health, 18(17), 9072. https://doi.org/10.3390/ijerph18179072
Downloads
Published
Issue
Section
License
Articles and conference papers published in Mediterranean Journal of Clinical Psychology are distributed under the terms and conditions of a Creative Commons Attribution 4.0 Unported License. Correspondingly, authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
