Evidence of validity of the instrument interRAI emergency screener for psychiatry for the brazilian context
DOI:
https://doi.org/10.33448/rsd-v10i13.21185Keywords:
Emergency hospital service; Diagnosis; Psychometrics; Validation studies; Mental disorders; General hospitals.; Mental disorders; Hospitals, general.Abstract
Objective: The aim of this study was to carry out the translation and present the evidence of validity of the Brazilian version of the interRAI Emergency Screener for Psychiatry (ESP). Method: this is a cross-sectional study conducted in a municipal hospital in the metropolitan region of Porto Alegre, Rio Grande do Sul. A total of 161 patients were evaluated in the first 24 hours of emergency arrival using ESP. Exploratory factor analyses of the sections of the instrument and reliability analyses were conducted using Cronbach's alpha and McDonald's Omega. Results: the analyzes suggested a factorial structure adequate to the purpose of the instrument, with two sections (Mental State Indicators and Harm to Self and Others) having a two-factor solution, contrary to the expected one-factorial expectation. However, the two-factor sections have theoretical interpretability and consistency. The factor loadings of the items were adequate, all with values equal to or greater than 0.30. The interpreted factors showed internal consistency, assessed by Cronbach's Alpha and McDonald's Ommega indices, with values ranging between 0.60 and 0.94. Conclusion: the Brazilian version of the interRAI Emergency Screener for Psychiatry (ESP) demonstrates adequate psychometric properties through the internal structure of the instrument. Future studies should investigate the relationship of the scores produced by the instrument with clinical diagnosis and with covariates relevant to mental health outcomes.
References
Brasil. (2001) Lei nº. 10.216, de 6 de abril de 2001. Dispõe sobre a proteção e os direitos das pessoas portadoras de transtornos mentais e redireciona o modelo assistencial em saúde mental. Diário Oficial da União. 9 abr 2001. http://www.planalto.gov.br/ccivil_03/Leis/LEIS_2001/L10216.htm.
Brasil. (2002). Portaria nº. 2048, de 5 de novembro de 2002. Regulamento Técnico dos Sistemas Estaduais de Urgência e Emergência. Diário Oficial da União. 5 nov. 2002. https://bvsms.saude.gov.br/bvs/saudelegis/gm/2002/prt2048_05_11_2002.html
Brasil. (2011). Portaria nº. 3.088, de 23 de dezembro de 2011. Institui a Rede de Atenção Psicossocial para pessoas com sofrimento ou transtorno mental e com necessidades decorrentes do uso de crack, álcool e outras drogas, no âmbito do Sistema Único de Saúde. Diário Oficial da União. 23 dez 2011.
Brasil. (2012). Resolução nº. 466, de 12 de dezembro de 2012. Diretrizes e normas regulamentadoras de pesquisas envolvendo seres humanos. Diário Oficial da União. 12 dez 2012. https://conselho.saude.gov.br/r%20esolucoes/2012/Reso466.pdf
Canadian Institute for Health Information (CIHI). (2017). Frequent emergency room visits for help with mental health and/or addictions [Internet]. Ottawa (ON): CIHI https://www.cihi.ca/sites/default/files/document/19994-pdf-backgrounder -shp-ed-visits-en02pc.pdf.
Canadian Institute for Health Information (CIHI). (2019). Health system resources for mental health and addictions care in Canada, July 2019. Ottawa (ON): CIHI; https://www.cihi.ca/sites/default/files/document/mental-health-chartbook-report-2019-en-web.pdf
Barros, R. E. M., Tung, T. C., & Mari, J. J. (2010). Serviços de emergência psiquiátrica e suas relações com a rede de saúde mental brasileira. Rev Bras Psiquiatria, 32 :S71-7. 10.1590/S1516-44462010000600003.
Benziger, C. P., Roth, G. A., & Moran, A. E. (2016). The global burden of disease study and the preventable burden of NCD. Glob Heart., 11(4):393-7. 10.1016/j.gheart.2016.10.024.
Del-Ben, C. M., Hallak, J. E. C., Sponholz, A., Marques, J. M. A., Labate, C. M., Contel, J. O. B., et al. (2005). Accuracy of psychiatric diagnosis performed under indirect supervision. Rev Bras Psiquiatr., 27(1):58-62. 10.1590/S1516-44462005000100013.
Del-Bem, C. M., Rufino, A. C. T. B. F., Azevedo-Marques, J. M., & Menezes, P. R. (2010). Differential diagnosis of first-episode psychosis: importance of an optimal approach in psychiatric emergency. Rev Bras Psiquiatr., 32 Suppl 2:S78-86. 10.1590/S1516-44462010000600004.
Giandinoto, J. A., Stephenson, J., & Edward, K. L. (2018). General hospital health professionals’ attitudes and perceived dangerousness towards patients with comorbid mental and physical health conditions: systematic review and meta-analysis. Int J Ment Health Nurs., 27(3):942-55. 10.1111/inm.12433.
Hashmi, A. M., Czelusta, K. L., Jabbar, Q., Siddiqui, S., & Shah, A. A. (2018). Psychiatric illness in the emergency department. Psychiatr Ann, 48(1):21-7. 10.3928/00485713-20171205-02.
Hirdes, J. P., Smith, T. F., Rabinowitz, T., Yamauchi, K., Pérez, E., Telegdi, N. C., et al. (2002). The resident assessment instrument-mental health (RAI-MH): inter-rater reliability and convergent validity. The journal of behavioral health services & research, 1; 29(4):419-32. 10.1007/BF02287348.
Hirdes, J. P., Ljunggren, G., Morris, J. N., Frijters, D. H., Soveri, H. F., Gray, L., et al. (2008). Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC health services research, 1;8(1):277. 10.1186/1472-6963-8-277
Hirdes, J. P., van Everdingen, C., Ferris, J., Franco-Martin, M., Fries, B. E., Heikkilä, J., et al (2020). The interRAI suite of mental health assessment instruments: an integrated system for the continuum of care. Front Psychiatry, 17; 20(926):1-30. 0.3389/fpsyt.2019.00926.
Lahey, B. B., Krueger, R. F., Rathouz, P. J., Waldman, I. D., & Zald, D. H. (2017). A hierarchical causal taxonomy of psychopathology across the life span. Psychol Bull., 143(2):142-86. 10.1037/bul0000069.
Martin, L., Hirdes, J. P., Morri, J. N., Montague, P., Rabinowitz, T., & Fries, B. E. (2009). Validating the mental health assessment protocols (MHAPs) in the resident assessment instrument mental health (RAI‐MH). Journal of Psychiatric and Mental Health Nursing, 16(7):646-53. 10.1111/j.1365-2850.2009.01429.x.
Marshall, M. (2020). The hidden links between mental disorders. Nature, 7; 581(7806):19-21 10.1038/d41586-020-00922-8.
Matsumoto, C. L., O'Driscoll, T., Lawrance J., Jakubow, A., Madden, S., & Kelly, L. (2017). A 5 year retrospective study of emergency department use in Northwest Ontario: a measure of mental health and addictions needs. CJEM, 19(5):381-5. 10.1017/cem.2016.387.
Miller, A. C., Frei, S. P., Rupp, V. A., Joho, B. S., Miller, K. M., & Bond, W. F. (2012). Validation of a Triage Algorithm for Psychiatric Screening (TAPS) for patients with psychiatric chief complaints. J Am Osteopath Assoc., 112(8):502-8. https://pubmed.ncbi.nlm.nih.gov/22904247
Mocking, L. B., Prinsen, C. A. C., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Terwee, C. B. (2019). COSMIN study design checklist for patient-reported outcome measurement instruments. Amsterdam, NL: Department of Epidemiology and Biostatistics, www.cosmin.nlAmsterdam (NL): COSMIN. http://www.cosmin.nl.
Moulin A., Evans E. J., Xing., & Melnikow, J. (2018). Substance use, homelessness, mental illness and medicaid coverage: a set-up for high emergency department utilization. West J Emerg Med., 19(6):902-6. 10.5811/westjem.2018.9.38954.
Noblett, J. E., Lawrence, R., & Smith J.G. (2015). The attitudes of general hospital doctors toward patients with comorbid mental illness. Int J Psychiatry Med., 26; 50(4):370-82. 10.1177/0091217415612721.
Rabinowitz, T., Hirdes, J. P., Curtin-Telegdi, N., Martin, L., & Smith, T. F. (2013). interRAI Emergency Screener for Psychiatry (ESP) assessment form and user’s manual. Version 9.1. Washington (DC): interRAI.
Shapiro, A., & Berge, J. M. F. (2002). Statistical inference of minimum rank factor analysis. Psychometrika, 1;67(1):79-94. 10.1007/BF02294710.
Shepard, D., VanderZanden, A., Moran, A., Naghavi, M., Murray, C., & Roth, G. (2015). Ischemic heart disease worldwide, 1990 to 2013: estimates from the global burden of disease study 2013. Circ Cardiovasc Qual Outcomes, 1;8(4):455-6. 10.1161/CIRCOUTCOMES.115.002007.
Staton, C. A., Vissoci, J. R. N., Wojcik, R., Hirshon, J. M., Mvungi, M., Mmbaga, B. T., et al. (2018). Perceived barriers by health care providers for screening and management of excessive alcohol use in an emergency department of a low-income country. Alcohol.,71:65-73.10.1016/j.alcohol.2018.01.003.
The Brainstorm Consortium. (2018). Analysis of shared heritability in common disorders of the brain. Science, 22; 360(6395):1-40. 10.1126/science.aap8757.
Timmerman, M. E., & Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods., 16(2):209-20. 10.1037/a0023353.
Trizano-Hermosilla, I., & Alvarado, J. M. (2016). Best Alternatives to Cronbach’s alpha reliability in realistic conditions: congeneric and asymmetrical measurements. Front Psychol., 26; 7(769):1-8. 10.3389/fpsyg.2016.00769.
Tucci, V., Siever, K., Matorin, A., & Moukaddam, N. (2015). Down the rabbit hole: emergency department medical clearance of patients with psychiatric or behavioral emergencies. Emerg Med Clin N Am., 5;33(4):721-37. 10.1016/j.emc.2015.07.002.
World Health Organization. (2013). Mental health action plan 2013-2020. WHO Document Production Services; 50 p. https://www.who.int/mental_health/action_plan_2013/bw_version.pdf
Williams, E., & Shepherd, S. M. (2000). Medical clearance of psychiatric patients. Emerg Med Clin North Am., 18(2):185-98. 10.1016/S0733-8627(05)70117-6.
Wilson et al. (2017). American Association for Emergency Psychiatry Task Force on medical clearance of adult psychiatric patients. Part II: controversies over medical assessment, and consensus recommendations. West J Emerg Med., 18(4):640-6. 10.5811/westjem.2017.3.32259.
Wu, Q., Luo, X., Chen, S., Qi, C., Yang, W.F., Liao, Y. et al. (2020). Stigmatizing attitudes towards mental disorders among non-mental health professionals in six general hospitals in Hunan province. Front Psychiatry, 10; 10(946):1-9. 10.3389/fpsyt.2019.00946.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Luis Afonso Bataglin Cabral; Wagner de Lara Machado; Elton Luiz Ferlin; John P. Hirdes; Luiz Carlos Porcello Marrone; Alice Hirdes
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1) Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2) Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3) Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
