Development of content validity and reliability of an instrument to assess adolescent food literacy
DOI:
https://doi.org/10.33448/rsd-v10i16.23631Keywords:
Adolescent; Feeding behavior; Surveys and questionnaires; Health literacy.Abstract
The objective was to develop and verify the content validity and reliability of an instrument that proposes to assess the levels of food literacy in adolescents. The test and retest was conducted with 60 participants to estimate reliability. The instrument developed was called Adolescent Food Literacy (ALE). The content validity analysis was conducted by a team of experts. Then, the instrument reliability (Cronbach's alpha/internal consistency) and test-retest (simple Kappa) were checked. After evaluation by the expert committee, the instrument was considered valid as to its content. Subsequently, it was recommended that the instrument be applied to evaluate the other proposed qualities. The results achieved were discussed again with the committee of experts, interviewers, and authors of the "LAA" instrument, who judged the instrument apt to be used in the remaining stages of the evaluations, with no need for changes, in the final version presented. The instrument was applied to 60 adolescents, of which 34 (56.7%) were male, with a mean age of 14.6 years and a prevalence of brown skin color/race (n=45 / 75%). With regard to the estimate of reliability, the internal consistency or Cronbach's alpha estimated was 0.82. As for the reproducibility, it was verified that among the 54 questions of the instrument, only two obtained a Kappa lower than 0.60. Thus, the LAA instrument showed good application and easy understanding, good standards of reliability and content validity.
References
Albert, D. & Steinberg, L. (2011). Judgment and decision making in adolescence. Journal of Research on Adolescence, 21(1), 211–224. https://doi.org/10.1111/j.1532-7795.2010.00724.x
Albuquerque, T. O.; Sampaio, H. A. C.; Barbosa Filho, V. C.; Cabral, L. A.; Leal, A. L. F.; Silva, S. A. et al. (2021). Intervenções fundamentadas no letramento alimentar: Revisão de escopo conforme a renda do país. Research, Society and Development, 10(9):e51310918311, 2021. http://dx.doi.org/10.33448/rsd-v109.18311
Baker, D. W., Williams, M. V., Parker, R. M., Gazmararian, J. A. & Nurss, J. (1999). Development of a brief test to measure functional health literacy. Patient Education and Counseling, 38(1), 33-42. https://doi.org/10.1016/s0738-3991(98)00116-5
Blakemore, S.-J. & Robbins, T. W. (2012). Decision-making in the adolescent brain. Nature Neuroscience, 15(9), 1184–1191. https://doi.org/10.1038/nn.3177
Chang, F.; Miao, N.; Lee, C.; Chen, P.; Chiu, C. & Lee, S. (2016). The association of media exposure and media literacy with adolescent alcohol and tobacco use. Journal of Health Psychology, 21(4), 513-525. https://doi.org/10.1177/1359105314530451
Chassin, L.; Presson, C. C.; Sherman, S. J. & McConnell, A. R. (1995). Adolescent health issues. In M. C. Roberts (Ed.), Handbook of pediatric psychology (pp. 723–740). The Guilford Press.
Coluci, M. Z. O.; Alexandre, N. M. C. & Milani, D. Construção de instrumentos de medida na área da saúde. Ciência & Saúde Coletiva. 2015;20(3):925-936. http://doi.org/10.1590/1413-81232015203.04332013
Cronbach, J. L. My current t procedures. (2004). Educational and Psychological Measurement, 64(3):391-418. https://doi.org/10.1177/0013164404266386
Davis, L. L. Instrument review: getting the most from a panel of experts. (1992). Applied Nursing Research. 5(4):194-197. https://doi.org/10.1016/S0897-1897(05)80008-4
Davis, T. C.; Wolf, M. S.; Arnold, C. L.; Byrd, R. S.; Long, S. W.; Springer, T. et al. (2006). Development and validation of the Rapid estimate of adolescent literacy in medicine (REALM-Teen): A tool to screen adolescents for below-grade reading in health care settings. Pediatrics, 118(6), e1707–e1714. https://doi.org/10.1542/peds.2006-1139
Dhir, B. & Ryan, F. (2010). Child overweight and obesity: Measurement, causes and management of overweight and obesity in children. Community Practitioner, 83(1), 32-35.
Eleutério, T. P.; Pereira, E. J.; Farias, P. K. S.; Hott, K. S.; Paula, F. M. T. & Martins, A. M. B. L. (2018). Elaboração e verificação da validade e confiabilidade de um instrumento de letramento em nutrição entre pessoas com diabetes. Cadernos Saúde Coletiva, 26(3):298-307. https://doi.org/10.1590/1414-462X201800030028
Fellow, E. T. P.; Lane, D. & Elliott, C. (2017). Defining food literacy: A scoping review. Appetite, 116, 365-371. http://doi.org/10.1016/j.appet.2017.05.007
Fordyce-Voorham, S. (2011). Identification of essential food skills for skill-based healthful eating programs in secondary schools. Journal of Nutrition Education and Behavior, 43(2), 116e122. http://doi.org/10.1016/j.jneb.2009.12.002
Ghaddar, S. F.; Valerio, M. A.; Garcia, C. M. & Hansen, L. (2012). Adolescent health literacy: The importance of credible sources for online health information. Journal of School Health, 82(1), 28-36. http://doi.org/10.1111/j.1746-1561.2011.00664.x
Grant, J. S. & Davis, L. L. (1997). Selection and use of content experts for instrument development. Research in Nursing & Health. 20(3):269-274. http://doi.org/10.1002/(sici)1098-240x(199706)20:3<269::aid-nur9>3.0.co;2-g
Hair, J. F.; Black, W. C.; Babin, B. J.; Anderson, R. E. & Tatham, R. L. Análise multivariada de dados. Bookman Editora, 2009.
Haynes, S. N.; Richard, D. C. S. & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238-247. https://doi.org/10.1037/1040-3590.7.3.238
Landis, J. R. & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics. 33(1):159-174.
Levin-Zamir, D.; Lemish, D. & Gofin, R. (2011). Media health literacy (MHL): Development and measurement of the concept among adolescents. Health Education Research, 26(2), 323-335. http://doi.org/10.1093/her/cyr007
Luna, B. (2009). Developmental changes in cognitive control through adolescence. Advances in Child Development and Behavior, 37, 233-278. http://doi.org/10.1016/s0065-2407(09)03706-9.
Lynn, M. R. Determination and quantification of content validity. (1986). Nursing Research, 35(6):382-385.
Mokkink, L. B.; Terwee, C. B.; Patrick, D. L.; Alonso, J.; Stratford, P. W.; Knol, D. L. et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. (2010). Journal of Clinical Epidemiology, 63(7):737-45. http://doi.org/10.1016/j.jclinepi.2010.02.006
Murimi, M. W.; Kanyi, M.; Mupfudze, T.; Amin, M. R.; Mbogori, T. & Aldubayan, K. (2017). Factors Influencing Efficacy of Nutrition Education Interventions: A Systematic Review. Journal of Nutrition Education and Behavior, 49(2):142-165. http://doi.org/10.1016/j.jneb.2016.09.003
Nelson, S. A.; Corbin, M. A. & Nickols-Richardson, S. M. (2013). A call for culinary skills education in childhood obesity-prevention interventions: Current status and peer influences. Journal of the Academy of Nutrition and Dietetics, 113(8), 1031-1036. http://doi.org/10.1016/j.jand.2013.05.002
Nelson, M. C.; Story, M.; Larson, N. I.; Neumark-Sztainer, D. & Lytle, L. A. (2008). Emerging adulthood and college-aged youth: An overlooked age for weightrelated behavior change. Obesity, 16(10), 2205-2211. http://doi.org/10.1038/oby.2008.365
Norman, C. D. & Skinner, H. A. (2006). eHEALS: The eHealth Literacy Scale. Journal of Medical Internet Research, 8(4), e27. http://dx.doi.org/10.2196/jmir.8.4.e27.
Ogden, C. L.; Carroll, M. D.; Kit, B. K. & Flegal, K. M. (2012). Prevalence of obesity and trends in body mass index among US children and adolescents, 1999-2010. Journal of the American Medical Association, 307(5), 483-490. http://doi.org/10.1001/jama.2012.40
Pasquali, L. (2009). Psychometrics. Revista da Escola de Enfermagem da USP, 43(spe), 992-999. https://doi.org/10.1590/S0080-62342009000500002
Polit, D. F. & Beck C. T. (2006). The content validity index: are you sure you know what's being reported? Critique and recomendationas. Research in Nursing & Health, 29: 489-497. http://doi.org/10.1002/nur.20147
Primack, B. A.; Gold, M. A.; Switzer, G. E.; Hobbs, R.; Land, S. R. & Fine, M. J. (2006). Development and validation of a smoking media literacy scale for adolescents. Archives of Pediatrics & Adolescent Medicine, 160(4), 369-374. http://doi.org/10.1001/archpedi.160.4.369
Rodrigues, M. L. M., Ponte, T. D. R., Vasconcelos, C. M. C. S. d., Cacau, L. T. & Sampaio, H. A. d. C. (2021). Desenvolvimento e validação de uma cartilha fundamentada no letramento em saúde sobre chás medicinais para mulheres sobreviventes de câncer de mama. Research, Society and Development, 10(4): e49410414266. http://dx.doi.org/10.33448/rsd-v10i4.14266
Rubio, D. M.; Berg-Weger, M.; Tebb, S. S.; Lee, S.; Rauch, S. (2003). Objectifying content validity: conducting a content validity study in social work research. Social Work Research, 27(2):94-105. https://doi.org/10.1093/swr/27.2.94
Salgado, M. V.; Pérez-Stable, E. J.; Primack, B. A.; Kaplan, C. P.; Mejia, R. M.; Gregorich, S. E. et al. (2012). Association of media literacy with cigarette smoking among youth in Jujuy, Argentina. Nicotine & Tobacco Research, 14(5), 516-521. https://doi.org/10.1093/ntr/ntr240
Sapnas, K. G. & Zeller, R. A. (2002). Minimizing sample size when using exploratory factor analysis for measurement. Journal of Nursing Measurement, 10(2):135-54. https://doi.org/10.1891/jnum.10.2.135.52552
Shone, L. P.; King, J. P.; Doane, C.; Wilson, K. M. & Wolf, M. S. (2011). Misunderstanding and potential unintended misuse of acetaminophen among adolescents and young adults. Journal of Health Communication, 16(sup3), 256–267. https://doi.org/10.1080/10810730.2011.604384
Sorensen, K.; Van den Broucke, S.; Fullam, J.; Doyle, G.; Pelikan, J.; Slonska, Z. & Brand, H. (2012). Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health, 12(1), 80. http://doi.org/10.1186/1471-2458-12-80
Valim, M. D.; Marziale, M. H. P.; Hayashida, M.; Rocha, F. L. R. & Santos, J. L. F. (2015). Validity and reliability of the Questionnaire for Compliance with Standard Precaution. Revista de Saúde Pública, 49(87):1-8. https://doi.org/10.1590/S0034-8910.2015049005975
Vidgena, H. A. & Gallegos, D. (2014). Defining food literacy and its components. Appetite, 76, 50-59. http://doi.org/10.1016/j.appet.2014.01.010
Weiss, B. D., Mays, M. Z., Martz, W., Castro, K. M., DeWalt, D. A., Pignone, M. P. et al. (2005). Quick assessment of literacy in primary care: The newest vital sign. The Annals of Family Medicine, 3(6), 514–522. http://doi.org/10.1370/afm.405
Wickham, C. A. & Carbone, E. T. (2018) What's technology cooking up? A systematic review of the use of technology in adolescent food literacy programs. Appetite, 125, 333-344. https://10.1016/j.appet.2018.02.001
Worsley, A. (2015). From nutrients to food literacy. Journal of the Home Economics Institute of Australia, 22(3), 13-21.
World Health Organization – WHO. (2011). Global Recommendations on Physical Activity for Health. https://www.who.int/dietphysicalactivity/global-PA-recs-2010.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Paula Karoline Soares Farias; Marinilza Soares Mota Sales; Ana Carolina Mota Barbosa; Priscila Avelar Monteiro; Patrícia Dawylla de Freitas Soares; Letícia Josyane Ferreira Soares; Fabíola Belkiss Santos de Oliveira; Viviane Soares Fonseca; Agda Silene Leite; Tatiane Palmeira Eleutério; Erika Cardoso dos Reis; Elma Lúcia de Freitas Monteiro; Aline Soares Figueiredo Santos; Helena Alves de Carvalho Sampaio; Andréa Maria Eleutério de Barros Lima Martins
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1) Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2) Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3) Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
