Keywords
Neuropsychological Tests
Neuropsychology
Psychometrics
Reproducibility of Results
How to Cite
Abstract
The objective of the study was to analyze the validity based on the content of the Child Executive Function Assessment Battery, composed of three computerized instruments that assess inhibition, working memory and cognitive flexibility, in addition to a scale based on parents' perception of children's difficulties in executive function. Seven experts and 22 people from the target population participated (15 children aged six to 10 years and seven parents). They evaluated the clarity, relevance and design/layout of the items. Data collection was remote with experts, and in person with children and parents. The application was individual. The data were analyzed descriptively and by estimating agreement and content validity, with percentages of agreement and appropriate coefficients, above 0.90 and 0.80, respectively. Suggestions and modifications to the instruments were discussed, it was concluded that the battery demonstrated evidence of content-based validity. It was concluded that the battery demonstrated adequate evidence of content validity, and this study stands out for transparently presenting the first and fundamental process of validity analysis, which is essential for the instrument to progress to subsequent stages and achieve effective application in the future.
References
Alexandre, N. M. C., & Coluci, M. Z. O. (2011). Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciência & Saúde Coletiva, 16(7), 3061-3068. https://doi.org/10.1590/S1413-81232011000800006
Almanasreh, E., Moles, R., & Chen, T. F. (2018). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy. https://doi.org/10.1016/j.sapharm.2018.03.066
American Educational Research Association - AERA, American Psychological Association - APA, and National Council on Measurement in Education - NCME. (2014). Standards for educational and psychological testing. Washington, DC. https://www.testingstandards.net/open-access-files.html
Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends in Cognitive Sciences, 4(11), 417-423. https://doi.org/10.1016/S1364-6613(00)01538-2
Baddeley, A. (2012). Working memory: Theories, models, and controversies. Annual review of psychology, 63, 1-29. https://doi.org/10.1146/annurev-psych-120710-100422
Berardi, A., Panuccio, F., Pilli, L., Tofani, M., Valente, D., & Galeoto, G. (2021). Evaluation instruments for executive functions in children and adolescents: a systematic review. Expert review of pharmacoeconomics & outcomes research, 21(5), 885-896. https://doi.org/10.1080/14737167.2021.1908889
Bowie, C., Harvey, P. (2006). Administration and interpretation of the Trail Making Test. Nature Protocols, 1, 2277-2281. https://doi.org/10.1038/nprot.2006.390
Brocki, K. C., & Bohlin, G. (2010). Executive Functions in Children Aged 6 to 13: A Dimensional and Developmental Study. Developmental Neuropsychology, 26(2), 571-593. http://dx.doi.org/10.1207/s15326942dn2602_3
Canet-Juric, L., del-Valle, M. V., Gelpi-Trudo, R., García-Coni, A., Zamora, E. V., Introzzi, I., & Andrés, M. L. (2021). Desarrollo y validación del Cuestionario de Funciones Ejecutivas en niños de 9 a 12 años (CUFE). Avances En Psicología Latinoamericana, 39(1), 1-25. https://doi.org/10.12804/revistas.urosario.edu.co/apl/a.9892
Cevada, T., Conde, E., Marques, D., & Deslandes, A. C. (2019): Test-retest reliability of the simon task: a short version proposal. Somatosensory & Motor Research, 1-8. https://doi.org/10.1080/08990220.2019.1689114
Chami, S., Charalambous, C., Knijnik, S. R., & Docking, K. (2022). Language and executive function skills as predictors of semantic fluency performance in pre-school children. International journal of speech-language pathology, 24(6), 626-635. https://doi.org/10.1080/17549507.2021.2008005
Cordeiro, A. S. (2020). Análise das funções executivas infantis: antes e durante a pandemia por COVID-19. [Dissertação de mestrado. Universidade Federal da Paraíba]. https://repositorio.ufpb.br/jspui/handle/123456789/20876?locale=pt_BR
Cordeiro, A. S., Tomaz, D. F. de O., & Minervino, C. A. da S. M. (2019). Memória de trabalho infantil: informatização de uma tarefa avaliativa. Revista Neuropsicologia Latinoamericana, 11(2), 21-33. https://www.neuropsicolatina.org/index.php/Neuropsicologia_Latinoamericana/article/view/493
Dai, D. W. T., Franke, N., Wouldes, T. A., Brown, G. T. L., Tottman, A. C., Harding, J. E., & PIANO Study Group (2021). The contributions of intelligence and executive function to behaviour problems in school-age children born very preterm. Acta paediatrica (Oslo, Norway: 1992), 110(6), 1827-1834. https://doi.org/10.1111/apa.15763
Damásio, B. (2023, Junho 09). Compreendendo os índices de validade de conteúdo. Psicometria Online. https://psicometriaonline.com.br/compreendendo-os-indices-de-validade-deconteudo/#:~:text=%E2%80%93%20Coeficiente%20de%20Validade%20de%20Conte%C3%BAdo,relev%C3%A2ncia%20te%C3%B3rica%20de%20cada%20item
Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135-168. https://doi.org/10.1146/annurev-psych-113011-143750
Diamond A. (2020). Executive functions. Handbook of clinical neurology, 173, 225-240. https://doi.org/10.1016/B978-0-444-64150-2.00020-4
Doğru, Y., Carroll, D., & Blakey, E.P. (2023). Cognitive Flexibility in Early Childhood: A Contemporary View of the Development of Flexible Goal-Oriented Behavior. Psikoloji Çalışmaları / Studies in Psychology, 43(2), 171-193. https://doi.org/10.26650/sp2022-1138580
Elage, G. K. C. de F., & Seabra, A. G. (2021). Desenvolvimento e Propriedades Psicométricas do Teste Informatizado de Avaliação das Funções Executivas. Avaliação Psicológica, 20(1), 100-110. https://dx.doi.org/10.15689/ap.2021.2001.17491.11
Guerra, A., Hazin, I., Guerra, Y., Roulin, J. L., Le Gall, D., & Roy, A. (2021). Developmental Profile of Executive Functioning in School-Age Children From Northeast Brazil. Frontiers in psychology, 11, 596075. https://doi.org/10.3389/fpsyg.2020.596075
Guerra, A., Hazin, I., Siebra, C., Rezende, M., Silvestre, I., Le Gall, D., & Roy, A. (2022). Assessing executive functions in Brazilian children: A critical review of available tools. Applied Neuropsychology: Child, 11(2), 184-196. https://doi.org/10.1080/21622965.2020.1775598
Hernández-Nieto, R. A. (2002). Contributions to statistical analysis: The coefficients of proportional variance, content validity and kappa capa. Booksurge Publishing.
Isherwood, S. J. S., Bazin, P. L., Miletić, S., Stevenson, N. R., Trutti, A. C., Tse, D. H. Y., Heathcote, A., Matzke, D., Innes, R. J., Habli, S., Sokołowski, D. R., Alkemade, A., Håberg, A. K., & Forstmann, B. U. (2023). Investigating Intra-Individual Networks of Response Inhibition and Interference Resolution using 7T MRI. NeuroImage, 271, 119988. https://doi.org/10.1016/j.neuroimage.2023.119988
Jersild, A. T. (1927). Mental set and shift. Archives of Psychology, 14, 5-81. https://archive.org/details/mentalsetshift00jers/page/6/mode/2up.
Jiang, H., Johnstone, S. J., & Lu, J. (2022). Comparing the Efficacy of Two School-Based Approaches of Neurocognitive Training for Enhancing Executive Functions. Children (Basel, Switzerland), 9(10), 1501. https://doi.org/10.3390/children9101501
Kusi-Mensah, K., Nuamah, N. D., Wemakor, S., Agorinya, J., Seidu, R., Martyn-Dickens, C., & Bateman, A. (2022a). Assessment Tools for Executive Function and Adaptive Function Following Brain Pathology Among Children in Developing Country Contexts: a Scoping Review of Current Tools. Neuropsychology review, 32(3), 459-482. https://doi.org/10.1007/s11065-021-09529-w
Kusi-Mensah, K., Nuamah, N. D., Wemakor, S., Agorinya, J., Seidu, R., Martyn-Dickens, C., & Bateman, A. (2022b). A Systematic Review of the Validity and Reliability of Assessment Tools for Executive Function and Adaptive Function Following Brain Pathology among Children and Adolescents in Low- and Middle-Income Countries. Neuropsychology review, 32(4), 974-1016. https://doi.org/10.1007/s11065-022-09538-3
Leal, P. B. (2022). Instrumento para avaliação da qualidade do serviço médico de emergência sob perspectiva do usuário proposta e validação de conteúdo [Trabalho de Conclusão de Curso, Escola Bahiana de Medicina e Saúde Pública]. Repositório Institucional. http://www.repositorio.bahiana.edu.br/jspui/handle/bahiana/7181
Likhitweerawong, N., Khorana, J., Boonchooduang, N., Phinyo, P., Patumanond, J., & Louthrenoo, O. (2022). Association between executive function and excess weight in pre-school children. PloS one, 17(10), e0275711. https://doi.org/10.1371/journal.pone.0275711
Martins, C. R. (2020). Evidências de validade do Teste de Inibição e Flexibilidade Cognitiva - TIF: Analisando o desenvolvimento do controle inibitório e flexibilidade cognitiva na infância. [Tese de Doutorado. Universidade Federal da Bahia]. https://repositorio.ufba.br/ri/handle/ri/32839
Minervino, C. A. da S. M., & Tomaz, D. F. de O. (2021). Habilidades precursoras da leitura: análise da tarefa informatizada de memória de trabalho para crianças. Em J. F. de S., & A. L. P. G. P. Navas. Avaliação da linguagem oral, escrita e de habilidades relacionadas: Panorama nacional de instrumentos. Vetor Editora.
Nogues, C. P., Nunes, D. M. (2023). A influência das funções executivas na matemática. Em L. V. Corso, E. F. de Assis, & C. P. Nogues (Orgs.), Matemática na Educação Infantil (pp. 93-110). CirKula. https://lume.ufrgs.br/handle/10183/265677
Nweze, T., & Nwani, W. (2020). Contributions of Working Memory and Inhibition to Cognitive Flexibility in Nigerian Adolescents. Developmental neuropsychology, 45(3), 118-128. https://doi.org/10.1080/87565641.2020.1765169
Pereira, E. E. L. D., Minervino, C. A. da S. M., Cruz, L. F. P. da., Roama-Alves, R. J., & Andrade, J. M. (2020). Executive Functions in Children with ADHD and/or Reading Difficulty. Psicologia: Teoria E Pesquisa, 36, e3623. https://doi.org/10.1590/0102.3772e3623
Perone, S., Simmering, V. R., & Buss, A. T. (2021). A Dynamical Reconceptualization of Executive-Function Development. Perspectives on Psychological Science, 16(6), 1198-1208. https://doi.org/10.1177/1745691620966792
Reppold, C. T., Wechsler, S. M., Almeida, L. da S., Elosua, P., & Hutz, C. S. (2020). Perfil dos Psicólogos Brasileiros que Utilizam Testes Psicológicos: Áreas e Instrumentos Utilizados. Psicologia: Ciência E Profissão, 40, e201348. https://doi.org/10.1590/1982-3703003201348
Ruffini, C., Marzocchi, G. M., & Pecini, C. (2021). Preschool Executive Functioning and Child Behavior: Association with Learning Prerequisites?. Children (Basel, Switzerland), 8(11), 964. https://doi.org/10.3390/children8110964
Santana, A. N. de., Melo, M. R. A., & Minervino, C. A. da S. M. (2019). Instrumentos de Avaliação das Funções Executivas: Revisão Sistemática dos Últimos Cinco Anos. Avaliação Psicológica, 18(1), 96-107. http://dx.doi.org/10.15689/ap.2019.1801.14668.11
Simon, J. R., & Rudell, A. P. (1967). Auditory S-R compatibility: the effect of an irrelevant cue on information processing. The Journal of applied psychology, 51(3), 300-304. https://doi.org/10.1037/h0020586
Souissi, S., Chamari, K., & Bellaj, T. (2022). Assessment of executive functions in school-aged children: A narrative review. Frontiers in psychology, 13, 991699. https://doi.org/10.3389/fpsyg.2022.991699
Stemler, S. E. (2004). A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research & Evaluation, 9(4), 1-19. https://doi.org/10.7275/96jp-xz07
Theodoraki, T. E., McGeown, S. P., Rhodes, S. M., & MacPherson, S. E. (2020). Developmental changes in executive functions during adolescence: A study of inhibition, shifting, and working memory. The British journal of developmental psychology, 38(1), 74-89. https://doi.org/10.1111/bjdp.12307
Venturieri, C., Silva, L. D. P. da, Lunkes, S., Stutz, L. P., & Dias, N. M. (2023). Avaliação de funções executivas em pré-escolares: revisão de escopo da literatura brasileira: Funções executivas em pré-escolares. Neuropsicología Latinoamericana, 15(1), 31-44. https://neuropsicolatina.org/index.php/Neuropsicologia_Latinoamericana/article/view/7562
Wang, L., Li, J., Jia, F., Lian, L., & Li, L. (2024). The Development of Response and Interference Inhibition in Children: Evidence from Serious Game Training. Children (Basel, Switzerland), 11(2), 138. https://doi.org/10.3390/children11020138
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2025 Andriely Cordeiro, Analice Maria da Silva Albuquerque, Antonio Simeão Sobrinho Neto , Paloma Victória de Sales Alves, Carla Alexandra da Silva Moita Minervino