Thinking aloud methodological elements to obtain evidence of content validity
Think-aloud has been implemented in educational research mainly to define the solution strategies of the subjects on different tasks. In particular, it has been used to determine the strategies the subjects implement to find solutions to items in educational tests. However, since the steps of the me...
| Main Author: | |
|---|---|
| Format: | Online |
| Language: | spa |
| Published: |
Instituto de Investigaciones Psicológicas (IIPSI, Conicet-UNC)
2023
|
| Subjects: | |
| Online Access: | https://revistas.unc.edu.ar/index.php/revaluar/article/view/43899 |
| _version_ | 1837685794250162176 |
|---|---|
| author | Ordóñez-Gutiérrez, Graciela Ordóñez-Gutiérrez, Graciela |
| author_facet | Ordóñez-Gutiérrez, Graciela Ordóñez-Gutiérrez, Graciela |
| author_sort | Ordóñez-Gutiérrez, Graciela |
| collection | Portal de Revistas |
| description | Think-aloud has been implemented in educational research mainly to define the solution strategies of the subjects on different tasks. In particular, it has been used to determine the strategies the subjects implement to find solutions to items in educational tests. However, since the steps of the methodological think-aloud elements followed to obtain valid evidence are not explicit and are important to define, this article aims to provide the methodological steps, from a theoretical perspective so they can be implemented. To develop the steps, a comprehensive literature review was carried out, and the following steps were proposed: 1) define the purpose, 2) elaborate the solution processes of the items from a theoretical perspective, 3) select the thinking-aloud sample, 4) simulation process, 5) data recollection, 6) think-aloud transcript and analysis. These steps can lead to a successful think-aloud process that produces reliable, valid evidence. |
| format | Online |
| id | oai:ojs.revistas.unc.edu.ar:article-43899 |
| institution | Universidad Nacional de Cordoba |
| language | spa |
| publishDate | 2023 |
| publisher | Instituto de Investigaciones Psicológicas (IIPSI, Conicet-UNC) |
| record_format | ojs |
| spelling | oai:ojs.revistas.unc.edu.ar:article-438992023-12-24T19:37:20Z Thinking aloud methodological elements to obtain evidence of content validity Elementos metodológicos de thinking aloud para la obtención de evidencias de validez de contenido Ordóñez-Gutiérrez, Graciela Ordóñez-Gutiérrez, Graciela thinking aloud valid evidence select sample expert consistency index quantitative reasoning skill thinking aloud evidencias de validez selección de la muestra índice de consistencia de expertos habilidades de razonamiento cuantitativas Think-aloud has been implemented in educational research mainly to define the solution strategies of the subjects on different tasks. In particular, it has been used to determine the strategies the subjects implement to find solutions to items in educational tests. However, since the steps of the methodological think-aloud elements followed to obtain valid evidence are not explicit and are important to define, this article aims to provide the methodological steps, from a theoretical perspective so they can be implemented. To develop the steps, a comprehensive literature review was carried out, and the following steps were proposed: 1) define the purpose, 2) elaborate the solution processes of the items from a theoretical perspective, 3) select the thinking-aloud sample, 4) simulation process, 5) data recollection, 6) think-aloud transcript and analysis. These steps can lead to a successful think-aloud process that produces reliable, valid evidence. Los test thinking aloud se han implementado en la investigación educativa, principalmente, para obtener las estrategias de solución de los sujetos en diferentes tareas. En particular, se han empleado con la finalidad de determinar las estrategias que los examinados implementan para dar solución a ítems en pruebas educativas. Sin embargo, los elementos metodológicos para elaborar un thinking aloud paso a paso y obtener evidencias de validez no son explícitos en la literatura. Sin embargo, es importante obtener esos resultados, por lo que el objetivo de este artículo es proporcionar los pasos metodológicos, desde una perspectiva práctica de implementación en la obtención de habilidades de razonamiento cuantitativo. Para llevar a cabo los test thinking aloud, se realizó una revisión exhaustiva de la literatura y se propusieron las siguientes etapas: 1) definición del propósito, 2) elaboración de los procesos de solución de los ítems desde una perspectiva teórica y práctica, 3) selección de la muestra, 4) proceso de simulación, 5) recolección de los datos, 6) transcripción y análisis. Al seguir estas etapas, se pueden efectuar los test thinking aloud que resulten exitosos y que permitan obtener evidencias válidas y confiables. Instituto de Investigaciones Psicológicas (IIPSI, Conicet-UNC) 2023-12-23 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion application/pdf https://revistas.unc.edu.ar/index.php/revaluar/article/view/43899 10.35670/1667-4545.v23.n3.43899 Revista Evaluar; Vol. 23 Núm. 3 (2023); 45-60 1667-4545 10.35670/1667-4545.v23.n3 spa https://revistas.unc.edu.ar/index.php/revaluar/article/view/43899/44138 http://creativecommons.org/licenses/by/4.0 |
| spellingShingle | thinking aloud valid evidence select sample expert consistency index quantitative reasoning skill thinking aloud evidencias de validez selección de la muestra índice de consistencia de expertos habilidades de razonamiento cuantitativas Ordóñez-Gutiérrez, Graciela Ordóñez-Gutiérrez, Graciela Thinking aloud methodological elements to obtain evidence of content validity |
| title | Thinking aloud methodological elements to obtain evidence of content validity |
| title_alt | Elementos metodológicos de thinking aloud para la obtención de evidencias de validez de contenido |
| title_full | Thinking aloud methodological elements to obtain evidence of content validity |
| title_fullStr | Thinking aloud methodological elements to obtain evidence of content validity |
| title_full_unstemmed | Thinking aloud methodological elements to obtain evidence of content validity |
| title_short | Thinking aloud methodological elements to obtain evidence of content validity |
| title_sort | thinking aloud methodological elements to obtain evidence of content validity |
| topic | thinking aloud valid evidence select sample expert consistency index quantitative reasoning skill thinking aloud evidencias de validez selección de la muestra índice de consistencia de expertos habilidades de razonamiento cuantitativas |
| topic_facet | thinking aloud valid evidence select sample expert consistency index quantitative reasoning skill thinking aloud evidencias de validez selección de la muestra índice de consistencia de expertos habilidades de razonamiento cuantitativas |
| url | https://revistas.unc.edu.ar/index.php/revaluar/article/view/43899 |
| work_keys_str_mv | AT ordonezgutierrezgraciela thinkingaloudmethodologicalelementstoobtainevidenceofcontentvalidity AT ordonezgutierrezgraciela thinkingaloudmethodologicalelementstoobtainevidenceofcontentvalidity AT ordonezgutierrezgraciela elementosmetodologicosdethinkingaloudparalaobtenciondeevidenciasdevalidezdecontenido AT ordonezgutierrezgraciela elementosmetodologicosdethinkingaloudparalaobtenciondeevidenciasdevalidezdecontenido |