The Influence of Item Discrimination on Misclassification of Test Takers
It has been suggested that low discriminating items can be included in a test with a criterion-referenced score interpretation as long as they measure a highly relevant content. However, low item discrimination increases the standard error of measurement, which might increase the expected proportion...
| Main Author: | |
|---|---|
| Format: | Online |
| Language: | spa |
| Published: |
Facultad de Psicología. Laboratorio de Evaluación Psicológica y Educativa (LEPE)
2021
|
| Subjects: | |
| Online Access: | https://revistas.unc.edu.ar/index.php/revaluar/article/view/36294 |
| _version_ | 1802292802364637184 |
|---|---|
| author | Trujano, Raúl Emmanuel |
| author_facet | Trujano, Raúl Emmanuel |
| author_sort | Trujano, Raúl Emmanuel |
| collection | Portal de Revistas |
| description | It has been suggested that low discriminating items can be included in a test with a criterion-referenced score interpretation as long as they measure a highly relevant content. However, low item discrimination increases the standard error of measurement, which might increase the expected proportion of misclassified test takers. In order to test it, responses from 2000 test takers to 100 items were simulated, varying item discrimination values and number and location of cut scores, and classification inaccuracy was estimated. Results show that the expected proportion of misclassified test takers increased as item discrimination decreased, and as the cut scores were closer to the mean of the distribution of test takers. Therefore, a test should include as few items with low discrimination values as possible —or even none— in order to reduce the expected proportion of test takers classified into a wrong performance level. |
| format | Online |
| id | oai:ojs.revistas.unc.edu.ar:article-36294 |
| institution | Universidad Nacional de Cordoba |
| language | spa |
| publishDate | 2021 |
| publisher | Facultad de Psicología. Laboratorio de Evaluación Psicológica y Educativa (LEPE) |
| record_format | ojs |
| spelling | oai:ojs.revistas.unc.edu.ar:article-362942021-12-24T01:14:21Z The Influence of Item Discrimination on Misclassification of Test Takers Influencia de la discriminación de los ítems en la clasificación incorrecta de los examinados Trujano, Raúl Emmanuel decision accuracy item discrimination item response theory Rudner algorithm information function precisión de la decisión discriminación de los ítems teoría de respuesta al ítem algoritmo de Rudner función de información It has been suggested that low discriminating items can be included in a test with a criterion-referenced score interpretation as long as they measure a highly relevant content. However, low item discrimination increases the standard error of measurement, which might increase the expected proportion of misclassified test takers. In order to test it, responses from 2000 test takers to 100 items were simulated, varying item discrimination values and number and location of cut scores, and classification inaccuracy was estimated. Results show that the expected proportion of misclassified test takers increased as item discrimination decreased, and as the cut scores were closer to the mean of the distribution of test takers. Therefore, a test should include as few items with low discrimination values as possible —or even none— in order to reduce the expected proportion of test takers classified into a wrong performance level. Se ha sugerido que en un examen con interpretación de puntajes basada en criterios se pueden incluir ítems con baja discriminación siempre que midan un contenido muy relevante. Sin embargo, los ítems con baja discriminación aumentan el error estándar de medición, lo que podría aumentar la proporción esperada de examinados mal clasificados. Para probarlo, se simularon las respuestas de 2000 examinados a 100 ítems, variando la discriminación de los ítems, el número y ubicación de los puntos de corte, y se estimó la imprecisión de la clasificación. Los resultados muestran que la proporción esperada de examinados mal clasificados aumentó a medida que disminuyó la discriminación de los ítems y que los puntos de corte se acercaron a la media de la distribución de los examinados. Por lo tanto, un examen debería incluir la menor cantidad posible de ítems con baja discriminación —o incluso ninguno— para reducir la proporción esperada de examinados clasificados en un nivel de desempeño incorrecto. Facultad de Psicología. Laboratorio de Evaluación Psicológica y Educativa (LEPE) 2021-12-24 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion application/pdf https://revistas.unc.edu.ar/index.php/revaluar/article/view/36294 Revista Evaluar; Vol. 21 Núm. 3 (2021); 15-34 1667-4545 1515-1867 10.35670/1667-4545.v21.n3 spa https://revistas.unc.edu.ar/index.php/revaluar/article/view/36294/36588 Derechos de autor 2021 Raúl Emmanuel Trujano http://creativecommons.org/licenses/by/4.0 |
| spellingShingle | decision accuracy item discrimination item response theory Rudner algorithm information function precisión de la decisión discriminación de los ítems teoría de respuesta al ítem algoritmo de Rudner función de información Trujano, Raúl Emmanuel The Influence of Item Discrimination on Misclassification of Test Takers |
| title | The Influence of Item Discrimination on Misclassification of Test Takers |
| title_alt | Influencia de la discriminación de los ítems en la clasificación incorrecta de los examinados |
| title_full | The Influence of Item Discrimination on Misclassification of Test Takers |
| title_fullStr | The Influence of Item Discrimination on Misclassification of Test Takers |
| title_full_unstemmed | The Influence of Item Discrimination on Misclassification of Test Takers |
| title_short | The Influence of Item Discrimination on Misclassification of Test Takers |
| title_sort | influence of item discrimination on misclassification of test takers |
| topic | decision accuracy item discrimination item response theory Rudner algorithm information function precisión de la decisión discriminación de los ítems teoría de respuesta al ítem algoritmo de Rudner función de información |
| topic_facet | decision accuracy item discrimination item response theory Rudner algorithm information function precisión de la decisión discriminación de los ítems teoría de respuesta al ítem algoritmo de Rudner función de información |
| url | https://revistas.unc.edu.ar/index.php/revaluar/article/view/36294 |
| work_keys_str_mv | AT trujanoraulemmanuel theinfluenceofitemdiscriminationonmisclassificationoftesttakers AT trujanoraulemmanuel influenciadeladiscriminaciondelositemsenlaclasificacionincorrectadelosexaminados AT trujanoraulemmanuel influenceofitemdiscriminationonmisclassificationoftesttakers |