Investigating The Effect of Exposure-Control Strategies on Item Selection Methods in MCAT

dc.authoridOzdemir, Burhanettin/0000-0001-7716-2700
dc.contributor.authorMao, Xiuzhen
dc.contributor.authorOzdemir, Burhanettin
dc.contributor.authorWang, Yating
dc.contributor.authorXin, Tao
dc.date.accessioned2024-12-24T19:30:34Z
dc.date.available2024-12-24T19:30:34Z
dc.date.issued2018
dc.departmentSiirt Üniversitesi
dc.description.abstractThis study aims to investigate the effect of different item exposure controlling strategies on item selection methods in the context of multidimensional computerized adaptive testing (MCAT). Additionally, this study aims to examine to what extend the restrictive threshold (RT) and the restrictive progressive (RPG) exposure methods suppress the item exposure rates and increase the exposure rates of underexposed items without losing psychometric precision in MCAT. For this purpose, the performance of four item selection methods with and without exposure controls are evaluated and compared so as to determine how results differ when item exposure controlling strategies are applied with Monte-Carlo simulation method. The four item selection methods employed in this study are D-optimality, Kullback-Leibler information (KLP), the minimized error variance of linear combination score with equal weight (V1), the composite score with optimized weight (V2). On the other hand, the maximum priority index (MPI) method proposed for unidimensional CAT and two other item exposure control methods, that are RT and RPG methods proposed for cognitive diagnostic CAT, are adopted. The results show that: (1) KLP, D-optimality, and V1 performed better in recovering domain scores, and all outperformed V2 with respect to precision; (2) although V1 and V2 offer improved item bank usage rates, KLP, D-optimality, V1, and V2 produced an unbalanced distribution of item exposure rates; (3) all exposure control strategies improved the exposure uniformity greatly and with very little loss in psychometric precision; (4) RPG and MPI performed similarly in exposure control, and outperformed RT exposure control method.
dc.identifier.doi10.21031/epod.407521
dc.identifier.endpage311
dc.identifier.issn1309-6575
dc.identifier.issue3
dc.identifier.scopus2-s2.0-85112138726
dc.identifier.scopusqualityQ4
dc.identifier.startpage295
dc.identifier.trdizinid302611
dc.identifier.urihttps://doi.org/10.21031/epod.407521
dc.identifier.urihttps://search.trdizin.gov.tr/tr/yayin/detay/302611
dc.identifier.urihttps://hdl.handle.net/20.500.12604/7587
dc.identifier.volume9
dc.identifier.wosWOS:000448280700004
dc.identifier.wosqualityN/A
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakScopus
dc.indekslendigikaynakTR-Dizin
dc.language.isoen
dc.publisherAssoc Measurement & Evaluation Education & Psychology
dc.relation.ispartofJournal of Measurement and Evaluation in Education and Psychology-Epod
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_20241222
dc.subjectMultidimensional computerized adaptive testing
dc.subjectitem selection methods
dc.subjectexposure control strategies
dc.titleInvestigating The Effect of Exposure-Control Strategies on Item Selection Methods in MCAT
dc.title.alternativeÇok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Testlerde Madde Kullanım-Sıklığı Yöntemlerinin Madde Seçim Yöntemleri Üzerindeki Etkisinin Incelenmesi
dc.typeArticle

Dosyalar