Analysis of Reliability and Validity of Islamic Cultural History (SKI) PAT Items in Madrasah Ibtidaiyah Surabaya
DOI:
https://doi.org/10.71382/sinova.v3i3.303Keywords:
Analysis, Multiple Choice, slamic Cultural HistoryAbstract
This study aims to analyze the reliability, discriminatory power, difficulty level, and overall quality of the year-end assessment (PAT) items for the Islamic Cultural History (SKI) subject at MI Supervisor Surabaya. The research employed a descriptive qualitative method and was conducted at MI Supervisor Surabaya with 4th-grade students as the subjects. The analyzed instrument consisted of 25 multiple-choice questions from the SKI PAT. The selection of the 4th-grade level was based on the limited number of previous studies analyzing test items at this level, as well as the accessibility of collaboration with teachers at the school. Data were analyzed through three stages: data reduction, data presentation, and conclusion drawing. The results showed that the reliability coefficient of the evaluation instrument was 0.88, indicating a very high level of reliability. This means the test items would produce consistent results if administered repeatedly. The discriminatory power analysis revealed that 11 items had sufficient quality, 3 items were categorized as good, and item number 12 showed the lowest quality, making it unsuitable for use. Based on the recap of item analysis, 21 items (52%) were considered valid and usable, 5 items (12.5%) required revision, and 14 items (35%) were deemed unsuitable for inclusion in the assessment.
References
Alpusari, M. (2015). Analysis of basic science 1 item questions through the use of the ANATES version 4.0 for Windows computer program. Primary: Journal of Primary School Teacher Education, 3(2), 106–115. https://doi.org/10.33578/jpfkip.v3i2.2501
Arikunto, S., Saputra, W. N. E., Khoirunnisa, D. A., & Sawai, R. P. (2023). Development and validation of teacher competency perception scale in Indonesia: The Rasch analysis. Journal of Professional Teacher Education, 1(1), 11–21. https://doi.org/10.12928/jprotect.v1i1.491
de Vet, H. C., Mokkink, L. B., Mosmuller, D. G., & Terwee, C. B. (2017). Spearman–Brown prophecy formula and Cronbach's alpha: Different faces of reliability and opportunities for new applications. Journal of Clinical Epidemiology, 85, 45–49. https://doi.org/10.1016/j.jclinepi.2017.01.013
Filippatos, P. P., Kelaidis, N., Vasilopoulou, M., Davazoglou, D., & Chroneos, A. (2021). Structural, electronic, and optical properties of group 6 doped anatase TiO₂: A theoretical approach. Applied Sciences, 11(4), 1657. https://doi.org/10.3390/app11041657
Joshi, P. K., Jain, Y., Khunyakari, R., & Basu, S. (2020). An alternative approach to calculate discrimination index. GPG Journal of Education and Research, 4(1), 22–30.*
Knight, S. R., Ho, A., Pius, R., Buchan, I., Carson, G., Drake, T. M., ... & Harrison, E. M. (2020). Risk stratification of patients admitted to hospital with COVID-19 using the ISARIC WHO Clinical Characterisation Protocol: Development and validation of the 4C Mortality Score. BMJ, 370, m3339. https://doi.org/10.1136/bmj.m3339
Mahjabeen, W., Alam, S., Hassan, U., Zafar, T., Butt, R., Konain, S., & Rizvi, M. (2017). Difficulty index, discrimination index, and distractor efficiency in multiple-choice questions. Annals of PIMS-Shaheed Zulfiqar Ali Bhutto Medical University, 13(4), 310–315. https://doi.org/10.48036/apims.v13i4.9
Mohan, R. (2023). Measurement, evaluation and assessment in education. PHI Learning Pvt. Ltd.
Nathan, L. (2016). The hardest questions aren’t on the test: Lessons from an innovative urban school. Beacon Press.
Reynolds, C. R., Altmann, R. A., & Allen, D. N. (2021). Introduction to psychological assessment. In Mastering modern psychological testing: Theory and methods (pp. 1–47). Springer International Publishing. https://doi.org/10.1007/978-3-030-59455-8_1
Reynolds, C. R., & Livingston, R. A. (2021). Mastering modern psychological testing (pp. 573–613). Springer International Publishing.
Reynolds, C., & Livingston, R. (2019). How to develop an empirically based psychological test. In Handbook of psychological assessment (pp. 31–62). Academic Press. https://doi.org/10.1016/B978-0-12-802203-0.00002-X
Riva, L. A., & Al-Ghifari, A. (2018). The use of ANATES software for test instrument validation. Al-Khidmat, 1(1), 73–78. https://doi.org/10.15575/jak.v1i1.3327
Rizqa, H. P., & Ofianto, O. (2019). The effectiveness of item analysis using Anajohn, ANATES, and Iteman: Study of USBN questions in history lessons in Padang. Jurnal Kronologi, 1(2), 1–11.
Stufflebeam, D. L., & Coryn, C. L. (2014). Evaluation theory, models, and applications. John Wiley & Sons.
Suharna, A. (2016). Evaluation of education from an Islamic perspective. Qathrunâ, 3(2), 49–68.
Sunardi, S. (2020). Global era education: Globalization of global education or Islamic education. Journal of Islamic and Social Studies (JISS), 1(1), 59–74.
Zulnaidi, H., & Zamri, S. N. A. S. (2017). The effectiveness of the GeoGebra software: The intermediary role of procedural knowledge on students’ conceptual knowledge and their achievement in mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 13(6), 2155–2180. https://doi.org/10.12973/eurasia.2017.01219a
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Alfita Choirun Amalia
This work is licensed under a Creative Commons Attribution 4.0 International License.
.
