Utilizing test items analysis to examine the level of difficulty and discriminating power in a teacher-made test

Sayit Abdul Karim, Suryo Sudiro, Syarifah Sakinah

Abstract


Apart from teaching, English language teachers need to assess their students by giving a test to know the students’ achievements. In general, teachers are barely conducting item analysis on their tests. As a result, they have no idea about the quality of their test distributed to the students. The present study attempts to figure out the levels of difficulty (LD) and the discriminating power (DP) of the multiple-choice (MC) test item constructed by an English teacher in the reading comprehension test utilizing test item analysis. This study employs a qualitative approach. For this purpose, a test of 50-MC test items of reading comprehension was obtained from the students’ test results. Thirty-five students of grade eight took part in the MC test try-out. They are both male (15) and female (20) students of junior high school 2 Kempo, in West Nusa Tenggara Province. The findings revealed that16 items out of 50 test items were rejected due to the poor and worst quality level of difficulty and discriminating index. Meanwhile, 12 items need to be reviewed due to their mediocre quality, and 11 items are claimed to have good quality items. Besides, 11 items out of 50 test items were considered as the excellent quality as their DP scores reached around 0.44 through 0.78. The implications of the present study will shed light on the quality of teacher-made test items, especially for the MC test.

Keywords


discriminating power; item analysis; level of difficulty; reading comprehension test; teacher-made test

Full Text:

PDF

References


Arikunto, S. (2013). Dasar – dasar evaluasi pendidikan. Bumi Aksara.

Backhoff. E.E, & Reyna, N.L, & Morales, M.R. (2000). The level of difficulty and discrimination power of the basic knowledge and skills examination (EXHCOBA). Revista Electronica d Investigacion Educativa, 2, (1), 1-16.

Bacon, D. R. (2003). Assessing learning outcomes: A comparison of multiple-choice and short asnwer question in a marketing context. Journal of Marketing Education, 25 (31-36). https://doi.org/10.1177/0273475302250570

Boopathiraj. C, & Chellamani, K. (2013). Analysis of test items on difficulty level and discrimination index in the test for research in education. International Journal of Social Science & interdisciplinary Research, 2 (2).

Brown, D. (2004). Language assessment: Principles and classroom practices. Pearson Education, Inc.

Buckles, S., & Siegfried, J.J. (2006). Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics. Journal of Economic Education, 37 (48-57). https://doi.org/10.3200/jece.37.1.48-57

Danuwijaya, A. A. (2018). Item analysis of reading comprehension test for post-graduatestudents. English Review: Journal of English Education, 7(1),29-40.https://journal.uniku.ac.id/index.php/ERJEE. https://doi.org/10.25134/erjee.v7i1.1493.

Fitrianawati, M. (2010). Peran analisis butir soal guna meningkatkan kualitas butir soal, belajar peserta didik. Seminar Nasional Pendidikan PGDS UMS & HDPGSDI Wilayah Jawa.

Gronlund, N.E. (1993). How to make achievement tests and assessments. University of Michigan.

Haladyna, T. M. (2004). Developing and validating multiple-choice test items (3rd ed.). Lawrence Erlbaum Associates Publisher. https://doi.org/10.4324/9780203825945

Hartati, N., & Yogi, H.P.S. (2019). Item analysis for a better quality test. English Language in Focus (ELIF), 2 (1), 59-70. Retrieve from: https://jurnal.umj.ac.id/index.php/ELIF. https://doi.org/10.24853/elif.2.1.59-70

Hartoyo. (2011). Language assessment. Pelita Insani

Hemmati, F., & Ghaderi, E. (2014). The effect of four formats of multiple- choice questions on the listening comprehension of EFL learners. Procedia - Social and Behavioral Sciences, 98, 637–644. https://doi.org/10.1016/j.sbspro.2014.03.462.

Ingale, A.S, Giri, P.A., Mohan.K., Doibale. (2017) Study on item and test analysis of multiple choice questions amongst undergraduate medical students. International Journal of Community Medicine and Public Health, 4 (5),1562-1565. http://dx.doi.org/10.18203/2394-6040.ijcmph20171764.

Jannah, R., Hidayat, D.N., Husna, N., Khasbani, I. (2021). An Item analysis on multiple-choice questions: a case of a junior high Scholl English try-out test in Indonesia. Leksika, 15 (1), 9-17. https://dx.doi.org/10.30595/lks.v15i1.8768.

Jayanti, D., Husna, N., & Hidayat, D. N. (2019). The validity and reliability analysis of English national final examination for junior high school. VELES Voices of English Language Education Society Journal, 3(2), 128–135. https://doi.org/10.29408/veles.v3i2.1551.

Luthfiyyah, R., Aisyah, & Sulistyo, G.H. (2021). Technology-enhanced formative assessment in higher education: A voice from Indonesian EFL teachers. EduLite: Journal of English Education, Literature, and Culture, 6 (1), 42-54. http://dx.doi.org/10.30659/e.6.1.42-54.

Maharani, A.V., & Putro, N.H.P.S. (2020). Item analysis of English final semester test. Indonesian Journal of EFL and Linguistics, 5 (2), 491- 504). https://doi.org/10.21462/ijefl.v5i2.302

Mahmud, M. (2014). The EFL students' problems in answering the Test of English as a Foreign Language (TOEFL): a study in Indonesian context. Theory and Practice in Language Studies, 4(12), 2581-2587. https://doi.org/10.4304/tpls.4.12.2581-2587.

Manalu, D., Sipayung, K.T., Lestari, F.D. (2019). An analysis of students reading final examination by using item analysis program on eleventh grade of SMA Negeri 8 Medan. Journal of English Language Teaching & Applied linguistics, 1 (1), 13-19. https://doi.org/10.36655/jetal.v1i1.98.

Nisa, R., & Helmanda, C.M. (2020). Analysis of reading comprehension final test at English Department of Muhammadyah Aceh University. 7 (1), 72-85. https://doi.org/10.46244/geej.v7i1.987

Palmer, E.J., & Devitt, P.G. (2007). Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple-choice questions? BMC Medical Education, 7 (49). https://doi.org/10.1186/1472-6920-7-49

Quaigrain, K., & Arhin. A.K. (2017) Using reliability and item analysis to evaluate a teacher-developed test in educational measurement and evaluation, Cogent Education, 4,1-11. https://doi.org/10.1080/2331186X.2017.1301013.

Sulistyo, G. H. (2018). EFL learning assessment at School: An introduction to its basic concepts and principles. CV Bintang Sejahtera.

Suprananto, K. (2012). Pengukuran dan penilaian pendidikan [Measurement and assessment of education]. Graha Ilmu.




DOI: http://dx.doi.org/10.30659/e.6.2.256-269

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Author(s)

License URL: https://creativecommons.org/licenses/by/4.0/