Design of Assessment Instrument for Mathematical Critical Thinking Indicators-Based Essay Questions for Vocational and High School Students Using the Rasch Model

Jarot Rudi Hartato, Nizaruddin Nizaruddin, Lukman Harun

Abstract


This research aims to create a measurement tool for Critical Thinking Skills (CTS) in mathematics. The instrument was analysed using the Rasch model. The analysis was conducted to determine the results of the content validity test (item suitability), reliability test, dimensionality test (construct validity), person separation test, and item separation, and to analyse the items' difficulty level. This research uses the R&D model with the 4D model. Data collection methods through interviews with two teachers, literature studies to determine CTS indicators, questionnaire validation of CTS test instruments, and CTS test questions given to students. The sampling technique used was saturated sampling. The indicators of CTS are Interpretation, analysis, evaluation, and inference. The results for each instrument item are valid; construct validity is good, reliability is sufficient, and Cronbach's alpha is 0.68. The results of the person separation analysis show that students are divided into two groups, and item separation shows that the questions are divided into five groups. The measure (logit value) analysis results show that the interpretation indicator question is easy, the analysis indicator question is very difficult, the evaluation indicator question is moderate, and the inference indicator question is difficult. This research fills the literature gap by developing CTS indicator-based instruments validated by the RASCH approach, which has not been widely applied in SMA / SMK.

 Keywords: Critical Thinking, Test Instrument, Rasch Model


References


Adi, N. R. M. (2025). Analisis Kualitas Instrumen Literasi Media: Validitas dan Reliabilitas Menggunakan Model Rasch. Briliant: Jurnal Riset Dan Konseptual, 10(2), 323–336. https://doi.org/10.28926/briliant.v10i2.2048

Ajizah, E., & Putu Artayasa, I. (2022). Validitas Bahan Ajar IPA Berbasis Problem Based Learning Untuk Meningkatkan Keterampilan Berpikir Kritis dan Sikap Ilmiah Peserta Didik. Journal of Classroom Action Research, 4(2), 147–153. https://doi.org/10.29303/jcar.v4i1.1855

Anderha, R. R., & Maskar, S. (2021). Pengaruh Kemampuan Numerasi Dalam Menyelesaikan Masalah Matematika Terhadap Prestasi Belajar Mahasiswa Pendidikan Matematika. Jurnal Ilmiah Matematika Realistik, 2(1), 1–10. https://doi.org/10.33365/ji-mr.v2i1.774

Chan, S. W., Ismail, Z., & Sumintono, B. (2014). A Rasch Model Analysis on Secondary Students' Statistical Reasoning Ability in Descriptive Statistics. Procedia - Social and Behavioural Sciences, 129, 133–139. https://doi.org/10.1016/j.sbspro.2014.03.658

Dini Riyantini Sari, Nanan Sekarwana, Zahrotur Rusyda Hinduan, & Bambang Sumintono. (2016). Analisis Tingkat Kepuasan Masyarakat terhadap Dimensi Kualitas Pelayanan Tenaga Pelaksana Eliminasi Menggunakan Pemodelan Rasch. JSK: Jurnal Sistem Kesehatan, 2(1), 47–55. https://jurnal.unpad.ac.id/jsk_ikm

Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Analisis Kualitas Soal Kemampuan Membedakan Rangkaian Seri dan Paralel Melalui Teori Tes Klasik dan Model Rasch. Indonesian Journal of Educational Research and Review, 3(1), 11–19. https://doi.org/https://doi.org/10.23887/ijerr.v3i1.24080

Fauziana, A., & Wulansari, A. D. (2021). Analisis Kualitas Butir Soal Ulangan Harian di Sekolah Dasar dengan Model Rasch. Ibriez : Jurnal Kependidikan Dasar Islam Berbasis Sains, 6, 10–19. https://doi.org/10.21154//ibriez.v6i1.112

Hadiyanti, H., Susongko, P., & Munadi. (2024). Pengembangan Instrumen Higher Order Thinking Skill Mata Pelajaran Matematika Dengan Rasch Model. Journal of Education Research, 5, 399–407. https://doi.org/https://doi.org/10.37985/jer.v5i1.765

Irfiani, V., Junaedi, I., & Waluya, S. B. (2023). Systematic Literature Review: Kemampuan Berpikir Kritis Matematis Siswa Ditinjau dari Adversity Quotient. Jurnal Pendidikan Matematika, 1(2), 11. https://doi.org/10.47134/ppm.v1i2.157

JANNAH, U., Rosi, M., & Hafsi, A. R. (2023). Profil Kemampuan Numerasi Siswa Terhadap Kecerdasan Emosional. As-Salam: Jurnal Studi Hukum Islam & Pendidikan, 12(1), 98–112. https://doi.org/10.51226/assalam.v12i1.513

Jayadi, A., Putri, D. H., & Johan, H. (2020). Identifikasi Pembekalan Ketrampilan Abad 21 Pada Aspek Keterampilan Pemecahan Masalah Siswa SMA Kota Bengkulu dalam Mata Pelajaran Fisika. Jurnal Kumpara Fisika, 3(1), 25–32. https://doi.org/https://doi.org/10.33369/jkf.3.1.25-32

Karim, K., & Normaya, N. (2015). Kemampuan Berpikir Kritis Siswa dalam Pembelajaran dalam Pembelajaran Matematika dengan Menggunakan Model Jucama di Sekolah Menengah Pertama. EDU-MAT: Jurnal Pendidikan Matematika, 3(1). https://doi.org/10.20527/edumat.v3i1.634

Lutfiah, F. C., Juniati, D., Khabibah, S., Surabaya, U. N., & Wetan, J. L. (2023). Pengaruh Mathematical Literacy Terhadap Peningkatan Critical Thinking: Literature Review. SUPERMAT Journal Pendidikan Matematika, 7(2), 208–218. https://doi.org/https://doi.org/10.33627/sm.v7i2.1588

Muliana, G. (2021). Analisis Kemampuan Berpikir Kritis Matematis Siswa Kelas X pada Materi Persamaan Logaritma Ditinjau dari Kemandirian Belajar. MATH LOCUS: Jurnal Riset Dan Inovasi Pendidikan Matematika, 2(1), 15–22. https://doi.org/10.31002/mathlocus.v2i1.1475

Muntazhimah, Syifani Putri, & Hikmatul Khusna. (2020). Rasch Model untuk Memvalidasi Instrumen Resiliensi Matematis Mahasiswa Calon Guru Matematika. JKPM (Jurnal Kajian Pendidikan Matematika), 6(1), 65. https://doi.org/10.30998/jkpm.v6i1.8144

Mustika Wati, & Saiyidah Mahtari. (2017). Artikel Penelitian / Article Reviu Pengembangan Instrumen Kognitif Fisika Siswa SMP. 1(1), 45–56.

Ngadi, N. (2023). Analisis Model Rasch Untuk Mengukur Kompetensi Pengetahuan Siswa Smkn 1 Kalianget Pada Mata Pelajaran Perawatan Sistem Kelistrikan Sepeda Motor. Jurnal Pendidikan Vokasi Otomotif, 6(1), 1–20. https://doi.org/10.21831/jpvo.v6i1.63479

Nuryanti, S., Masykuri, M., & Susilowati, E. (2018). Analisis Iteman dan model Rasch pada pengembangan instrumen kemampuan berpikir kritis peserta didik sekolah menengah kejuruan. Jurnal Inovasi Pendidikan IPA, 4(2), 224–233. https://doi.org/10.21831/jipi.v4i2.21442

Parisu, C. Z. L., Ekadayanti, W., Sisi, L., Juwairiyah, A., & Kasmawati. (2024). Analisis Butir Soal Pengetahuan Dasar Matematika Menggunakan Pendekatan Rasch. SCIENCE TECH : Jurnal Ilmu Pengetahuan Dan Teknologi, 10(1), 36–45.

Pratama, B. A., & Mardiani, D. (2022). Kemampuan berpikir kritis matematis antara siswa yang mendapat model problem-based learning dan discovery learning. Jurnal Inovasi Pembelajaran Matematika: PowerMathEdu, 1(1), 83–92. https://doi.org/10.31980/pme.v1i1.1368

Pratama, D. (2020). Analisis Kualitas Tes Buatan Guru Melalui Pendekatan Item Response Theory (IRT) Model Rasch. Tarbawy : Jurnal Pendidikan Islam, 7(1), 61–70. https://doi.org/10.32923/tarbawy.v7i1.1187

Ramadhan, M. F., Siroj, R. A., & Afgani, M. W. (2024). Validitas and Reliabilitas. Journal on Education, 6(2), 10967–10975. https://doi.org/10.31004/joe.v6i2.4885

Ridho, A. (2011). MULTIDIMENSIONALITAS PADA TES POTENSI AKADEMIK. 1–16. https://repository.uin-malang.ac.id/1855/

Rizti, T. M., & Prihatnani, E. (2021). Efektivitas Model Pembelajaran 3CM (Cool-Critical-Creative-Meaningfull) terhadap Kemampuan Berpikir Kritis Siswa SMP. Mosharafa: Jurnal Pendidikan Matematika, 10(2), 213–224. https://doi.org/10.31980/mosharafa.v10i2.945

Rosita Dewi Nur, I., Herman, T., & Mariyana, R. (2019). Logical-Mathematics Intelligence in Early Childhood. International Journal of Social Science and Humanity, May, 105–109. https://doi.org/10.18178/ijssh.2018.v8.944

Sahira, P. E., & penggabean, E. M. (2022). Development of Test Instruments to Measure Middle School Students' Creative Thinking Ability. EDUMATIKA JURNAL MIPA, 2(1), 167–171. https://doi.org/https://doi.org/10.56495/emju.v2i4.300

Salsabila, U. H., Ilmi, M. U., Aisyah, S., Nurfadila, N., & Saputra, R. (2021). Peran Teknologi Pendidikan dalam Meningkatkan Kualitas Pendidikan di Era Disrupsi. Journal on Education, 3(01), 104–112. https://doi.org/10.31004/joe.v3i01.348

Sebariani, N., Ningsih, I., & Khoiruddin, A. Y. (2023). Faktor-Faktor Yang Mempengaruhi Loyalitas Nasabah Bank Syariah Indonesia. Jurnal Syarikah, 9(2), 197–208. https://doi.org/https://doi.org/10.30997/jsei.v9i2.9884

Sri Hanipah. (2023). Analisis Kurikulum Merdeka Belajar Dalam Memfasilitasi Pembelajaran Abad Ke-21 Pada Siswa Menengah Atas. Jurnal Bintang Pendidikan Indonesia, 1(2), 264–275. https://doi.org/10.55606/jubpi.v1i2.1860

Sumintono, B. (2018). Rasch Model Measurements as Tools in Assesment for Learning. 173(Icei 2017), 38–42. https://doi.org/10.2991/icei-17.2018.11

Sumintono, B., Islam, U., Indonesia, I., Widhiarso, W., & Mada, U. G. (2014). untuk Penelitian Ilmu-Ilmu Sosial. November.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch Pada Assessment Pendidikan. AplikAsi RascH PemodelAn Pada Assessment Pendidikan, September, 1–24.

Wulandari, O., Muhtarom, M., & Sumarno, S. (2025). Analisis Butir Soal Pengetahuan Matematika Kelas V Sekolah Dasar Menggunakan Model Rasch. 07(1), 293–302.

Zain, N. K., & Marhayati. (2024). Level of Critical Thinking Abilities of Madrasah Aliyah Negeri 1 Jombang Students in Solving Geometry Problems: A Review Based on Cognitive Style. Kontinu: Jurnal Penelitian Dikdaktik Matematika, 08(2), 120–134. https://doi.org/http://dx.doi.org/10.30659/kontinu.8.2


Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Jarot Rudi Hartato, Nizaruddin -, Lukman Harun

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Creative Commons License
This work is licensed under a Creative Commons - Attribution-NonCommercial-ShareAlike 4.0 International License.

The Kontinu Journal is published by the Mathematics Education Study Program, Faculty of Teacher Training and Education (FKIP), Universitas Islam Sultan Agung (Unissula).

Contact us: GKB, 2nd Floor, FKIP Unissula, Jl. Raya Kaligawe Km.4, Terboyo Kulon, Genuk, Semarang 50112.
Email: jurnal.kontinu@unissula.ac.id