SOLO TAXONOMY AND RASCH-BASED NEEDS ANALYSIS FOR MATHEMATICS LITERACY ASSESSMENT: TEACHERS’ AND STUDENTS’ PERSPECTIVES

  • Viona Yuliza Universitas Jambi, Indonesia
  • Syamsir Sainuddin Universitas Jambi, Indonesia
  • Ilham Falani Universitas Jambi, Indonesia
Keywords: mathematics assessment, mathematical literacy, rasch model, SOLO taxonomy

Abstract

Indonesian students’ mathematical literacy remains low (PISA 2022 score = 366), partly because school assessments are dominated by procedural items lacking graded cognitive complexity. This study analyzes the need for a SOLO Taxonomy-based mathematics literacy instrument from combined teacher and student perspectives, an empirical foundation not offered by single-stakeholder studies. An Exploratory Sequential Mixed-Methods design used three instruments, a teacher questionnaire (N = 3), a student questionnaire (N = 200), and an 8-item PISA-referenced diagnostic test (N = 200), in Jambi City and Muaro Jambi. Questionnaires were analyzed descriptively; the diagnostic test used the Dichotomous Rasch Model via Joint Maximum Likelihood Estimation. Teachers showed a knowledge-practice gap (highest dimension: need for new instruments, M = 3.24; lowest: item-construction practice, M = 2.92, scale 1-4). Rasch calibration showed strong item separation (Reliability = 0.99, Separation = 9.13) and acceptable person separation for an 8-item instrument (Reliability = 0.52), no item misfit, no significant gender/domicile DIF, and confirmed 87.5% of students (175/200) at PISA Levels 1-3, mean θ = -1.17 logit. Joint Display integration converged on three needs: SOLO-graded items, PISA-aligned real-world contexts, and teacher professional development. Unlike prior PISA- or SOLO-based instruments developed separately, this is the first study to integrate teacher/student needs data with Rasch-calibrated diagnostic evidence into a single empirical foundation for SOLO-based literacy instrument development in Indonesian junior high schools.

Penelitian Literasi matematika siswa Indonesia masih rendah (skor PISA 2022 = 366), sebagian karena penilaian di sekolah didominasi oleh soal-soal prosedural yang kurang mencerminkan kompleksitas kognitif berjenjang. Penelitian ini menganalisis kebutuhan akan instrumen literasi matematika berbasis Taksonomi SOLO dari perspektif gabungan guru dan siswa, sebuah landasan empiris yang tidak ditawarkan oleh penelitian yang hanya melibatkan satu pemangku kepentingan. Desain Eksploratif Sekuensial Metode Campuran menggunakan tiga instrumen, yaitu kuesioner guru (N = 3), kuesioner siswa (N = 200), dan tes diagnostik berbasis PISA yang terdiri dari 8 soal (N = 200), di Kota Jambi dan Muaro Jambi. Kuesioner dianalisis secara deskriptif; sedangkan tes diagnostik menggunakan Model Rasch Dikotomis melalui Estimasi Maksimum Likelihood Bersama. Guru menunjukkan kesenjangan antara pengetahuan dan praktik (dimensi tertinggi: kebutuhan akan instrumen baru, M = 3,24; terendah: praktik penyusunan item, M = 2,92, skala 1–4). Kalibrasi Rasch menunjukkan pemisahan item yang kuat (Reliabilitas = 0,99, Pemisahan = 9,13) dan pemisahan antarindividu yang dapat diterima untuk instrumen berisikan 8 item (Kekuatan Reliabilitas = 0,52), tanpa misfit butir maupun DIF gender/domisili, serta mengonfirmasi 87,5% siswa (175/200) berada pada Level PISA 1–3, dengan rata-rata θ = –1,17 logit. Integrasi Joint Display menghasilkan tiga kebutuhan konvergen: soal berjenjang berbasis SOLO, konteks nyata sesuai PISA, dan pengembangan professional guru. Berbeda dari instrument berbasis PISA atau SOLO yang dikembangkan terpisah pada penelitian terdahulu, studi ini pertama kali mengintegrasikan data kebutuhan guru-siswa dengan bukti diagnostic terkalibrasi Rasch sebagai landasan empiris tunggal pengembangan instrument literasi matematika berbasis SOLO di SMP Indonesia.

 

References

Afifa, M., Khoirunnisa, R., Pratiwi, S. M. V., & Meitaza, D. (2024). Utilizing Rasch Model To Analyze A Gender Gap In Students’ Scientific Literacy On Energy. JPFI: Jurnal Pendidikan Fisika Indonesia, 20(1), 85-95. https://doi.org/10.15294/jpfi.v20i1.44472

Aisyah, & Juandi, D. (2022). The Description Of Indonesian Student Mathematics Literacy In The Last Decade. International Journal of Trends in Mathematics Education Research, 5(1), 105-110. https://doi.org/10.33122/ijtmer.v5i1.114

Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A Taxonomy For Learning, Teaching, And Assessing: A Revision Of Bloom’s Taxonomy Of Educational Objectives. Longman. https://id.scribd.com/document/369062951

Biggs, J. B., & Collis, K. F. (1982). Evaluating the Quality of Learning: the SOLO Taxonomy (Structur of the Observed Learning Outcome). Academic Press. https://resolutionresources.com.au/wp-content/uploads/2022/02/Biggs-Collis-1982.pdf

Bilad, M. R., Zubaidah, S., & Prayogi, S. (2024). Addressing The Pisa 2022 Results: A Call For Reinvigorating Indonesia’s Education System. International Journal of Essential Competencies in Education, 3(1), 1-12. https://doi.org/10.36312/ijece.v3i1.1935

Bolstad, O. H. (2023). Lower Secondary Students’ Encounters With Mathematical Literacy. Mathematics Education Research Journal, 35, 237-253. https://doi.org/10.1007/s13394-021-00386-7

Bond, T. G., & Fox, C. M. (2015). Applying the rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge. https://doi.org/10.4324/9781410614575

Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the rasch model: Fundamental measurement in the human sciences (4th ed.). Routledge. https://www.routledge.com/9 780367141424

Creswell, J. W., & Clark, V. L. P. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications.

Darman D. R., Suhandi, A., Kaniawati, I., Samsudin, A., & Wibowo, F. C. (2024). Development And Validation Of Scientific Inquiry Literacy Instrument (Sili) Using Rasch Measurement Model. Education Science, 14(3), 1-28. https://doi.org/10.3390/educsci14030322

Dong, J., & Zhang, Y. (2024). Research Review: The Solo Taxonomy (Structure Of The Observed Learning Outcome) In Mathematics Education. Academic Journal of Mathematical Sciences, 5(1), 30-34. https://doi.org/10.25236/AJMS.2024.050105

Edwar, Putri, R. I. I., Zulkardi, & Darmawijoyo. (2023). Developing A Workshop Model For High School Mathematics Teachers Constructing HOTS Questions Through The Pendidikan Matematika Realistic Indonesia Approach. Journal on Mathematics Education, 14(4), 603-626. https://doi.org/10.22342/jme.v14i4.pp603-626

Eka, F., Suratman, D., Rifat, M., Siregar, & N., Hamdani. (2026). Design And Validation Of A Pisa Oriented Instructional Module For Linear Functions Aligned With The Merdeka Curriculum. Al-Jabar: Jurnal Pendidikan Matematika, 17(1), 233-248. https://doi.org/10.24042/ajpm.v17i1.29709

Ekowati, V. I., Nurhayati, E., Suwarna, & Saputri, I. I. (2023). Program For International Student Assessment-Based Analysis For Javanese Test. IJERE: International Journal of Evaluation and Research in Education, 12(2), 1122-1135. https://doi.org/10.11591/ijere.v12i2.24426

Falani, I., Ramalisa, Y., Sainuddin, S., & Kriswantoro. (2025). Development of a PISA-Based Mathematical Literacy Instrument For Indonesian Students Using Item Response Theory. Journal of Physics: Conference Series, 3148, 012003. https://doi.org/10.1088/1742-6596/3148/1/012003

Fitrah, M., Sofroniou, A., Ofisnto, Judijanto, L., & Widihastuti. (2024). Reliability And Separation Index Analysis Of Mathematics Questions Integrated With The Cultural Architecture Framework Using The Rasch Model. Journal of Education and e-Learning Research, 11(3), 499-509. https://doi.org/10.20448/jeelr.v11i3.5861

Fitriati, F., Rosli, R., Iksan, Z., & Hidayat, A. (2024). Exploring Challenges In Preparing Prospective Teachers For Teaching 4c Skills In Mathematics Classroom: A School-University Partnership Perspectives. Cogent Education, 11(1), 1-21. https://doi.org/10.1080/2331186X.2023.2286812

Harisman, Y., Mayani, D. E., Armiati, Syaputra, H., & Amiruddin, M. H. (2023). Analysis Of Student’s Ability To Solve Mathematical Literacy Problems In Junior High Schools In The City Area. Infinity: Journal of Mathematics Education, 12(1), 55-68. https://doi.org/10.22460/infinity.v12i1.p55-68

Juniati, H., & Jamaan, E. Z. (2024). Problem-Based Learning In Improving Critical Mathematical Thinking Skills: Independent Curriculum Teaching Module. Al-Jabar: Jurnal Pendidikan Matematika, 15(2), 493-503. https://doi.org/10.24042/ajpm.v15i2.23788

Kania, N., Kusumah, Y.S., Dahlan, J.A., Nurlaeelah E., Gurbuz, F., & Bonyah, E. (2024). Constructing And Providing Content Validity Evidence Throught The Aiken’s V Index Based On The Experts’ Judgments Of The Instrument To Measure Mathematical Problem-Solving Skills. REID: Research and Evaluation in Education, 10(1), 45-58. https://doi.org/10.21831/reid.v10i1.71032

L’Boy, D., & Khan, R. N. (2023). A Rasch-Mode-Based Hierarchical Framework For Statistical Literacy And Learning. International Journal of Mathematical Education in Science and Technology, 54(9), 1874-1887. https://doi.org/10.1080/0020739X.2023.2261453

Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(2), 328. https://www.researchgate.net/publication/235361463

Miles, M. B., Huberman, A. M., & Saldana, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). SAGE Publications.

Nurhanurawati, Caswita, Bharata, H., & Widyastuti. (2022). The Analysis Of Junior High School Students’ Mathematical Literacy: Field Study In Bandar Lampung. Al-Jabar: Jurnal Pendidikan Matematika, 13(1), 199-209. https://doi.org/10.24042/ajpm.v13i1.11659

Nusantara, D. S., Zulkardi, & Putri, R. I. I. (2021). Designing Pisa-Like Mathematics Task Using A Covid-19 Context (Pisacomat). JME: Journal on Mathematics Education, 12(2), 349-364. https://jme.ejournal.unsri.ac.id/index.php/jme/article/view/3727/251

OECD. (2023a). PISA 2022 Assessment and Analystical Framework. PISA, OECD Publishing, Paris. https://doi.org/10.1787/dfe0bf9c-en

OECD. (2023b). PISA 2022 Results (Volume I):The State of Learning and Equity in Education. PISA, OECD Publishing, Paris. https://doi.org/10.1787/53f23881-en

Rizbudiani, A. D., Jaedun, A., Rahim, A., & Arief. (2021). Rasch Model Item Response Theory (Irt) To Analyze The Quality Of Mathematics Final Semester Exam Test On System Of Linear Equations In Two Variables (Sletv). Al-Jabar: Jurnal Pendidikan Matematika, 12(2), 399-412. Https://Doi.Org/10.24042/Ajpm.V12i2.9939

Samsuddin, A. F., & Rernawati, H. (2025). Literasi Matematika Siswa Smp Negeri Makassar Ditinjau Dari Domain Proses, Konten, Dan Konteks Pisa. Primatika: Jurnal Pendidikan Matematika, 14(2), 413-422. https://jurnal.fkip.unmul.ac.id/index.php/primatika/article/ view/6127

Stacey, K. (2011). The pisa view of mathematical literacy in indonesia. Journal on Mathematics Education, 2(2), 95-126. https://doi.org/10.22342/jme.2.2.746.95-126

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Trim Komunikata. https://www.researchgate.net/publication/282673464

Suparman, Juandi, D., & Martadiputra, B. A. P. (2023). Students’ Heterogeneous Mathematical Critical Thinking Skills In Problem-Based Learning: A Meta-Analysis Investigating The Involvement Of School Geographical Location. Al-Jabar: Jurnal Pendidikan Matematika, 14(1), 37-53. https://doi.org/10.24042/ajpm.v14i1.16200

Susanta, A., Sumardi, H., Susanto, E., & Retnawati. (2023). Mathematics Literacy Task On Number Pattern Using Bengkulu Context For Junior High School Students. JME: Journal on Mathematics Education, 14(1), 85-102. https://doi.org/10.22342/jme.v14i1.pp85-102

Tanujaya, B., Prahmana, R. C. I., & Mumu, J. (2021). Mathematics Instruction To Promote Mathematics Higher-Order Thinking Skills Of Students In Indonesia: Moving forward. TEM Journal: Technology, Education, Management, Informatics, 10(4), 1945-1954. https://doi.org/10.18421/TEM104-60

Wang, X. S., Perry, L. B., Malpique, A., & Ide, T. (2023). Factors Predicting Mathematics Achievement In Pisa: A Systematic Review. Large-Scale Assessments in Education, 11(24), 11-24. https://doi.org/10.1186/s40536-023-00174-8

Wijaya, T. T., Hidayat, W., Hermita, N., Alim, J. A., & Talib, C. A. Exploring Contributing Factors To Pisa 2022 Mathematics Achievement: Insights From Indonesian Teachers. Infinity: Journal of Mathematics Education, 13(1), 139-156. https://doi.org/10.22460/infinity.v13i1.p139-156

Wright, B. D., & Stone, M. H. (1979). Best Test Design: Rasch Measurement. MESA Press. https://research.acer.edu.au/cgi/viewcontent.cgi?params=/context/measurement/article/1000

Yanuarto, W. N., Setyaningsih, E., & Umiatun, K. N. (2023). Kahoot! As A Collaborative Gamified Mathematics Learning Platform For Indonesian Junior School Students. Al-Jabar: Jurnal Pendidikan Matematika, 14(1), 99-108. https://doi.org/10.24042/ajpm.v14i1.16623

Yuanita, P., Maimunah, Kartini, & Arif, N. (2023). Analysis Of Solo Taxonomy-Based Test Instruments In Approaching The Merdeka Curriculum. JRAMathEdu: Journal of Research and Advances in Mathematics Education, 8(1), 12-29. https://doi.org/10.23917/jramathedu.v8i1.1270

Yulia, Kustati, M., & Afriadi, J. (2021). Mathematical Literacy: A Case Study On Padang Students’ Mathematical Ability. Al-Jabar: Jurnal Pendidikan Matematika, 12(1), 109-120. https://doi.org/10.24042/ajpm.v12i1.8538

Published
2026-09-23
Section
Articles