Examining the Alignment of the Writing Test with Diverse Learners’ Writing Competencies through Readability Test
DOI:
https://doi.org/10.31849/cmyf8z79Keywords:
English writing test, Mixed ability, Readability test, Writing skillsAbstract
Arranging a writing test without considering students’ level of understanding of the test items may lead to misunderstandings during the test, particularly in a class with diverse writing abilities. This research aims to explore students’ insights to enhance the quality of writing tests as an attempt to avoid misunderstandings regarding writing test questions and instructions by utilising readability tests. The assessment was conducted at a private Islamic secondary school, where students exhibited a range of writing abilities. A total of 19 students participated in this evaluation. Data were collected through the following process: (1) students read and completed the writing test; (2) they filled out a readability test to identify their comprehension of the writing test questions and instructions; (3) the gathered data were classified into three categories (writing comprehension test, writing skill test, and test suitability). The results indicated that six students did not understand the writing test in Sections A and B due to their limited vocabulary. However, they demonstrated a better understanding of the writing test instructions (Section C), even though they had not fully utilised the provided vocabulary list for writing. Overall, the students felt that the writing test was suitable for their level of learning. In summary, readability assessments can serve as an alternative means to identify varied students’ understanding of writing test questions and instructions. This finding is beneficial for teachers in designing writing tests that accommodate students with varying writing competencies. Given that many students struggle with comprehending writing questions and instructions, teachers can assist this process by providing translations of the instructions.
References
Absalamova, G. (2024). The importance of skills and competencies of English teachers. UzMU Xabarlari, 1(1.6), 29–31. https://doi.org/10.69617/nuuz.v1i1.6.3655
Afwallah, M. (2024). Assessing reading comprehension: Analysing readability and students’ perceived difficulty (Master’s thesis, Université Mohammed V de Rabat). https://rgdoi.net/10.13140/RG.2.2.17736.12801
Akram, M., Siddiqa, A., Nabi, A. G., Shahzad, W., & Rashid, M. (2020). Essay writing and its problems: A study of ESL students at secondary level. International Journal of English Linguistics, 10(6), 237–246. https://doi.org/10.5539/ijel.v10n6p237
Alderson, J. C. (2000). Assessing reading. Cambridge University Press.
Apridayani, A., Han, W., & Sakkanayok, K. (2024). Enhancing English writing competence in higher education: A comparative study of teacher-only assessment versus teacher and student self-assessment approaches. Asian-Pacific Journal of Second and Foreign Language Education, 9(1), Article 37. https://doi.org/10.1186/s40862-024-00263-3
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.
Carcamo, B. (2023). The issue of readability in the Chilean EFL textbook. HOW Journal, 30(2), 135–155. https://doi.org/10.19183/how.30.2.739
Chang, D. Y. S., Lin, M. H., & Lee, J. Y. (2024). Exploring language assessment literacy and needs of English teachers at senior high school level. Asia Pacific Journal of Education, 1–19. https://doi.org/10.1080/02188791.2024.2313486
Durrant, P. (2016). To what extent is the Academic Vocabulary List relevant to university student writing? English for Specific Purposes, 43, 49–61. https://doi.org/10.1016/j.esp.2016.01.004
Emilia, E., Wijayanti, M. A., Chodidjah, I., Herawati, H., Murnijati, M., Hardini, S. R., & Hidayat, D. R. (2025). Guidance for the English subject phase B–F and the F advanced level (1st ed.). Education Standards, Curriculum, and Assessment Agency, Ministry of Primary and Secondary Education of the Republic of Indonesia. https://kurikulum.kemdikbud.go.id/file/panduan/dokumen/3. Final Panduan Mata Pelajaran Bahasa Inggris_12_09_2025_Revisi 3.pdf
Fata, I. A., Komariah, E., & Riski Alya, A. (2022). Assessment of readability level of reading materials in Indonesia EFL textbooks. Lingua Cultura, 16(1), 97–104. https://doi.org/10.21512/lc.v16i1.8277
Fulcher, G. (2010). Practical language testing. Hodder Education.
Haidari, M., Katawazai, R., & Mohd Yusof, S. (2020). The use of social media and wikis in teaching writing skills: A review article. International Journal of Interactive Mobile Technologies, 14(16), 168–179. https://doi.org/10.3991/ijim.v14i16.15531
Handayani, E. T., & Aminatun, D. (2020). Students’ point of view on the use of WhatsApp group to elevate writing ability. Journal of English Language Teaching and Learning, 1(2), 31–37. https://doi.org/10.33365/jeltl.v1i2.602
Hidayat, L. E., Amalia, S. N., Rohmana, W. I. M., Virdyna, N. K., Ardi, P., & Suryati, N. (2024). EFL teachers’ understanding and practices of classroom-based diagnostic assessment in differentiated instruction. In T. Q. Tran & T. M. Duong (Eds.), Advances in educational technologies and instructional design (pp. 181–218). IGI Global. https://doi.org/10.4018/979-8-3693-6497-0.ch007
Hyland, K. (2003). Second language writing. Cambridge University Press.
International Test Commission. (2025). Guidelines for technology-based assessment. International Test Commission.
Javed, M., Juan, W. X., & Nazli, S. (2013). A study of students’ assessment in writing skills of the English language. International Journal of Instruction, 6(2), 129–144
Juhansar, Prasetyoaji, A., Pabbajah, M., & Mahardika, N. A. (2022). Students’ performance in arranging English words into simple sentences utilizing jumbled-word cards. IJOLTL (Indonesian Journal of Language Teaching and Linguistics), 7(3), 291–311. https://doi.org/10.30957/ijoltl.v7i3.700
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
Kartinisari, K. R., Batan, I. G., & Adnyani, L. D. S. (2017). Teacher’s use of translation as instructional strategy in teaching English. Lingua Scientia, 25(1), Article 20. https://doi.org/10.23887/ls.v25i1.18819
Kaur, A., Noman, M., & Nordin, H. (2017). Inclusive assessment for linguistically diverse learners in higher education. Assessment & Evaluation in Higher Education, 42(5), 756–771. https://doi.org/10.1080/02602938.2016.1187250
Kouamé, J. B. (2010). Using readability tests to improve the accuracy of evaluation documents intended for low-literate participants. Journal of MultiDisciplinary Evaluation, 6(14), 132–139. https://doi.org/10.56645/jmde.v6i14.280
Liu, X. (2024). Formative writing assessment: An EFL teacher’s beliefs and practices. Changing English, 31(2), 200–210. https://doi.org/10.1080/1358684X.2024.2328163
Luan, N. M., Rajendran, M., Subramanian, J., Jaisankar, D., Oli, L., & A, P. (2024). Exploration of factors causing difficulties in students’ writing skills. World Journal of English Language, 14(4), 447–456. https://doi.org/10.5430/wjel.v14n4p447
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki. (2023). Exploring artificial intelligence in academic essay: Higher education student’s perspective. International Journal of Educational Research Open, 5, Article 100296. https://doi.org/10.1016/j.ijedro.2023.100296
Malilla, R., & Irwandi, I. (2022). The effectiveness of using WhatsApp in English language teaching during the Covid-19 pandemic for junior high school students. Journal of Education and Teaching, 3(2), 185–194. https://doi.org/10.51454/jet.v3i2.157
Mayahi, A. J., & Alshatti, E. N. (2023). Assessing English language writing and readability skills using long short-term memory model. In 2023 Computer Applications & Technological Solutions (CATS) (pp. 1–4). IEEE. https://doi.org/10.1109/CATS58046.2023.10424106
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). American Council on Education and Macmillan.
Motlaq, H. S., & Egresh, N. (2016). The relationship between reading ability and writing quality among Iranian EFL academic writers. International Journal of Humanities and Cultural Studies, 3(2), 1270–1287.
Naka, L. (2017, October 28). The importance of differentiated instruction in EFL learning. In 2017 UBT International Conference (Conference presentation). https://doi.org/10.33107/ubt-ic.2017.119
Nazilah, A. S. (2024). Diagnostic assessment in differentiated learning: Supporting learners’ needs for improved learning achievement. Research Journal on Teacher Professional Development, 2(1), 87–92. https://doi.org/10.21580/rjtpd.v2i1.20662
Nemati, M., & Azizi, M. (2013). Readability index of essays as an alternative to the scoring procedure in L2 academic writing. Journal of Paramedical Sciences, 4(1), 2–8. https://doi.org/10.22037/jps.v4i0.4011
Noman, M., & Kaur, A. (2014). Differentiated assessment: A new paradigm in assessment practices for diverse learners. International Journal of Education and Applied Sciences, 1(4), 167–174.
Nor, H., Saadillah, & Afifi, N. (2023). Unpacking writing assessment tasks for junior high school students: A comprehensive analysis. ELE Reviews: English Language Education Reviews, 3(1), 66–83. https://doi.org/10.22515/elereviews.v3i1.6979
Nurpiana, Z., & Fithriani, R. (2023). Indonesian EFL teachers’ use of code mixing in classroom interactions. Journal of Vocational Education Studies, 6(1), 25–39. https://doi.org/10.12928/joves.v6i1.8049
Oliveri, M. E. (2019). Considerations for designing accessible educational scenario-based assessments for multiple populations: A focus on linguistic complexity. Frontiers in Education, 4, Article 88. https://doi.org/10.3389/feduc.2019.00088
Owu-Ewie, C. (2015). Readability of comprehension passages in junior high school (JHS) English textbooks in Ghana. Ghana Journal of Linguistics, 3(2), 35–56. https://doi.org/10.4314/gjl.v3i2.3
Pardede, Y. K. P., Silaban, D. M. T. S., Sibarani, S. O. R., & Saragih, E. (2022). Writing assessment strategies by junior high school English teacher. Linguistic, English Education and Art (LEEA) Journal, 5(2), 247–257. https://doi.org/10.31539/leea.v5i2.3800
Purba, M. P., Khairina, A., Manurung, M. A., Anshari, K., & Wuriyani, E. P. (2025). Improving junior high school students’ reading and writing skills based on diagnostic assessment. Edunesia: Jurnal Ilmiah Pendidikan, 6(3). https://doi.org/10.51276/edu.v6i3
Rahmawati, L. E., & Sulistyono, Y. (2021). Assessment and evaluation on text readability in reading test instrument development for BIPA-1 to BIPA-3. Asian Journal of University Education, 17(3), 51–62. https://doi.org/10.24191/ajue.v17i3.14522
Rahmawati, Y. R., & Rini, S. (2024). English writing assessment in EFL classrooms at junior high schools: What are teachers’ perceptions? SCOPE: Journal of English Language Teaching, 8(2), 639–650. https://doi.org/10.30998/scope.v8i2.19608
Ramaila, S. (2025). Unveiling the potential: A systematic review on harnessing the affordances of differentiated instruction. Journal of Teaching and Learning, 19(2), 41–56. https://doi.org/10.22329/jtl.v19i2.8561
Rosalinda, E., Hamamah, H., & Degeng, P. D. D. (2022). Students’ perception on the use of WhatsApp for learning writing during Covid-19 pandemic: A case study. Jurnal Pendidikan: Riset dan Konseptual, 6(3), 500–509. https://doi.org/10.28926/riset_konseptual.v6i3.557
Sari, R. K. (2020). Readability assessment of English junior high school textbooks by implementing cloze procedure. SCOPE: Journal of English Language Teaching, 4(2). https://doi.org/10.30998/scope.v4i2.6294
Shafiee Rad, H., & Alipour, R. (2024). Unlocking writing success: Building assessment literacy for students and teachers through effective interventions. Assessing Writing, 59, Article 100804. https://doi.org/10.1016/j.asw.2023.100804
Situmorang, K., & Pramusita, S. M. (2024). Students’ perceived challenges and learning strategies of English medium of instruction in the international nursing program: A descriptive quantitative study. Al-Ishlah: Jurnal Pendidikan, 16(1), 158–168. https://doi.org/10.35445/alishlah.v16i1.4246
Sujinah, Isnah, E. S., Jalis, F. M. M., & Kharis, M. (2024). Utilizing cognitive diagnostic assessments to identify and address student needs in differentiated classrooms. Journal of Higher Education Theory and Practice, 24(1). https://doi.org/10.33423/jhetp.v24i1.6763
The Agency of Curriculum and Assessment Standard. (2022). English learning outcomes in Indonesian education phase A–F. Badan Standar, Kurikulum, dan Asesmen Pendidikan, Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi Republik Indonesia.
Tomlinson, C. A. (2017). How to differentiate instruction in academically diverse classrooms (3rd ed.). ASCD.
Troia, G., Lawrence, F., Brehmer, J., Glause, K., & Reichmuth, H. (2023). Efficient measurement of writing knowledge with forced-choice tasks: Preliminary data using the student knowledge of writing tests. Journal of Writing Research, 15(2), 395–427. https://doi.org/10.17239/jowr-2023.15.02.06
Utami, F. S., Pabbajah, M., & Juhansar, J. (2018). The implementation of jumbled-sentences toward students’ skill in writing report text. English Review: Journal of English Education, 7(1), 115–124. https://doi.org/10.25134/erjee.v7i1.1501
Uzun, K. (2017). The relationship between genre knowledge and writing performance. The Journal of Teaching English for Specific and Academic Purposes, 5(2), 153–162. https://doi.org/10.22190/JTESAP1702153U
Wardani, H. K., Syukriyah, F. M., & Hidayah, B. (2024). Identifying students’ difficulties in reading comprehension tests. English Journal of Indragiri, 8(1), 15–30. https://doi.org/10.61672/eji.v8i1.2626
Weir, C. J. (2005). Language testing and validation: An evidence-based approach. Palgrave Macmillan.
Williams, C., & Beam, S. (2019). Technology and writing: Review of research. Computers & Education, 128, 227–242. https://doi.org/10.1016/j.compedu.2018.09.024
Wiyaka, W., Silitonga, L. M., Sunardi, S., & Pramudi, Y. T. C. (2025). Leveraging diagnostic assessment aligned to differentiated learning: Voices of English language teachers. KnE Social Sciences, 10(9), 175–188. https://doi.org/10.18502/kss.v10i9.18486
Wray, D., & Janan, D. (2013). Exploring the readability of assessment tasks: The influence of text and reader factors. Multidisciplinary Journal of Educational Research, 3(1), 69–95. https://doi.org/10.4471/remie.2013.04
Yu, C., & Xu, W. (2024). Writing assessment literacy and its impact on the learning of writing: A netnography focusing on Duolingo English Test examinees. Language Testing in Asia, 14, Article 24. https://doi.org/10.1186/s40468-024-00297-x
Yulianto, Y. (2019). An analysis on readability level of English reading texts for eighth grade students. Journal of English for Academic, 6(1), 81–90. https://doi.org/10.25299/jshmic.2019.vol6(1).2675
Yuliawati, F. (2016). Testing students through the writing skills. Wacana Didaktika, 4(1), 33–41. https://doi.org/10.31102/wacanadidaktika.4.1.33-41
Zulkifli, N. A. (2017). Designing writing assessment tasks for junior high school. Indonesian Journal of Integrated English Language Teaching, 2(2). https://doi.org/10.24014/ijielt.v2i2.2456
Zulkornain, L. H., Mat, A. C., & Rahman, N. A. A. (2023). Does automated writing evaluation (AWE) improve students’ writing? Focus on technical aspects and readability. International Journal of Information and Education Technology, 13(10), 1656–1662. https://doi.org/10.18178/ijiet.2023.13.10.1974
Downloads
Published
Issue
Section
License
- Author retains the copyright and grants Elsya Journal the right of first publication of the work simultaneously licensed under the Creative Commons Attribution-ShareAlike 4.0 License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal
- The author is able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book) with the acknowledgment of its initial publication in this journal.
- The author is permitted and encouraged to post his/her work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of the published work (See The Effect of Open Access).
Elsya Journal is licensed under 