Workplace Simulation-Based English for Specific Purposes (ESP) Assessment in Vocational Education: A Scoping Review
DOI:
https://doi.org/10.33603/perspective.v14i2.12838Keywords:
Assessments ESP, Instruments Validation, Scoping Review, Vocational Education, Work-SimulationAbstract
English for Specific Purposes (ESP) plays an important role in workplace competence in vocational education. Work simulation is widely promoted as a way to provide authentic, performance-based assessment. However, it remains unclear whether simulation is actually used to assess ESP proficiency or mainly to support learning, and whether the assessment instruments are properly validated. This study uses a scoping review based on the PRISMA-ScR guidelines to examine how work simulation is used in ESP assessment in vocational education. A systematic search of four databases (Lens.org, ERIC, DOAJ, and Garuda) for studies published between 2016 and 2026 identified 172 records. After removing duplicates and conducting two-stage screening, 11 studies met the inclusion criteria. The findings show that work simulation is used mainly as a learning strategy rather than as a way to assess competence. Only one of the 11 studies conducted assessment within a simulated task and validated its measurement instrument. Other studies often treated statistical significance as evidence of validation, validated materials or satisfaction questionnaires instead of proficiency instruments, or used standardized tests without providing a context-specific validity argument. These findings highlight a gap between the authenticity promised by simulation-based assessment and its actual use in ESP. Future research should prioritize developing and validating assessment instruments embedded in simulated work tasks, including emerging AI- and virtual-reality-based environments.
References
Abdullah, M. I. M., & Soliman, K. S. M. (2019). The Effectiveness of Using Task-Based Instruction in Enhancing Vocational Students’ Communicative Performance. Open Journal of Modern Linguistics, 9(6), 446. https://doi.org/10.4236/ojml.2019.96035
Anderson, H. L., Kurtz, J., & West, D. C. (2021). Implementation and Use of Workplace-Based Assessment in Clinical Learning Environments: A Scoping Review. Academic Medicine, 96(Supplement_2), S164–S174. https://doi.org/10.1097/ACM.0000000000004366
Apriyanti, D., Syarif, H., & Ramadhan, S. (2021). Video Feature Making in ESP- Based Public Speaking Class: A Student-Centred Learning in Vocational Higher Education Context. International Journal of Language Education, 5(1). https://doi.org/10.26858/ijole.v5i1.15419
Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Centre for Reviews and Dissemination. (2025). PROSPERO. https://www.crd.york.ac.uk/prospero/
Chernikova, O., Heitzmann, N., Stadler, M., Holzberger, D., Seidel, T., & Fischer, F. (2020). Simulation-Based Learning in Higher Education: A Meta-Analysis. Review of Educational Research, 90(4), 499–541. https://doi.org/10.3102/0034654320933544
Coxhead, A., Parkinson, J., Mackay, J., & McLaughlin, E. (2019). English for Vocational Purposes: Language Use in Trades Education. Routledge. https://doi.org/10.4324/9780429449932
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, 55(6), 2503–2529. https://doi.org/10.1111/bjet.13460
Dahlback, J., Olstad, H. B., Sylte, A. L., & Wolden, A.-C. (2020). The Importance of Authentic Workplace-Based Assessment: A Study From VET Teacher Education. International Journal for Research in Vocational Education and Training, 7(3), 302–324. https://doi.org/10.13152/IJRVET.7.3.3
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004). A five-dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–86. https://doi.org/10.1007/BF02504676
Guo, J., & Yu, K. (2022). Effects of ESP Courses on Chinese Health Vocational College Students. Korean J General Edu, 16(5), 189-202. https://doi.org/10.46392/kjge.2022.16.5.189
Hidayati, L., & Meisani, D. R. (2023). The Needs Analysis of English for Specific Purposes: A Study in an Indonesian Medical School. IJELTAL (Indonesian Journal of English Language Teaching and Applied Linguistics), 7(2), 465–479. https://doi.org/10.21093/ijeltal.v7i2.1424
Huang, X. (2026). Reconstruction and Empirical Research on Full-Process Maritime English Teaching in Higher Vocational Colleges Supported by Dual Collaborative Generative AI Models. International Journal of Education and Humanities, 24(1), 55–59. https://doi.org/10.54097/d28kdm66
Jossberger, H., Brand-Gruwel, S., van de Wiel, M. W. J., & Boshuizen, H. (2017). Learning in Workplace Simulations in Vocational Education: A Student Perspective. Vocations and Learning, 11(2), 179–204. https://doi.org/10.1007/s12186-017-9186-7
Kanca, I. N., Ginaya, G., & Astuti, N. N. S. (2021). The effectiveness of the problem solving method on learning outcomes of the English course for room division operation during the COVID-19 pandemic. International Journal of Linguistics, Literature and Culture, 7(1), 12–22. https://doi.org/10.21744/ijllc.v7n1.1102
Kane, M. T. (2013). Validating the Interpretations and Uses of Test Scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
Knoch, U., & Macqueen, S. (2016). 18. Language assessment for the workplace. In D. Tsagari & J. Banerjee (Eds.), Handbook of Second Language Assessment. https://www.degruyterbrill.com/document/doi/10.1515/9781614513827-020/html?lang=en
Koester, A. (2021). English for Occupational Purposes. In The Encyclopedia of Applied Linguistics (pp. 1–6). John Wiley & Sons, Ltd. https://doi.org/10.1002/9781405198431.wbeal0381.pub2
Levac, D., Colquhoun, H., & O’Brien, K. K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5(1), 69. https://doi.org/10.1186/1748-5908-5-69
Liao, L., Ye, S. X., & Yang, J. (2023). A mini review of communicative language testing. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1058411
Lo, Y.-H. G. (2017). Reconceptualizing Curriculum Politics: A Case Study of an ESP Program for Vocational High School Students in Taiwan. Taiwan Journal of TESOL, 14(1), 37–86.
Messick, S. (1989). Validity. In Educational Measurements (3rd ed.). American Council on Education.
Mukadimah, H., & Sahayu, W. (2021). Embedding Content and Language Integrated Learning (CLIL) into English for specific purposes curriculum for vocational high school. Jurnal Pendidikan Vokasi, 11(2), 204–212. https://doi.org/10.21831/jpv.v11i2.41065
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(1), 143. https://doi.org/10.1186/s12874-018-0611-x
Newton, P. E., & Shaw, S. D. (2014). Validity in educational & psychological assessment. SAGE Publications.
Norris, J. M., Sasayama, S., & Kim, M. (2023). Simulating Real-World Context in an Email Writing Task: Implications for Task-Based Language Assessment. ETS Research Report Series, 2023(1), 1–22. https://doi.org/10.1002/ets2.12366
Nurjanah, I., & Ana, A. (2022). Work Readiness of TVET Graduates in the Context of Industry 4.0. Proceedings of the 4th International Conference on Innovation in Engineering and Vocational Education (ICIEVE 2021), 34–38. https://www.atlantis-press.com/proceedings/icieve-21/125972285
Nyström, S., & Ahn, S. (2020). Simulation-based training in VET through the lens of a sociomaterial perspective. Nordic Journal of Vocational Education and Training, 10(1), 1–17. https://doi.org/10.3384/njvet.2242-458X.201011
OECD. (2021). Teachers and Leaders in Vocational Education and Training. OECD. https://www.oecd.org/en/publications/teachers-and-leaders-in-vocational-education-and-training_59d4fbb1-en.html
Peters, M., Marnie, C., Tricco, A., Pollock, D., Munn, Z., Alexander, L., McInerney, P., Godfrey, C., & Khalil, H. (2021). Updated methodological guidance for the conduct of scoping reviews. JBI Evidence Implementation, 19(1), 1–10. https://doi.org/10.1097/XEB.0000000000000277
Plomp, T., & Nieveen, N. (2013). Educational Design Research: Part A: An Introduction. https://ris.utwente.nl/ws/portalfiles/portal/1554416/Design_Research_Part_A.pdf
Pradipta, B., Hirawan, F., & Ragamustari, S. (2021). Evaluation of policy in the vocational education system revitalization in Indonesia: Examining the teaching factory readiness of industry. Jurnal Pendidikan Vokasi, 11(1), 68–77. https://doi.org/10.21831/jpv.v11i1.37693
Prianto, A., Winardi, W., & Qomariyah, U. N. (2021). The Effect of the Implementation of Teaching Factory and Its Learning Involvement toward Work Readiness of Vocational School Graduates. International Journal of Instruction, 14(1), 283–302. https://doi.org/10.29333/iji.2021.14117a
Putra, I. M. A., Widanta, I. M. R. J., Ardika, I. W. D., Hudiananingsih, P. D., Yuliantini, N. N., & Sitawati, A. A. R. (2021, April 26). Designing English for Vocational Purposes (EVP) in the Context of Merdeka Belajar of Kampus Merdeka. Proceedings of the International Conference on Applied Science and Technology on Social Science (ICAST-SS 2020). International Conference on Applied Science and Technology on Social Science. https://doi.org/10.2991/assehr.k.210424.051
Rafiq, K. R. M., Hashim, H., & Yunus, M. M. (2021). Sustaining Education with Mobile Learning for English for Specific Purposes (ESP): A Systematic Review (2012–2021). Sustainability, 13(17), 1–18. https://doi.org/10.3390/su13179768
Rahmanu, I. W. E. D., & Molnár, G. (2026). Virtual reality in English language education: A systematic review of opportunities and challenges in higher education. Acta Psychologica, 264, 106358. https://doi.org/10.1016/j.actpsy.2026.106358
Ramendra, D. P., Juniarta, P. A. K., Parma, I. P. G., Jayanta, I. N. L., Tantri, A. A. S., & Dewantara, K. A. K. (2025). Artificial Intelligence-Based Virtual Tour for Vocational High Schools in Tourism Sector in Developing English Language Competence for Guides. International Journal of Language Education, 9(1). https://doi.org/10.26858/ijole.v1i1.71704
Rattanavich, S. (2017). The Effects of an Experimental Training Program for Teachers of Vocational English Using Concentrated Language Encounter Instructional Processes and Reciprocal Peer Teaching Strategies. English Language Teaching, 10(12), p58. https://doi.org/10.5539/elt.v10n12p58
Rietmeijer, C. B. T., Watling, C. J., & Teunissen, P. W. (2025). Rethinking Workplace-Based Assessment: The Costly Illusion of Authenticity. Academic Medicine, 100(11), 1254–1257. https://doi.org/10.1097/ACM.0000000000006173
Saputro, D. A., & Savitri, W. E. (2025). Need Analysis on English for Specific Purposes of Visual Communication Design Student at Vocational High School. Journal of Linguistics, Literature, and Language Teaching (JLLLT), 4(2), 139–151. https://doi.org/10.37249/jlllt.v4i2.892
Sari, L. I., Sari, R. H., & Amrullah, Y. F. (2024). Empowering ESP Learners Through Business Meeting Simulations: Insights on Challenges and Opportunities. English Review: Journal of English Education, 12(2), 537–546. https://doi.org/10.25134/erjee.v12i2.9267
Seifried, J., Brandt, S., Kögler, K., & Rausch, A. (2020). The computer-based assessment of domain-specific problem-solving competence—A three-step scoring procedure. Cogent Education, 7(1), 1719571. https://doi.org/10.1080/2331186X.2020.1719571
Su, S.-M., Tsai, Y.-H., & Tai, H.-C. (2022). An ESP Approach to Teaching Nursing Note Writing to University Nursing Students. Education Sciences, 12(3), 223. https://doi.org/10.3390/educsci12030223
Suharno, Pambudi, N. A., & Harjanto, B. (2020). Vocational education in Indonesia: History, development, opportunities, and challenges. Children and Youth Services Review, 115, 105092. https://doi.org/10.1016/j.childyouth.2020.105092
Sumira, Febriansyah, G., Miladiyenti, F., Wahyuni, N., & Laily, H. I. (2025). Simulation-Based Project Learning in ESP: The Effectiveness of Crewpers for Vocational Journalism Education. Voices of English Language Education Society, 9(2), 400–412. https://doi.org/10.29408/veles.v9i2.30694
Tricco, A. C., Lilie, E., Zarin, W., O’Brien, K., Colquhoun, H., Levac, D., Moher, D., Peters, M., Horsley, T., Weeks, L., Hempel, S., Akl, E. A., Chang, C., McGowan, J., Stewart, L., Hartling, L., Aldcroft, A., Wilson, M., Garritty, C., … Straus, S. (2018). PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Annals of Internal Medicine, 169(7), 467–473. https://doi.org/10.7326/M18-0850
Tyas, A. S. P., Muam, A., Sari, Y. I. H., & Dewantara, C. (2020). The Effectiveness of Blended Learning in Improving Students’ Workplace Communication Skills: A Case Study on Olive Website Test Result. Lingua Cultura, 14(1), 1–13. https://doi.org/10.21512/lc.v14i1.6130
Xenia, T., & Indriyani, C. E. (2025). Hoteliers’ Needs Analysis in a Five-Star Hotel: ESP Course Design Considerations. Journal of English Language and Education, 10(6), 212–222. https://doi.org/10.31004/jele.v10i6.1563
Zinchenko, O., Ogrenich, M., Shepel, M., & Yakovlieva, M. (2020). Future Economists’ Cultural Competence and Business English Speech Etiquette Formation. Romanian Journal for Multidimensional Education/Revista Românească Pentru Educaţie Multidimensională, 12(2), 290. https://doi.org/10.18662/rrem/12.2/279
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2026 Rindilla Antika, Doris Sukma
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution - Share Alike 4.0 Internasional License (CC-BY-SA) that allows others to share the work with an acknowledgment of the works' authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journals published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Upon receiving the proofs, the Author/Editor agrees to promptly check the proofs carefully, correct any errors, and authorize the publication of the corrected proofs.
- Authors should submit the signed copyright transfer agreement form (CTA Form) along with the checked (and corrected proofs).
