Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program

Authors

  • Dani Fitria Brilianti Politeknik Keselamatan Transportasi Jalan, Indonesia
  • Nurul Fitriani Politeknik Keselamatan Transportasi Jalan, Indonesia
  • Aat Eska Fahmadi Politeknik Keselamatan Transportasi Jalan, Indonesia
  • Abdul Rokhim Politeknik Transportasi Darat, Indonesia

DOI:

https://doi.org/10.33603/perspective.v14i2.13015

Keywords:

Usability, e-book, English for Engineering, System Usability Scale, road transportation system engineering

Abstract

English for Engineering (EFE) materials must be both contextually relevant and easy to use. This study evaluated cadets’ perceptions of the usability of an EFE e-book (version 1.0) that had been developed from a needs analysis, after it was used in eight learning sessions in the Road Transportation System Engineering (RSTJ) study program of Politeknik Keselamatan Transportasi Jalan, Tegal, Indonesia. A quantitative descriptive design was applied. Data were collected from 105 third-semester cadets (88.2% of the population of 119) using the ten-item System Usability Scale (SUS) and a short questionnaire on respondent characteristics. The data were analyzed with descriptive statistics, a one-sample t-test against the benchmark of 68, item-level analysis, and the Learnable and Usable subscales of the SUS. The mean SUS score was 82.4 (SD = 6.9; 95% CI [81.1, 83.7]), which falls in the “Excellent” band of the working categories adopted in this study (80–100) and is above the benchmark of 68, t(104) = 21.26, p < .001, d = 2.08 (the large d partly reflects the narrow spread of scores). All 105 cadets scored 68 or higher: 73.3% scored in the Excellent band and 26.7% in the Good band. The strongest items concerned low complexity, ease of use, and the absence of cumbersome operation, whereas the weakest items concerned the need to learn many things before starting (Q10) and the need for technical support (Q4). Descriptively and tentatively, the Learnable subscale (75.1) was lower than the Usable subscale (84.2), although this two-factor split is of uncertain stability and the Learnable subscale has only two items. Internal consistency of the SUS in this restricted-range sample was low (α = 0.41) and all scores lay between 70.0 and 92.5. The survey was completed in class by cadets taught by the lecturers who developed the e-book, so social desirability may have inflated the ratings. In this cohort, as rated in a post-use survey, the e-book was perceived very favorably. The findings suggest that onboarding and embedded help are the relative priorities for version 2.0, a conclusion that rests on neutral rather than unfavorable answers and needs confirmation with qualitative evidence.

References

Alkadrie, S. A., Fauzan Albahy, A., Handayani, Y., & Zein, A. F. (2025). Evaluation of the Usability of Online Learning Platforms Using the System Usability Scale Method and Nielsen Usability Attributes. ITDM: Information Technology Development And Management, 1(1), 107–120. https://journal.uinjkt.ac.id/index.php/itdm/article/view/50374

Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6). https://doi.org/10.1080/10447310802205776

Brilianti, D. F., Fitriani, N., Fahmadi, A. E., Pradana, B., Rokhim, A., & Najwa, D. A. (2026). Integration of Needs Analysis in Developing E-Book Materials for English for Engineering in Road Transportation System Engineering Study Program. Allure Journal, 6(2). https://doi.org/10.26877/allure.v6i2.1000

Brooke, J. (1996). SUS -A quick and dirty usability scale Usability and context. Usability Evaluation in Industry, 189(194).

Buroidah, H., Zubaidah, S., & Mahanal, S. (2023). Effects of Project-Based Learning with Project Guide E-book on Critical Thinking and Metacognitive Skills: A Case from Undergraduate Biology Students in Genetic 1 Course. Prisma Sains : Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 11(2). https://doi.org/10.33394/j-ps.v11i2.6727

Changpueng, P., & Pattanapichet, F. (2023). A Needs Analysis of English for Meeting Lessons for Thai Undergraduate Engineering Students. LEARN Journal: Language Education and Acquisition Research Network, 16(2), 603–623. https://so04.tci-thaijo.org/index.php/LEARN/article/view/266974

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.

Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly: Management Information Systems, 13(3). https://doi.org/10.2307/249008

Dudley-Evans, T., & St John, M. J. (1998). Developments in English for specific purposes: A multi-disciplinary approach. Cambridge University Press.

Efendi, M. Y., Mayasari, E., Iswanto, J., & Apriyani, L. (2025). Needs Analysis of English for Specific Purpose at Engineering Students in Vocational High School. Issues in Applied Linguistics & Language Teaching, 7(1). https://doi.org/10.37253/iallteach.v7i1.9333

Hernon, P., Hopper, R., Leach, M. R., Saunders, L. L., & Zhang, J. (2007). E-book Use by Students: Undergraduates in Economics, Literature, and Nursing. Journal of Academic Librarianship, 33(1). https://doi.org/10.1016/j.acalib.2006.08.005

Hutchinson, T., & Waters, A. (1987). English for specific purposes: A learning-centred approach. Cambridge University Press.

ISO. (2018). Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts (ISO 9241-11:2018). International Organization for Standardization. https://www.iso.org/standard/63500.html

Lewis, J. R., & Sauro, J. (2009). The factor structure of the system usability scale. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5619 LNCS. https://doi.org/10.1007/978-3-642-02806-9_12

Lewis, J. R., & Sauro, J. (2017). Revisiting the factor structure of the System Usability Scale. Journal of Usability Studies, 12(4), 183–192. https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Lewis_August2017.pdf

Lim, E. L., & Hew, K. F. (2014). Students’ perceptions of the usefulness of an E-book with annotative and sharing capabilities as a tool for learning: a case study. Innovations in Education and Teaching International, 51(1). https://doi.org/10.1080/14703297.2013.771969

Marisda, D. H., Tolla, I., & Arsyad, M. (2025). Developing and Validating an Interactive Flipbook E-Book to Foster Critical Thinking in Modern Physics Education. TWIST, 20(1), 279–288. https://doi.org/10.5281/zenodo.10049652

Mohamad Saleh, N. N., & Mohammed, Y. (2024). Tourist Guides’ Needs for Arabic for Specific Purposes According to The Hutchinson-Waters Model. Al-Azkiyaa - International Journal of Language and Education, 3(1). https://doi.org/10.33102/alazkiyaa267

Nateghian, N. (2024). English language needs of Iranian students of civil engineering: Are the courses aligned with workplace needs? English for Specific Purposes, 76. https://doi.org/10.1016/j.esp.2024.08.002

Norman, D. A. (2013). The design of everyday things (Rev. and expanded ed.). Basic Books.

Nunnally, J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.

Ramadhani, R., Aulawi, H., Setiawan, R., & Rahayu, S. (2023). The Speaking English Material Needs of Engineering Students for the English Club Program: An ESP Analysis. Scope : Journal of English Language Teaching, 7(2). https://doi.org/10.30998/scope.v7i2.16310

Rubin, J., & Chisnell, D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests (2nd ed.). Wiley.

Sasabone, L., Irman, Taufiq, A., & Hasbi, N. A. (2024). Needs Analysis of English for Specific Purposes (ESP) in Students’ Speaking Materials. EDULEC: Education, Language, and Culture Journal, 4(1). https://doi.org/10.56314/edulec.v4i1.218

Sun, P. C., Tsai, R. J., Finger, G., Chen, Y. Y., & Yeh, D. (2008). What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers and Education, 50(4). https://doi.org/10.1016/j.compedu.2006.11.007

Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly: Management Information Systems, 27(3). https://doi.org/10.2307/30036540

Wahyuni, S., & Rosana, D. (2025). Using Interactive Science E-Books Using PBL Model on Critical Thinking Skills of Junior High School Students. JPI (Jurnal Pendidikan Indonesia), 14(1). https://doi.org/10.23887/jpiundiksha.v14i1.84159

Zaharias, P., & Poylymenakou, A. (2009). Developing a usability evaluation method for e-learning applications: Beyond functional usability. International Journal of Human-Computer Interaction, 25(1). https://doi.org/10.1080/10447310802546716

Downloads

Published

2026-11-14

How to Cite

Brilianti, D. F., Fitriani, N., Fahmadi, A. E., & Rokhim, A. (2026). Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program. Academic Journal Perspective: Education, Language, and Literature, 14(2). https://doi.org/10.33603/perspective.v14i2.13015

Issue

Section

Artikel

Citation Check

Similar Articles

<< < 2 3 4 5 6 7 8 9 10 11 > >> 

You may also start an advanced similarity search for this article.