Perception and Usability Evaluation of an English for Engineering E-Book in the Road Transportation System Engineering Study Program
DOI:
https://doi.org/10.33603/perspective.v14i2.13015Keywords:
Usability, e-book, English for Engineering, System Usability Scale, road transportation system engineeringAbstract
English for Engineering (EFE) materials must be both contextually relevant and easy to use. This study evaluated cadets’ perceptions of the usability of an EFE e-book (version 1.0) that had been developed from a needs analysis, after it was used in eight learning sessions in the Road Transportation System Engineering (RSTJ) study program of Politeknik Keselamatan Transportasi Jalan, Tegal, Indonesia. A quantitative descriptive design was applied. Data were collected from 105 third-semester cadets (88.2% of the population of 119) using the ten-item System Usability Scale (SUS) and a short questionnaire on respondent characteristics. The data were analyzed with descriptive statistics, a one-sample t-test against the benchmark of 68, item-level analysis, and the Learnable and Usable subscales of the SUS. The mean SUS score was 82.4 (SD = 6.9; 95% CI [81.1, 83.7]), which falls in the “Excellent” band of the working categories adopted in this study (80–100) and is above the benchmark of 68, t(104) = 21.26, p < .001, d = 2.08 (the large d partly reflects the narrow spread of scores). All 105 cadets scored 68 or higher: 73.3% scored in the Excellent band and 26.7% in the Good band. The strongest items concerned low complexity, ease of use, and the absence of cumbersome operation, whereas the weakest items concerned the need to learn many things before starting (Q10) and the need for technical support (Q4). Descriptively and tentatively, the Learnable subscale (75.1) was lower than the Usable subscale (84.2), although this two-factor split is of uncertain stability and the Learnable subscale has only two items. Internal consistency of the SUS in this restricted-range sample was low (α = 0.41) and all scores lay between 70.0 and 92.5. The survey was completed in class by cadets taught by the lecturers who developed the e-book, so social desirability may have inflated the ratings. In this cohort, as rated in a post-use survey, the e-book was perceived very favorably. The findings suggest that onboarding and embedded help are the relative priorities for version 2.0, a conclusion that rests on neutral rather than unfavorable answers and needs confirmation with qualitative evidence.
References
Alkadrie, S. A., Fauzan Albahy, A., Handayani, Y., & Zein, A. F. (2025). Evaluation of the Usability of Online Learning Platforms Using the System Usability Scale Method and Nielsen Usability Attributes. ITDM: Information Technology Development And Management, 1(1), 107–120. https://journal.uinjkt.ac.id/index.php/itdm/article/view/50374
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6). https://doi.org/10.1080/10447310802205776
Brilianti, D. F., Fitriani, N., Fahmadi, A. E., Pradana, B., Rokhim, A., & Najwa, D. A. (2026). Integration of Needs Analysis in Developing E-Book Materials for English for Engineering in Road Transportation System Engineering Study Program. Allure Journal, 6(2). https://doi.org/10.26877/allure.v6i2.1000
Brooke, J. (1996). SUS -A quick and dirty usability scale Usability and context. Usability Evaluation in Industry, 189(194).
Buroidah, H., Zubaidah, S., & Mahanal, S. (2023). Effects of Project-Based Learning with Project Guide E-book on Critical Thinking and Metacognitive Skills: A Case from Undergraduate Biology Students in Genetic 1 Course. Prisma Sains : Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 11(2). https://doi.org/10.33394/j-ps.v11i2.6727
Changpueng, P., & Pattanapichet, F. (2023). A Needs Analysis of English for Meeting Lessons for Thai Undergraduate Engineering Students. LEARN Journal: Language Education and Acquisition Research Network, 16(2), 603–623. https://so04.tci-thaijo.org/index.php/LEARN/article/view/266974
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly: Management Information Systems, 13(3). https://doi.org/10.2307/249008
Dudley-Evans, T., & St John, M. J. (1998). Developments in English for specific purposes: A multi-disciplinary approach. Cambridge University Press.
Efendi, M. Y., Mayasari, E., Iswanto, J., & Apriyani, L. (2025). Needs Analysis of English for Specific Purpose at Engineering Students in Vocational High School. Issues in Applied Linguistics & Language Teaching, 7(1). https://doi.org/10.37253/iallteach.v7i1.9333
Hernon, P., Hopper, R., Leach, M. R., Saunders, L. L., & Zhang, J. (2007). E-book Use by Students: Undergraduates in Economics, Literature, and Nursing. Journal of Academic Librarianship, 33(1). https://doi.org/10.1016/j.acalib.2006.08.005
Hutchinson, T., & Waters, A. (1987). English for specific purposes: A learning-centred approach. Cambridge University Press.
ISO. (2018). Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts (ISO 9241-11:2018). International Organization for Standardization. https://www.iso.org/standard/63500.html
Lewis, J. R., & Sauro, J. (2009). The factor structure of the system usability scale. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5619 LNCS. https://doi.org/10.1007/978-3-642-02806-9_12
Lewis, J. R., & Sauro, J. (2017). Revisiting the factor structure of the System Usability Scale. Journal of Usability Studies, 12(4), 183–192. https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Lewis_August2017.pdf
Lim, E. L., & Hew, K. F. (2014). Students’ perceptions of the usefulness of an E-book with annotative and sharing capabilities as a tool for learning: a case study. Innovations in Education and Teaching International, 51(1). https://doi.org/10.1080/14703297.2013.771969
Marisda, D. H., Tolla, I., & Arsyad, M. (2025). Developing and Validating an Interactive Flipbook E-Book to Foster Critical Thinking in Modern Physics Education. TWIST, 20(1), 279–288. https://doi.org/10.5281/zenodo.10049652
Mohamad Saleh, N. N., & Mohammed, Y. (2024). Tourist Guides’ Needs for Arabic for Specific Purposes According to The Hutchinson-Waters Model. Al-Azkiyaa - International Journal of Language and Education, 3(1). https://doi.org/10.33102/alazkiyaa267
Nateghian, N. (2024). English language needs of Iranian students of civil engineering: Are the courses aligned with workplace needs? English for Specific Purposes, 76. https://doi.org/10.1016/j.esp.2024.08.002
Norman, D. A. (2013). The design of everyday things (Rev. and expanded ed.). Basic Books.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.
Ramadhani, R., Aulawi, H., Setiawan, R., & Rahayu, S. (2023). The Speaking English Material Needs of Engineering Students for the English Club Program: An ESP Analysis. Scope : Journal of English Language Teaching, 7(2). https://doi.org/10.30998/scope.v7i2.16310
Rubin, J., & Chisnell, D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests (2nd ed.). Wiley.
Sasabone, L., Irman, Taufiq, A., & Hasbi, N. A. (2024). Needs Analysis of English for Specific Purposes (ESP) in Students’ Speaking Materials. EDULEC: Education, Language, and Culture Journal, 4(1). https://doi.org/10.56314/edulec.v4i1.218
Sun, P. C., Tsai, R. J., Finger, G., Chen, Y. Y., & Yeh, D. (2008). What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers and Education, 50(4). https://doi.org/10.1016/j.compedu.2006.11.007
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly: Management Information Systems, 27(3). https://doi.org/10.2307/30036540
Wahyuni, S., & Rosana, D. (2025). Using Interactive Science E-Books Using PBL Model on Critical Thinking Skills of Junior High School Students. JPI (Jurnal Pendidikan Indonesia), 14(1). https://doi.org/10.23887/jpiundiksha.v14i1.84159
Zaharias, P., & Poylymenakou, A. (2009). Developing a usability evaluation method for e-learning applications: Beyond functional usability. International Journal of Human-Computer Interaction, 25(1). https://doi.org/10.1080/10447310802546716
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2026 Dani Fitria Brilianti, Nurul Fitriani, Aat Eska Fahmadi, Abdul Rokhim

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution - Share Alike 4.0 Internasional License (CC-BY-SA) that allows others to share the work with an acknowledgment of the works' authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journals published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Upon receiving the proofs, the Author/Editor agrees to promptly check the proofs carefully, correct any errors, and authorize the publication of the corrected proofs.
- Authors should submit the signed copyright transfer agreement form (CTA Form) along with the checked (and corrected proofs).








