A Comparative Analysis of Google Translate and ChatGPT Results Based on Translation Quality Assessment (TQA)
DOI:
https://doi.org/10.55299/ijere.v4i1.1175Keywords:
translation, quality, assessment, google translate, chatgpt, artificial intelligenceAbstract
The development of digital technology today has a major impact on various aspects of human life. In bridging intercultural communication, translation has a significant role that cannot be separated from the help of technology. Technology also has brought changes in the way translation is done, including helping individual translators to increase efficiency. For example, with the help of machine translation, Google Translate continues to develop transformers and AI. On the other hand, ChatGPT, built on artificial intelligence, allows translation. Both adopt NLP. This study aims to determine the quality of the translation of both based on the TQA proposed by House. In addition, it assesses the level of similarity of the translation results and errors that occur based on the translation technique used. Translation samples were selected based on purposive sampling techniques, namely from a report chapter available on the internet in English. The samples were translated into Indonesian using Google Translate (GT) and ChatGPT (CG) and then analyzed using TQA. The results show that GT and CG have high similarities and insignificant error rates. This is possible because GT and CG continue to be developed over time to respond to and translate languages that are increasingly natural and resemble human language.
Downloads
References
Afifah, Y. M. S., Baharuddin, Putera, L. J., & Wardana, L. A. (2024). Comparative Study On Chatgpt vs Google Translate In Indonesian-English of Bilingual Description of Historical Heritage at Museum Negeri Nusa Tenggara Barat. Didaktik : Jurnal Ilmiah PGSD STKIP Subang, 10(1), 69–80. https://doi.org/10.36989/DIDAKTIK.V10I1.2560
Aiken, M. (2019). An Updated Evaluation of Google Translate Accuracy. StudiesinLinguisticsandLiterature, 3(3), 253–260.
Alzain, E., Nagi, K. A., & Algobaei, F. (2024). The Quality of Google Translate and ChatGPT English to Arabic Translation The Case of Scientific Text Translation. Forum for Linguistic Studies, 6(3), 837–849. https://doi.org/10.30564/FLS.V6I3.6799
Benmansour, M., & Hdouch, Y. (2023). The Role of The Latest Technologies in the Translation Industry. Emirati Journal of Education and Literature, 1(2), 31–36. https://doi.org/10.54878/VC4ZBY09
Bentivogli, L., Bisazza, A., Cettolo, M., & Federico, M. (2016). Neural versus Phrase-Based Machine Translation Quality: a Case Study. EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings, 257–267. https://doi.org/10.18653/V1/D16-1025
Chirag. (2024, July 31). How Transformer Outperforms RNNs in NLP and Why It Matters. Appinventiv. https://appinventiv.com/blog/transformer-vs-rnn/
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/J.IJINFOMGT.2023.102642
Faris, H., & Abdurrahman, M. (2023). Analisis Penerjemahan Bahasa Arab Ke Bahasa Indonesia Melalui Artificial Intelligence Chat GPT. Al-Af’idah Jurnal Pendidikan Dan Pengajaran Bahasa Arab, 7(2), 222–233. https://doi.org/10.52266/AL-AFIDAH.V7I2.1967
Filippi, E., Bannò, M., & Trento, S. (2023). Automation technologies and their impact on employment: A review, synthesis and future research agenda. Technological Forecasting and Social Change, 191, 122448. https://doi.org/10.1016/J.TECHFORE.2023.122448
Golovatska, I., & Tereshchuk, G. (2024). The Use of Digital Technologies to Prepare Future Translators for the Modern Requirements of the Linguistic Services Market. Journal of Educational Technology Development and Exchange (JETDE), 17(1), 175–187. https://doi.org/10.18785/jetde.1701.10
House, J. (2015). Translation quality assessment: Past and present (1st ed., Vol. 1). Routledge.
Loss, A. (2024, January 29). From Neural Networks to Transformers: The Evolution of Machine Learning. Dataversity. https://www.dataversity.net/from-neural-networks-to-transformers-the-evolution-of-machine-learning/
Mahsun. (2017). Metode Penelitian Bahasa: Tahapan, Strategi, Metode, dan Tekniknya (5th ed., Vol. 1). Rajawali Press.
Merritt, R. (2022, March 25). What Is a Transformer Model? NVIDIABlogs.
Moneus, A. M., & Sahari, Y. (2024). Artificial intelligence and human translation: A contrastive study based on legal texts. Heliyon, 10(6), e28106. https://doi.org/10.1016/J.HELIYON.2024.E28106
Olujimi, P. A., & Ade-Ibijola, A. (2023). NLP techniques for automating responses to customer queries: a systematic review. Discover Artificial Intelligence, 3(1), 1–19. https://doi.org/10.1007/S44163-023-00065-5/FIGURES/4
Putri, A. N., & Tatang, T. (2024). Perbandingan Antara Google Translate dan Artifical Intelligence dalam Menerjemahkan dari Bahasa Arab ke Bahasa Indonesia. Jurnal Pendidikan Tambusai, 8(2), 19690–19696. https://jptam.org/index.php/jptam/article/view/15300
Rahmiasri, M. (2017, April 2). Google Enables in-app Image Translation. TheJakartaPost.Com.
Rao, P., McGee, L. M., & Seideman, C. A. (2024). A Comparative assessment of ChatGPT vs. Google Translate for the translation of patient instructions. Journal of Medical Artificial Intelligence, 7(0). https://doi.org/10.21037/JMAI-24-24/COIF
Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121–154. https://doi.org/10.1016/J.IOTCPS.2023.04.003
Roumeliotis, K. I., & Tselikas, N. D. (2023). ChatGPT and Open-AI Models: A Preliminary Review. Future Internet 2023, Vol. 15, Page 192, 15(6), 192. https://doi.org/10.3390/FI15060192
Rusadi, A. M., & Setiajid, H. H. (2023). Evaluating the Accuracy of Google Translate and ChatGPT in Translating Windows 11 Education Installation GUITexts to Indonesian: An Application of Koponen’s Error Category. English Language and Literature International Conference, 698–713.
Schäferhoff, N. (2024, July 9). The History of Google Translate (2004-Today): A Detailed Analysis. Translatepress.Com.
Supriyono, Wibawa, A. P., Suyono, & Kurniawan, F. (2024). Advancements in Natural Language Processing: Implications, Challenges, and Future Directions. Telematics and Informatics Reports, 100173. https://doi.org/10.1016/J.TELER.2024.100173
Tan, Z., Wang, S., Yang, Z., Chen, G., Huang, X., Sun, M., & Liu, Y. (2020). Neural machine translation: A review of methods, resources, and tools. AI Open, 1, 5–21. https://doi.org/10.1016/J.AIOPEN.2020.11.001
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, Ł., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., … Dean, J. (2016). Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. https://arxiv.org/abs/1609.08144v2
Yuxiu, Y. (2024). Application of translation technology based on AI in translation teaching. Systems and Soft Computing, 6, 200072. https://doi.org/10.1016/J.SASC.2024.200072
Zohuri, B., Mossavar-Rahmani, F., & Behgounia, F. (2022). Artificial intelligence, machine learning, and deep learning driving big data. Knowledge Is Power in Four Dimensions: Models to Forecast Future Paradigm, 837–888. https://doi.org/10.1016/B978-0-323-95112-8.00027-1
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Roswani Siregar, Heni Subagiharti, Diah Syafitri Handayani, Dermawan Hutagaol, Ahmad Laut Hasibuan, Nuraida Nuraida, Ervina Sipahutar
This work is licensed under a Creative Commons Attribution 4.0 International License.
