Artificial Intelligence Models and Test Performance
(Case Study in Accounting Program)
DOI:
https://doi.org/10.69588/mjer.v29i18.4262Keywords:
Accounting program, final examination test, students’ performance, Chat Generative Pre-trained Transformer, Copilot, DeepseekAbstract
Integrating artificial intelligence (AI) in education has required considering the conservative approaches of teaching and assessment systems, as AI impacts how educators operate, how students learn, and how learning outcomes are evaluated. The primary goal of this research paper is to compare AI tools’ performance with students’ performance through experiments on the final examination tests in the accounting program. In the conducted experiment, ChatGBT achieved a performance rate of 77 percent in a series of tests that encompassed the final examination, which included 11 courses and a total of 100 questions. The performance of the top-scoring students exceeded the results of the Copilot and Deepseek models; however, it did not surpass that of ChatGBT. The study findings have shown that ChatGPT performed less effectively on multiple-choice questions that require extensive calculations and accounting estimations; however, it was good at simpler multiple-choice and matching tasks. Thus, it was concluded that permitting students to undertake online examinations in unsupervised settings or utilize AI tools without limitations can enhance student performance in unreal ways while simultaneously minimizing reliability in assessment outcomes.
Downloads
240
References
Abeysekera, I. (2023). ChatGPT and academia on accounting assessments. Technology, Market, and Complexity, www.sciencedirect.com/journal/journal-of-open-innovation-technology- market-and-complexity. https://doi.org/10.1016/j.joitmc.2024.100213
Atanasko Atanasovski, T. T. (2023). EVALUATING THE PERFORMANCE OF CHATGPT IN ACCOUNTING AND. Economic and Business Trends Shaping the Future. Research Gate. https://doi.org/10.47063/EBTSF.2023.0003
Atanasovski, A. (2023). Evaluating the Performance of ChatGPT in Accounting and Auditing Exams: An Experimental Study in North Macedonia. Proceedings of the 4th International Conference Economic and Business Trends Shaping the Future. https://doi.org/10.47063/EBTSF.2023.0003
ChatGPT and academia on accounting assessments. (огноо байхгүй).
Clare Baek, T. T. (2023). ChatGPT seems too good to be true": College students' use and perceptions of generative AI. Artificial Intelligence , www.sciencedirect.com/journal/computers-and-education-artificial-intelligence. https://doi.org/10.31219/osf.io/6tjpk
Jonathan H. Choi, 1. K. (2022). CHATGPT GOES TO LAW SCHOOL . Journal of Legal Education, 387-400.
Marc Eulerich, A. S. (2024). Is it all hype? ChatGPT's performance and disruptive. Review of Accounting Studies. https://doi.org/10.1007/s11142-024-09833-9
Sarangoo.I. (2024 оны 10 27). https://eagle.mn/: https://eagle.mn/r/131945-ээс Гаргасан
Stokel-Walker, C. (2024 оны 6 24). newscientist.com: https://www.newscientist.com/article/2436888-university-examiners-fail-to-spot-chatgpt-answers-in-real-world-test/?utm_source=chatgpt.com-ээс Гаргасан
Stokel-Walker, C. (2024 оны 12 13). (https://www.newscientist.com/. Over 70 per cent of students in US survey use AI for school work. https://doi.org/10.1016/S0262-4079(24)01217-X
Susnjak, T. (2022). ChatGPT: The End of Online Exam Integrity? https://doi.org/10.48550/arXiv.2212.09292 . ChatGPT: The End of Online Exam Integrity?-ээс Гаргасан
Terwiesch, C. (2023). Would Chat GPT3 Get a Wharton MBA? A Prediction Based on Its Performance in the Operations Management Course . Mack Institute for Innovation Management at the Wharton School, University of Pennsylvania.
Wood, D. A. (2023). The ChatGPT artificial intelligence chatbot: how well does it answer accounting assessment questions? Issues Account. Educ. 38 (3), 1-28. .., Educ. 38 (3), 1-28. https://doi.org/10.2308/ISSUES-2023-013
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Gantsetseg Sanjmyatav, Namuun Tsendbayar, Enkhsuren Munkhjargal, Enkh-Amgalan Erdenesuren

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright on any research article in the Mongolian Geoscientist is retained by the author(s).
The authors grant the Mongolian Journal of Economic Review a license to publish the article and identify itself as the original publisher.

Articles in the Mongolian Journal of Economic Review are Open Access articles published under a Creative Commons ATTRIBUTION-NONCOMMERCIAL-NODERIVS 4.0 INTERNATIONAL - CC BY-NC-ND 4.0.
This license permits use, distribution and reproduction in any medium, provided the original work is properly cited.