Artificial Intelligence Models and Test Performance

(Case Study in Accounting Program)

Authors

  • Gantsetseg Sanjmyatav Department of Foreign Languages, Mandakh University, Ulaanbaatar, Mongolia
  • Namuun Tsendbayar Department of Foreign Languages, Mandakh University, Ulaanbaatar, Mongolia
  • Enkhsuren Munkhjargal Accounting and Analysis Department, Mandakh University, Ulaanbaatar, Mongolia
  • Enkh-Amgalan Erdenesuren Accounting and Analysis Department, Mandakh University, Ulaanbaatar, Mongolia
  • Zolboo Gantulga Accounting and Analysis Department, Mandakh University, Ulaanbaatar, Mongolia

DOI:

https://doi.org/10.69588/mjer.v29i18.4262

Keywords:

Accounting program, final examination test, students’ performance, Chat Generative Pre-trained Transformer, Copilot, Deepseek

Abstract

Integrating artificial intelligence (AI) in education has required considering the conservative approaches of teaching and assessment systems, as AI impacts how educators operate, how students learn, and how learning outcomes are evaluated. The primary goal of this research paper is to compare AI tools’ performance with students’ performance through experiments on the final examination tests in the accounting program. In the conducted experiment, ChatGBT achieved a performance rate of 77 percent in a series of tests that encompassed the final examination, which included 11 courses and a total of 100 questions. The performance of the top-scoring students exceeded the results of the Copilot and Deepseek models; however, it did not surpass that of ChatGBT. The study findings have shown that ChatGPT performed less effectively on multiple-choice questions that require extensive calculations and accounting estimations; however, it was good at simpler multiple-choice and matching tasks. Thus, it was concluded that permitting students to undertake online examinations in unsupervised settings or utilize AI tools without limitations can enhance student performance in unreal ways while simultaneously minimizing reliability in assessment outcomes.

Downloads

Download data is not yet available.
Abstract
240
PDF
123

References

Abeysekera, I. (2023). ChatGPT and academia on accounting assessments. Technology, Market, and Complexity, www.sciencedirect.com/journal/journal-of-open-innovation-technology- market-and-complexity. https://doi.org/10.1016/j.joitmc.2024.100213

Atanasko Atanasovski, T. T. (2023). EVALUATING THE PERFORMANCE OF CHATGPT IN ACCOUNTING AND. Economic and Business Trends Shaping the Future. Research Gate. https://doi.org/10.47063/EBTSF.2023.0003

Atanasovski, A. (2023). Evaluating the Performance of ChatGPT in Accounting and Auditing Exams: An Experimental Study in North Macedonia. Proceedings of the 4th International Conference Economic and Business Trends Shaping the Future. https://doi.org/10.47063/EBTSF.2023.0003

ChatGPT and academia on accounting assessments. (огноо байхгүй).

Clare Baek, T. T. (2023). ChatGPT seems too good to be true": College students' use and perceptions of generative AI. Artificial Intelligence , www.sciencedirect.com/journal/computers-and-education-artificial-intelligence. https://doi.org/10.31219/osf.io/6tjpk

Jonathan H. Choi, 1. K. (2022). CHATGPT GOES TO LAW SCHOOL . Journal of Legal Education, 387-400.

Marc Eulerich, A. S. (2024). Is it all hype? ChatGPT's performance and disruptive. Review of Accounting Studies. https://doi.org/10.1007/s11142-024-09833-9

Sarangoo.I. (2024 оны 10 27). https://eagle.mn/: https://eagle.mn/r/131945-ээс Гаргасан

Stokel-Walker, C. (2024 оны 6 24). newscientist.com: https://www.newscientist.com/article/2436888-university-examiners-fail-to-spot-chatgpt-answers-in-real-world-test/?utm_source=chatgpt.com-ээс Гаргасан

Stokel-Walker, C. (2024 оны 12 13). (https://www.newscientist.com/. Over 70 per cent of students in US survey use AI for school work. https://doi.org/10.1016/S0262-4079(24)01217-X

Susnjak, T. (2022). ChatGPT: The End of Online Exam Integrity? https://doi.org/10.48550/arXiv.2212.09292 . ChatGPT: The End of Online Exam Integrity?-ээс Гаргасан

Terwiesch, C. (2023). Would Chat GPT3 Get a Wharton MBA? A Prediction Based on Its Performance in the Operations Management Course . Mack Institute for Innovation Management at the Wharton School, University of Pennsylvania.

Wood, D. A. (2023). The ChatGPT artificial intelligence chatbot: how well does it answer accounting assessment questions? Issues Account. Educ. 38 (3), 1-28. .., Educ. 38 (3), 1-28. https://doi.org/10.2308/ISSUES-2023-013

Downloads

Published

2025-06-30

How to Cite

Sanjmyatav, G., Tsendbayar, N., Munkhjargal, E., Erdenesuren, E.-A., & Gantulga, Z. (2025). Artificial Intelligence Models and Test Performance: (Case Study in Accounting Program). Mongolian Journal of Economic Review, 29(18), 24–29. https://doi.org/10.69588/mjer.v29i18.4262

Issue

Section

Articles