PEDAGOGICAL FOUNDATIONS FOR ASSESSING WRITTEN WORK USING ARTIFICIAL INTELLIGENCE

Authors

  • Nigora Kenesbaevna Dauletiyarova

    Nukus State Pedagogical Institute named after Ajiniyaz image/svg+xml

Keywords: artificial intelligence, writing assessment, automated essay scoring, large language models, psychometric validity, assessment fairness, academic writing, critical thinking, feedback, higher education

Abstract

This article examines the pedagogical and psychometric foundations of assessing writing tasks using artificial intelligence. It explores the benefits and limitations of AI-based assessment systems, focusing on reliability, validity, fairness, and academic integrity. The study emphasizes the importance of combining AI capabilities with human expertise to promote critical thinking, student agency, and effective academic writing.

References

1. Barrett and A., Pack A. “Not quite eye to A.I.: student and teacher perspectives on the use of generative artificial intelligence in the writing process,” International Journal of Educational Technology in Higher Education , vol. 20, no. 1, Nov. 2023, doi: 10.1186/s41239-023-00427-0.

2. Kumar V. and Boulanger D. “Explainable Automated Essay Scoring: Deep Learning Really Has Pedagogical Value,” Frontiers in Education , vol. 5, Oct. 2020, doi: 10.3389/feduc.2020.572367.

3. Wang Y., Huang J., Du L., Guo Y., Liu X., and Wang R. “Evaluating large language models as raters in large-scale writing assessments: A psychometric framework for reliability and validity,” Computers and Education Artificial Intelligence, vol. 9, pp. 100481–100481, Sep. 2025, doi: 10.1016/j.caeai.2025.100481.

4. Yavuz F., Çelik Ö., and Çelik G. “Utilizing large language models for EFL essay grading: An examination of reliability and validity in rubric‐based assessments,” British Journal of Educational Technology , vol. 56, no. 1, -P. 150- 166, Jun. 2024, doi: 10.1111/bjet.13494.

5. H.-N.Wu, M.Chu, and J.-L. Hsu, “Comparing GPT and human raters in essay assessment: Variability, bias, and the potential of LLM-based scoring,” Computers and Education Open , vol. 10, -P. 100341-100341, Feb. 2026, doi: 10.1016/j.caeo.2026.100341.

6. Zhang X. “Fairness and Effectiveness in AI-Driven Educational Assessments: Challenges and Mitigation Strategies,” Journal of innovation and development , vol. 11, no. 1, P. 7-10, Apr. 2025, doi: 10.54097/adcxze34.

7. Pachipulusu S.C. “A Psychometric Evaluation of LLM-Scored Communication Skills: Construct Validity and Bias Analysis,” OSF Preprints (OSF Preprints) . Center for Open Science, Feb. 27, 2026. Accessed: Mar. 2026. [Online]. Available: https://osf.io/5gzcv

8. Miguel D.C. and Bagli E. “From Prediction to Precision: Leveraging LLMs for Equitable and Data-Driven Writing Placement in Developmental Education,” Jan. 01, 2025. doi: 10.4230/oasics.slate.2025.1.

9. Jovic M. Papakonstantinidis S. and Kirkpatrick R. “From red ink to algorithms: investigating the use of large language models in academic writing feedback,” Language Testing in Asia , vol. 15, no. 1, Oct. 2025, doi:

10. 1186/s40468-025-00389-2. 10. Helm G., Hesse F. “Stop perfecting the feedback, start supporting the uptake: rethinking AI in writing instruction,” Frontiers in Education , vol. 11, Jan. 2026, doi: 10.3389/feduc.2026.1737037.

11. Escalante J., Pack A., and Barrett A. “AI-generated feedback on writing: insights into efficacy and ENL student preference,” International Journal of Educational Technology in Higher Education , vol. 20, no. 1, Oct. 2023, doi: 10.1186/s41239-023-00425-2.

12. Yang K. et al. , “Ink and algorithm: Exploring temporal dynamics in generative AI ‐assisted writing,” British Journal of Educational Technology , vol. 57, no. 2, pp. 508–534, Nov. 2025, doi: 10.1111/bjet.70031.

13. Wang C. “Exploring Students’ Generative AI-Assisted Writing Processes: Perceptions and Experiences from Native and Nonnative English Speakers,” Technology Knowledge and Learning , vol. 30, no. 3, pp. 1825–1846, May 2024, doi: 10.1007/s10758-024-09744-3.

14. Xia Q., Weng X., Ouyang F., Lin T., and T. K. F. Chiu, “A scoping review on how generative artificial intelligence transforms assessment in higher education,” International Journal of Educational Technology in Higher Education, vol. 21, no. 1, May 2024, doi: 10.1186/s41239-024-00468-z.

15. LEE A. “From Traces to Teaching: A Socio-Technical Framework for Process-Based Assessment in an Age of Distributed Cognition,” Artificial Intelligence Education Studies , vol. 1, no. 3, -P. 43-55, Sep. 2025, doi: 10.6914/aiese.010304.

16. Knoth N., Tolzin A., Janson A., and Leimeister J.M. “AI literacy and its implications for prompt engineering strategies,” Computers and Education Artificial Intelligence , vol. 6, -P. 100225–100225, Apr. 2024, doi: 10.1016/j.caeai.2024.100225.