Generative AI-Enabled Formative Assessment in a Higher Vocational Surveying Programming Course: Design and Initial Practice

Authors

  • Shuolin Meng Department of Geomatics Engineering, Shijiazhuang Institute of Railway Technology, Shijiazhuang 050041, China

DOI:

https://doi.org/10.6918/IJOSSER.202608_9(8).0003

Keywords:

Generative artificial intelligence; formative assessment; surveying programming; higher vocational education; code feedback; learning analytics.

Abstract

Programming courses in higher vocational geomatics education ask students to combine Python syntax with surveying computation fundamentals, data-processing workflows, and engineering-quality standards. In many cases, assessment of traditional assignments is both delayed and oriented toward final results, which makes it hard to pinpoint issues such as algorithmic mistakes, code-quality shortcomings, and each learner’s specific needs. This study proposes a generative AI–enabled formative assessment model for the Surveying Programming (Python) course. Using a platform that was developed in-house, the model integrates rule-based checks, test cases, domain-specific rubrics, large-language-model analysis, and teacher review to create a closed loop that supports task design, code submission, intelligent evaluation, personalized feedback, revision, learning analytics, and ongoing instructional improvement. The model was first piloted in the spring 2026 term in Engineering Surveying Class 2401 (n = 42). Data aggregated from five assignments were analyzed descriptively. The platform dashboard showed a 95% assignment completion rate, an overall average score of 84.6, and four students who required additional attention. Mean assignment scores rose from 78.1 on the first task to 88.9 on the fifth task. The most frequently recorded problems were file-reading exceptions (28%), non-standard variable naming (22%), and loop-boundary errors (18%). Overall, these results offer early evidence that the model is feasible for providing timely, domain-informed feedback and for turning programming-process data into actionable teaching information at the class level. Because this study involves only one class and relies on descriptive platform data without a control group, the findings should be viewed as implementation evidence rather than proof, in a causal sense, of improved learning effectiveness.

Downloads

Download data is not yet available.

References

[1] Ministry of Education of the People's Republic of China, National Development and Reform Commission, Ministry of Industry and Information Technology, Ministry of Science and Technology, & National Data Administration. (2026). Artificial intelligence + education action plan (2026). [In Chinese]

[2] CPC Central Committee & State Council. (2025). Education powerhouse development plan (2024 2035). [In Chinese]

[3] UNESCO. (2023). Guidance for generative AI in education and research. UNESCO.

[4] Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7 74. https://doi.org/10.1080/0969595980050102

[5] Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81 112. https://doi.org/10.3102/003465430298487

[6] Nicol, D. J., & Macfarlane Dick, D. (2006). Formative assessment and self regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199 218. https://doi.org/10.1080/03075070600572090

[7] Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153 189. https://doi.org/10.3102/0034654307313795

[8] Keuning, H., Jeuring, J., & Heeren, B. (2018). A systematic literature review of automated feedback generation for programming exercises. ACM Transactions on Computing Education, 19(1), Article 3. https://doi.org/10.1145/3231711

[9] Messer, M., Brown, N. C. C., Kölling, M., & Shi, M. (2024). Automated grading and feedback tools for programming education: A systematic review. ACM Transactions on Computing Education, 24(1). https://doi.org/10.1145/3636515

[10] Nguyen, H., & Allan, V. (2024). Using GPT 4 to provide tiered, formative code feedback. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education (Vol. 1, pp. 958 964). https://doi.org/10.1145/3626252.3630960

[11] Kasneci, E., Sessler, K., Küchemann, S., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

[12] Tlili, A., Shehata, B., Adarkwah, M. A., et al. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, Article 15. https://doi.org/10.1186/s40561 023 00237 x

[13] Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410

[14] Zawacki Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education where are the educators? International Journal of Educational Technology in Higher Education, 16, Article 39. https://doi.org/10.1186/s41239 019 0171 0

[15] Li, X. Z., Zhang, Y. X., Xie, J. J., Zhang, R., Liu, M. M., & Zhao, J. (2026). Teaching practice of explainable feedback in programming empowered by large language models. International Journal of Social Science and Education Research, 9(7), 60 67.

[16] Yang, J., Zhang, Y. X., Xie, J. J., Chen, Y. Q., & Fu, C. T. (2026). Research on an AI empowered three stage closed loop teaching model for chemical engineering practical training. International Journal of Social Science and Education Research, 9(7), 68 75.

[17] Li, Y. X. (2026). Research and practice on the teaching reform of programming courses enabled by AI: A case study of "Python fundamentals and applications". International Journal of Social Science and Education Research, 9(7), 108 115.

Downloads

Published

2026-08-12

Issue

Section

Articles

How to Cite

Meng, S. (2026). Generative AI-Enabled Formative Assessment in a Higher Vocational Surveying Programming Course: Design and Initial Practice. International Journal of Social Science and Education Research, 9(8), 14-26. https://doi.org/10.6918/IJOSSER.202608_9(8).0003