
Intelligent tutoring systems (ITSs) offer potential support for teaching and learning, but studies have reported mixed effectiveness. This review examines their operation in real, natural educational settings and the challenges of applying and evaluating them.
Method
Using a systematic literature review, the authors analyzed 40 eligible studies from 2011–2022 that used social-experiment methods to assess ITS effectiveness in authentic educational contexts.
Main findings
The review found a complex effectiveness landscape. Main findings included:
- Social-experiment research was unevenly distributed across countries and regions.
- Non-cognitive, process-oriented and social outcomes received less attention than learning performance.
- Some included studies showed limited scientific rigor in experimental design and data analysis.
Interpreting the evidence
The findings call for broader evaluation outcomes and stronger experimental design and data analysis. Contextual differences and evidence limitations matter when interpreting these mixed results; a single effect should not be generalized to all tutoring systems.
Related reading
Related reading: the review of technology-supported student-centred learning considers technology, learning principles and implementation conditions from another perspective.
Publication and source
The article appeared online on 7 January 2023 and was published in Education and Information Technologies, volume 28, pages 9113–9148 (2023). The site’s original research introduction dated 8 January 2023 is retained as a historical report.
Reference: Huanhuan Wang; Ahmed Tlili; Ronghuai Huang; Zhenyu Cai; Min Li; Zui Cheng; Dong Yang; Mengti Li; Xixian Zhu; Cheng Fei. Examining the applications of intelligent tutoring systems in real educational contexts: A systematic literature review from the social experiment perspective. Education and Information Technologies 28, 9113–9148 (2023). DOI: 10.1007/s10639-022-11555-x
Original link: https://aiedchair.bnu.edu.cn/examining-the-applications-of-intelligent-tutoring-systems-in-real-educational-contexts-asystematic-literature-review-from-the-social-experiment-perspective/


