Few-Shot Question Generation for Personalized Feedback in Intelligent Tutoring Systems

Devang Kulshreshtha, Muhammad Shayan, Robert Belfer, Siva Reddy, Iulian Vlad Serban, Ekaterina Kochmar

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

3 Citations (SciVal)

Abstract

Existing work on generating hints in Intelligent Tutoring Systems (ITS) focuses mostly on manual and non-personalized feedback. In this work, we explore automatically generated questions as personalized feedback in an ITS. Our personalized feedback can pinpoint correct and incorrect or missing phrases in student answers as well as guide them towards correct answer by asking a question in natural language. Our approach combines cause-effect analysis to break down student answers using text similarity-based NLP Transformer models to identify correct and incorrect or missing parts. We train a few-shot Neural Question Generation and Question Re-ranking models to show questions addressing components missing in the student's answers which steers students towards the correct answer. Our model vastly outperforms both simple and strong baselines in terms of student learning gains by 45% and 35% respectively when tested in a real dialogue-based ITS. Finally, we show that our personalized corrective feedback system has the potential to improve Generative Question Answering systems.

Original languageEnglish
Title of host publicationPAIS 2022 - 11th Conference on Prestigious Applications of Artificial Intelligence, co-located with IJCAI-ECAI 2022
EditorsAndrea Passerini, Thomas Schiex
PublisherIOS Press BV
Pages17-30
Number of pages14
ISBN (Electronic)9781643682945
DOIs
Publication statusPublished - 15 Jul 2022
Event11th Conference on Prestigious Applications of Artificial Intelligence, PAIS 2022, co-located with the 31st International Joint Conference on Artificial Intelligence and the 25th European Conference on Artificial Intelligence, IJCAI-ECAI 2022 - Vienna, Austria
Duration: 25 Jul 2022 → …

Publication series

NameFrontiers in Artificial Intelligence and Applications
Volume351
ISSN (Print)0922-6389

Conference

Conference11th Conference on Prestigious Applications of Artificial Intelligence, PAIS 2022, co-located with the 31st International Joint Conference on Artificial Intelligence and the 25th European Conference on Artificial Intelligence, IJCAI-ECAI 2022
Country/TerritoryAustria
CityVienna
Period25/07/22 → …

Keywords

  • Deep learning
  • Intelligent tutoring systems
  • Natural language processing
  • Personalized learning and feedback
  • Question Generation

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Few-Shot Question Generation for Personalized Feedback in Intelligent Tutoring Systems'. Together they form a unique fingerprint.

Cite this