Machine Learning for Holistic Evaluation of Scientific Essays

Simon Hughes, Peter Hastings, M. Anne Britt, Patricia Wallace, and Dylan Blaum. Machine Learning for Holistic Evaluation of Scientific Essays. In Proceedings of Artificial Intelligence in Education 2015, Springer, Berlin, 2015.

Download

[263.3kB pdf] 

Abstract

In the US in particular, there is an increasing emphasis on the importance of science in education. To better understand a scientific topic, students need to compile information from multiple sources and determine the principal causal factors involved. We describe an approach for automatically inferring the quality and completeness of causal reasoning in essays on two separate scientific topics using a novel, two-phase machine learning approach for detecting causal relations. For each core essay concept, we initially trained a window-based tagging model to predict which individual words belonged to that concept. Using the predictions from this first set of models, we then trained a second stacked model on all the predicted word tags present in a sentence to predict inferences between essay concepts. The results indicate we could use such a system to provide explicit feedback to students to improve reasoning and essay writing skills.

BibTeX

@InProceedings{Hughes:aied2015,
  author = name:spapd,
  title = {Machine Learning for Holistic Evaluation of Scientific Essays},
  booktitle = {{Proceedings of Artificial Intelligence in Education 2015}},
  year = 2015,
  address = 	 {Berlin},
  publisher = {Springer},
  cvnote = {Acceptance rate: 28\%. CORE Conference Rank: A.},
  abstract = {In the US in particular, there is an increasing emphasis on the importance of science in education. To better understand a scientific topic, students need to compile information from multiple sources and determine the principal causal factors involved. We describe an approach for automatically inferring the quality and completeness of causal reasoning in essays on two separate scientific topics using a novel, two-phase machine learning approach for detecting causal relations. For each core essay concept, we initially trained a window-based tagging model to predict which individual words belonged to that concept. Using the predictions from this first set of models, we then trained a second stacked model on all the predicted word tags present in a sentence to predict inferences between essay concepts. The results indicate we could use such a system to provide explicit feedback to students to improve reasoning and essay writing skills.}
}