Research Topic and Resources
Student writing often demonstrates student understanding. Essay questions and construction-response questions help students demonstrate knowledge much more than multiple choice questions. One disadvantage to student-produced writing is that this writing must be tediously graded and may be subject to human preference or even error. Automated Essay Scoring (AES) has been developed to remedy these problems. AES programs use Natural Language Processing, model comparisons and feature sets to give essays a score and essay writers feedback. Writers get nearly instant feedback on the writings that they submit. My research paper will focus on two main areas. First, how effective is the scoring produced by AES programs? How do the scores given by these programs compare to scores given by human graders? Second, what is the impact on learning and teaching? Are students more motivated to write and revise when they use AES programs? Do AES systems help teachers? Will teachers change curriculum based on these programs?
Resources:
Attali, Y. & Burstein, J. (2006). Automated Essay Scoring With e-rater® V.2. Journal of Technology, Learning, and Assessment, 4(3). Retrieved October 29, 2009 from http://www.jtla.org
Cheville, J. (2004). Automated scoring technologies and the rising influence of error. English Journal, 93 (4), 47-52. Retrieved October 29, 2009 from http://www.jstor.org/pss/4128980
Dikli, S. (2006). An overview of automated scoring of essays. Journal of Technology, Learning and Assessment, 5(1). Retrieved October 29, 2009 from http://www.jtla.org
Riedel E., Dexter S. L., Scharber C., Doering A. (2006) Experimental evidence on the effectiveness of automated essay scoring in teacher education cases. Journal of Educational Computing Research, 35, 267-287. Retrieved October 29, 2009 http://etips.info/papers/2experiemental.pdf
Ruder, L.M., Garcia, V., & Welch, C. (2006). An evaluation of the IntelliMetric essay scoring system. Journal of Technology, Learning and Assessment, 4(4). Retrieved October 29, 2009 from http://www.jtla.org
Wang, J., & Brown, M. (2007). Automated essay scoring versus human scoring: A comparative study. Journal of Technology, Learning, and Assessment, 6(2). Retrieved October 29, 2009 from http://www.jtla.org
Groups:
Submitted by Amy Hall on Thu, 10/29/2009 - 12:54pm
Printer-friendly version
Disclaimer
Any opinions expressed here, except as specifically noted, are those of the individual authors or commenters and do not necessarily represent the views or policies of the Department of Instructional Technology and Learning Sciences, the Emma Eccles Jones College of Education and Human Services, or Utah State University.
awesome
Great job, look forward to reading more about this.
Let me know if I can be of any help, or Anne Diekema might know some about this area, too.
This is interesting. I am
This is interesting. I am looking forward to reading your paper and what you find about the effectiveness of using AES.
This is interesting. I am
This is interesting. I am looking forward to reading your paper and what you find about the effectiveness of using AES.