Automated Essay Scoring Versus Human Scoring: A Correlational Study
 New Search |  Print Abstract |  E-mail Abstract |  Full Text |  Save to My Collections |  Export Citation |
HTML version at citejournal.org
Wang, J. & Stallone Brown, M. (2008). Automated Essay Scoring Versus Human Scoring: A Correlational Study. Contemporary Issues in Technology and Teacher Education, 8(4), 310-325. AACE.
Retrieved from http://www.editlib.org/p/25295.
Journal Information
Contemporary Issues in Technology and Teacher Education
ISSN 1528-5804
Volume 8, Issue 4, December 2008
Association for the Advancement of Computing in Education (AACE)
More Information on CITE Journal
Authors
Abstract
The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance. Spearman rank correlation coefficient tests were utilized for data analyses. Results from the data analyses showed no statistically significant correlation between the overall holistic scores assigned by the AES tool and the overall holistic scores assigned by faculty human raters or human raters who scored another standardized writing test. On the other hand, there was a significant correlation between scores assigned by two teams of human raters. A significant correlation was also present between AES and faculty human scoring in Dimension 4 - Sentence Structure, but no significant correlations existed in other dimensions. Findings from the current study do not corroborate previous findings on AES tools. Implications of these findings for English educators reveal that AES tools have limited capability at this point and that more reliable measures for assessment, like writing portfolios and conferencing, still need to be a part of the methods repertoire.
Keywords
Also Read
- July 2009 - Social Media: Trends and Implications for Learning
- Is E-Learning True to the Principles of Technology?
- Preparing Teachers to Teach Mathematics with Technology: Key Issues, Concerns and Research Questions
- The intractability of information: non-governmental development organizations and the uses of knowledge
- The Connected Learning Space
- Learning in a Networked World: Trends and Opportunities in the Future of Technology for Learning Environments and Education
- Research Highlights in Technology and Teacher Education 2009
- Knowledge Management in Universities
- Leading and teaching in schools of the future: Using interactive video connectivity and networking in educator preparation programs
- Are Pretty Interfaces Worth the Time? The Effects of User Interface Types on Web-Based Instruction
Tags
Add tagComments & Discussion
Comment on the paper above. You must be registered to participate. Registration is free.
New comment