[Home ] [Archive]   [ فارسی ]  
:: Main :: About :: Current Issue :: Archive :: Search :: Submit :: Contact ::
Main Menu
Home::
Journal Information::
Articles archive::
For Authors::
For Reviewers::
Registration::
Contact us::
Site Facilities::
::
Search in website

Advanced Search
..
Receive site information
Enter your Email in the following box to receive the site news and information.
..
:: Volume 16, Issue 1 (3-2013) ::
IJAL 2013, 16(1): 145-175 Back to browse issues page
Rater Bias in Assessing Iranian EFL Learners’ Writing Performance
Mahnaz Saeidi , Mandana Yousefi , Purya Baghayei
Abstract:   (8907 Views)
Evidence suggests that variability in the ratings of students’ essays results not only from their differences in their writing ability, but also from certain extraneous sources. In other words, the outcome of the rating of essays can be biased by factors which relate to the rater, task, and situation, or an interaction of all or any of these factors which make the inferences and decisions made about students’ writing ability undependable. The purpose of this study, therefore, was to examine the issue of variability in rater judgments as a source of measurement error this was done in relation to EFL learners’ essay writing assessment. Thirty two Iranian sophomore students majoring in English language participated in this study. The learners’ narrative essays were rated by six different raters and the results were analyzed using many-facet Rasch measurement as implemented in the computer program FACETS. The findings suggest that there are significant differences among raters concerning their harshness as well as several cases of bias due to the rater-examinee interaction. This study provides a valuable understanding of how effective and reliable rating can be realized, and how the fairness and accuracy of subjective performance can be assessed. 
Keywords: Rater bias, Writing ability, Many-Facet Rasch Measurement, Inter-rater reliability
Full-Text [PDF 260 kb]   (3178 Downloads)    
Type of Study: Research |
Published: 2013/03/15
Add your comments about this article
Your username or Email:

CAPTCHA


XML   Persian Abstract   Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Saeidi M, Yousefi M, Baghayei P. Rater Bias in Assessing Iranian EFL Learners’ Writing Performance. IJAL 2013; 16 (1) :145-175
URL: http://ijal.khu.ac.ir/article-1-1592-en.html


Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Volume 16, Issue 1 (3-2013) Back to browse issues page
Iranian Journal of Applied Linguistics
Persian site map - English site map - Created in 0.09 seconds with 36 queries by YEKTAWEB 4666