31 فروردین 1403
نسيم قنبري

نسیم قنبری

مرتبه علمی: استادیار
نشانی: دانشکده ادبیات و علوم انسانی - گروه زبان و ادبیات انگلیسی
تحصیلات: دکترای تخصصی / آموزش زبان انگلیسی
تلفن: 077 3122 2321
دانشکده: دانشکده ادبیات و علوم انسانی

مشخصات پژوهش

عنوان Iranian EFL writing assessment: The agency of rater or rating scale?
نوع پژوهش مقالات در نشریات
کلیدواژه‌ها
EFL writing assessment, Rating scale, Rater, Validation, Think aloud protocols
مجله International Journal of Language Testing
شناسه DOI
پژوهشگران نسیم قنبری (نفر اول) ، حسین براتی (نفر دوم)

چکیده

The present study explores the practice of Iranian raters in the EFL writing assessment context of the country. For this aim, early in the study a questionnaire developed by the researcher was administered to thirty experienced raters from ten major state universities in Iran. Later, five of the raters were chosen to participate in a follow-up think aloud session aimed to further explore the rating process. Findings of the questionnaire casted doubt on the existence of an explicit rating scale in the context. The following think aloud protocols further revealed that despite the apparent superiority of the raters in the rating process, neither the raters nor the rating scale-as two central components of the performance assessment- had a real agency in the Iranian EFL rating context. Lack of a common rating scale caused the raters to draw on ad hoc rating criteria and raters‟ idiosyncratic practices resulted by a missing rater training component created a context in which the construct of writing ability is greatly underrepresented. Along with locating the sources of the issue in both the rating scale and the raters, this study emphasizes that Iranian raters are in urgent need of training and constant monitoring programs to acquire rating expertise over time. As a requirement for the training programs, development of an explicit rating scale is strongly encouraged in the context.