Lallmamode, Sheila Parveen and Mat Daud, Nuraihan and Abu Kassim, Noor Lide (2016) Development and initial argument-based validation of a scoring used in the assessment of L2 writing electronic portfolios. Assessing Writing, 30. pp. 44-62. ISSN 1075-2935
![]() |
PDF
- Published Version
Restricted to Repository staff only Download (1MB) | Request a copy |
Abstract
Although writing electronic portfolios (ePortfolios) help learners communicate digitally and provide a platform for works to be better collected and presented, challenges are present in their assessment. This paper reports the development and validation of a writing ePortfolio scoring rubric for an action research course for L2 learners. Using Bachman's (2005) 'Assessment Use Argument' as a basis, two main claims to support the validity of the rubric were examined: (1) the rubric is a reliable tool; and, (2) the rubric is relevant to the construct being measured. A mixed-method approach was used in the development and validation of the eight-criteria analytic and holistic evaluation scoring rubric. Thirteen raters evaluated thirty-eight ePortfolios in the study. The analyses of raters' rating using many-facet Rasch measurement approach and raters' individual standardised open-ended interviews indicated that overall the rubric's analytic categories functioned appropriately to assess the intended construct. However, the criterion 'Ease of Navigation' was found to be misfitting due to a differences in raters' evaluation of the same ePortfolios. Overall, the argument-based validation indicated that the scoring rubric is a reliable and valid instrument for the purpose of assessing L2 writing ePortfolios in the context for which it was developed.
Item Type: | Article (Journal) |
---|---|
Additional Information: | 419/52378 |
Uncontrolled Keywords: | Argument-based validation; Digital writing; Electronic portfolio; ESL writing; L2 writing assessment; Rasch measurement; Rating scale; Scoring rubric |
Subjects: | L Education > L Education (General) P Language and Literature > PE English |
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button): | Kulliyyah of Languages and Management |
Depositing User: | Prof. Nuraihan Mat Daud |
Date Deposited: | 07 Dec 2016 10:18 |
Last Modified: | 07 Dec 2016 10:18 |
URI: | http://irep.iium.edu.my/id/eprint/52378 |
Actions (login required)
![]() |
View Item |