Favoring certain groups of students because of their culture, background knowledge, beliefs, or personal circumstances, rather than their language ability.
Bias
Oops!
Check
Okay!
Check
baam
Lose 15 points!
Oops!
rocket
Go to first place!
Okay!
rocket
Go to first place!
Okay!
baam
Lose 25 points!
Oops!
20
The degree of consistency when the same rater scores the same text at different times.
intra-rater reliability
Oops!
Check
Okay!
Check
20
The degree of agreement between different raters.
inter-rater reliability
Oops!
Check
Okay!
Check
thief
Give points!
5
10
15
20
25
shark
Other team loses 25 points!
Okay!
fairy
Take points!
5
10
15
20
25
banana
Go to last place!
Oops!
15
Tasks should provide structure to guide learners.
scaffolding
Oops!
Check
Okay!
Check
25
the test looks appropriate and fair to students and teachers
face validity
Oops!
Check
Okay!
Check
15
it gives consistent results across time, tasks, and raters.
Reliability
Oops!
Check
Okay!
Check
20
A rubric that breaks writing into separate categories (e.g., content, organization, language, mechanics), each with its own score.
analytic
Oops!
Check
Okay!
Check
15
it measures what it is supposed to measure.
validity
Oops!
Check
Okay!
Check
eraser
Reset score!
Oops!
gift
Win 25 points!
Okay!
fairy
Take points!
5
10
15
20
25
lifesaver
Give 25 points!
Oops!
seesaw
Swap points!
Oops!
magnet
Take 10 points!
Okay!
gift
Win 5 points!
Okay!
thief
Give points!
5
10
15
20
25
15
When a test item does not match the level, skills, or learning objectives it is supposed to assess.
Mismatch
Oops!
Check
Okay!
Check
15
assessment tasks resemble real-world language use.
authenticity
Oops!
Check
Okay!
Check
20
a rubric used for fast scoring
holistic
Oops!
Check
Okay!
Check
20
The variety of vocabulary and grammar structures a student uses appropriately in writing.