What does a test score actually tell us about a learner’s language ability, and which decisions can it justify? This learning hub connects the principles of language testing with the practical work of designing, analysing, and evaluating assessments for real classrooms and programmes.
Begin with tests and tasks you already use or have taken. Examine them against the principles of validity, reliability, practicality, authenticity, and washback, then design and trial instruments of your own. The materials are designed for postgraduate students in TESOL and applied linguistics, in-service language teachers, and programme coordinators.
Explain core concepts in language testing and assessment, including the distinctions between testing, assessment, and evaluation, and between formative and summative purposes.
Apply the principles of validity, reliability, practicality, authenticity, and washback to analyse an existing test in its educational context.
Write test specifications and design tasks and scoring rubrics for listening, speaking, reading, writing, grammar, and vocabulary.
Interpret test scores and basic item statistics, such as item facility and item discrimination, and use them to revise test items.
Critically evaluate standardised tests and standards-based frameworks, including the CEFR and Vietnam’s six-level foreign language proficiency framework, with attention to fairness, ethics, and social consequences.
Grade and report on students’ work transparently and consistently, including through alternatives such as portfolios, self-assessment, and peer assessment.
The four-part learning pathway draws on Language Assessment: Principles and Classroom Practices by Brown and Abeywickrama (2019), alongside work by Bachman and Palmer, Fulcher and Davidson, Hughes, and Green. Topics 1–18 are organised for this course; their numbers do not correspond directly to the textbook’s chapter numbers.
Work through the topics in sequence, keeping one test you know well alongside your notes. For each principle, ask what evidence would show that the test meets it and what evidence would count against it.
Topic 1 — Testing, assessing, and teaching: purposes, types of tests, and current issues.
Topic 2 — Principles of language assessment: practicality, reliability, validity, authenticity, and washback.
Topic 3 — Validity and validation: from construct definition to argument-based approaches.
Topic 4 — Reliability and scoring: sources of measurement error, rater consistency, and rubrics.
Suggested practical · Evaluate a classroom test
Select a test you have administered or taken, with permission to discuss it. Describe its purpose, test takers, and the decisions based on its scores. Evaluate it against the five principles, citing specific items or tasks as evidence.
Present your evaluation in a short table with one row per principle, and propose three concrete revisions. Distinguish weaknesses in the test itself from weaknesses in how its scores are used.
Start from the decision the test must support. Before writing any item, state the construct, the target language use situation, and how a score will be interpreted, so that design choices can be checked against a stated purpose.
Topic 5 — Designing classroom language tests: purposes, constructs, and test specifications.
Topic 6 — Writing and reviewing items: selected-response and constructed-response formats.
Topic 7 — Item analysis and score interpretation: descriptive statistics, item facility, and item discrimination.
Topic 8 — Standards-based assessment: the CEFR, national proficiency frameworks, and standard setting.
Topic 9 — Standardised testing: how large-scale tests such as IELTS, TOEFL, and VSTEP are developed, used, and critiqued.
Suggested practical · Write specifications and pilot a short test
Write test specifications for one unit of a course you teach: purpose, construct, task types, timing, and scoring. Draft a short test of 15–20 items from the specifications and ask a colleague to review each item against them.
Pilot the test with a small group, where you have consent to do so. Calculate item facility and item discrimination, identify items that behave unexpectedly, and revise them. Interpret statistics from small samples cautiously and report the sample size.
For each skill, begin with what test takers must do with language outside the test. Compare task formats by the evidence they provide about the construct, and by what they demand of teachers in preparation and scoring.
Topic 10 — Assessing listening: micro- and macro-skills, task types, and the role of input.
Topic 11 — Assessing speaking: from imitative to extensive tasks, interviews, and interactional competence.
Topic 12 — Assessing reading: text selection, item formats, and reading strategies.
Topic 13 — Assessing writing: prompts, holistic and analytic scoring, and feedback.
Topic 14 — Assessing grammar and vocabulary: knowledge, use, and integration with skills.
Suggested practical · Design and trial a rating scale
Design a speaking or writing task with an analytic rating scale of three to five criteria. Ask two raters to score the same set of anonymised performances independently, then compare the scores criterion by criterion.
Discuss the disagreements and revise the descriptors that caused them. Where the data allow, report exact and adjacent agreement, and add Cohen’s kappa or a correlation only when the number of performances justifies it.
Treat assessment as part of teaching and of a wider social system. Consider who is affected by each assessment decision, what information they receive, and how technology changes what can be assessed and trusted.
Topic 15 — Alternatives in assessment: portfolios, journals, conferences, observation, self-assessment, and peer assessment.
Topic 16 — Grading and student evaluation: grading philosophies, criteria, and reporting.
Topic 17 — Fairness, ethics, and social impact: washback, test use, and language assessment literacy.
Topic 18 — Technology and AI in assessment: computer-based testing, automated scoring, and academic integrity.
Suggested practical · Build an assessment plan
Draft an assessment plan for one course that combines formative and summative components. Map each component to a learning outcome, state its weighting, and explain how feedback will reach students in time to be used.
Include at least one alternative assessment with its criteria, and one paragraph on how the plan addresses fairness for students with different backgrounds and access to technology.
Additional reading
Bachman and Palmer (2010), Language Assessment in Practice: a framework for justifying test development and use.
Fulcher and Davidson (2007), Language Testing and Assessment: An Advanced Resource Book: key concepts, extended readings, and exploration tasks.
Hughes and Hughes (2020), Testing for Language Teachers: practical guidance on writing and evaluating tests.
Green (2021), Exploring Language Assessment and Testing: an accessible account of assessment practice and its history.
The Cambridge Language Assessment series, including Alderson (2000) on reading, Read (2000) on vocabulary, Buck (2001) on listening, Weigle (2002) on writing, Luoma (2004) on speaking, and Purpura (2004) on grammar.
Suggested final project
Develop a small-scale test for a context you know well. Possible projects include an achievement test for one unit of a general English course, a speaking assessment aligned with a CEFR level, or a critical evaluation of a test used for placement or graduation requirements.
Submit the test specifications, the test and its scoring guide, a summary of pilot results, and a reflective report. Explain the purpose, the construct, the design decisions, the evidence for validity and reliability, and the limitations.
Before sharing your work: obtain consent for any trial, remove personal information from scripts and recordings, keep test materials secure where they will be reused, and disclose any use of generative AI. Support claims about test quality with evidence from items, scores, or test-taker responses.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford University Press.
Brown, H. D., & Abeywickrama, P. (2019). Language assessment: Principles and classroom practices (3rd ed.). Pearson.
Fulcher, G., & Davidson, F. (2007). Language testing and assessment: An advanced resource book. Routledge.
Green, A. (2021). Exploring language assessment and testing: Language in action (2nd ed.). Routledge.
Hughes, A., & Hughes, J. (2020). Testing for language teachers (3rd ed.). Cambridge University Press.
This teaching page provides an adapted reading pathway and suggested activities for postgraduate study. Its scope and sequence were informed by publicly available descriptions of language testing modules at Lancaster University, the University of Melbourne, and the University of Southampton; the wording and activities are this course’s own. Topic numbering belongs to this course outline; consult each publication’s own contents when planning your reading.