Fundamental Considerations for a Writing Test Construction

Authors

DOI:

https://doi.org/10.48112/aessr.v3i2.484

Abstract

Abstract Views: 560

Writing is challenging in second language and its test construction is rather problematic. The present study is aimed to offer an overview of the fundamental considerations in the test construction in English language teaching. The significance of test validity, test reliability, task interactiveness, test attentiveness, test impact, and test practicality have been employed to improve educational practices. The researcher has considered the validity and reliability as severe concerns for the issues in question and the review has been advanced to add to the understanding of the former’s value in designing a writing test. Desktop reach formed the base of this research. The search confirms that the aforementioned characteristics are central to the design. This confirms with the research findings available in the literature of teaching and testing.

Keywords:

Ethical Standards, Test Fairness, Test Reliability, Test Validity, Writing Test Construction

References

Alderson, J. C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. Cambridge University Press.

Baartman, L. K., Bastiaens, T. J., Kirschner, P. A., & Vander Vleuten, C. P. (2006). The wheel of competency assessment: Presenting quality criteria for competency assessment programs. Studies in Educational Evaluation, 32(2), 153-170. https://doi.org/10.1016/j.stueduc.2006.04.006

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford University Press.

Bachman, L. F. (2000). Modern language testing at the turn of the century: Assuring that what we count counts. Language Testing, 17(1), 1-42. https://doi.org/10.1191/026553200675041464

Charney, D. (1984). The validity of using holistic scoring to evaluate writing: A critical overview. Research in the Teaching of English, 65-81.

Considine, J., Botti, M., & Thomas, S. (2005). Design, format, validity and reliability of multiple choice questions for use in nursing research and education. Collegian, 12(1), 19-24. https://doi.org/10.1016/s1322-7696(08)60478-3

Crocker, L. (2003). Teaching for the test: Validity, fairness, and moral action. Educational Measurement: Issues and Practice, 22(3), 5-11. https://doi.org/10.1111/j.1745-3992.2003.tb00132.x

Fowler, R. C. (2008). Validity, test. Encyclopedia of Special Education, 2087-2089.

Grant, S. G. (2000). Teachers and tests changes in the New York state testing program. Education Policy Analysis Archives, 8, 14-14. https://doi.org/10.14507/epaa.v8n14.2000

Hughes, A. (2003). Testing for language teachers. Cambridge University Press.

Humphry, S. M., & Heldsinger, S. A. (2014). Common structural design features of rubrics may represent a threat to validity. Educational Researcher, 43(5), 253-263. https://doi.org/10.3102/0013189x14542154

Kunkun, L. U. O. (2015). Validity considerations in designing a writing test. Studies in Literature and Language, 10(5), 19-21.

Lee, H. K., & Anderson, C. (2007). Validity and topic generality of a writing performance test. Language Testing, 24(3), 307-330. https://doi.org/10.1177/0265532207077200

Lissitz, R. W., & Samuelsen, K. (2007). A suggested change in terminology and emphasis regarding validity and education. Educational Researcher, 36(8), 437-448. https://doi.org/10.3102/0013189x07311286

Long, T., & Johnson, M. (2000). Rigour, reliability, and validity in qualitative research. Clinical Effectiveness in Nursing, 4(1), 30-37. https://doi.org/10.1054/cein.2000.0106

MacIver, R., Anderson, N., Costa, A. C., & Evers, A. (2014). Validity of Interpretation: A user validity perspective beyond the test score. International Journal of Selection and Assessment, 22(2), 149-164. https://doi.org/10.1111/ijsa.12065

Moss, P. A. (1994). Validity in high stakes writing assessment: Problems and possibilities. Assessing Writing, 1(1), 109-128. https://doi.org/10.1016/1075-2935(94)90007-8

Noble, H., & Smith, J. (2015). Issues of validity and reliability in qualitative research. Evidence-based Nursing, 18(2), 34-35. https://doi.org/10.1136/eb-2015-102054

O’Neill, P., Murphy, S., Huot, B., & Williamson, M. (2005). What teachers say about different kinds of mandated state writing tests. Journal of Writing Assessment, 2(2), 81-108.

Riege, A. M. (2003). Validity and reliability tests in case study research: a literature review with “hands‐on” applications for each research phase. Qualitative Market Research: An International Journal, 6(2),75-86. https://doi.org/10.1108/13522750310470055

Rossi, O., & Brunfaut, T. (2019). Test item writers. The TESOL Encyclopedia of English Language Teaching, 1–7. https://doi.org/10.1002/9781118784235.eelt0981

Smith, M. L. (1991). Put to the test: The effects of external testing on teachers. Educational Researcher, 20(5), 8-11. https://doi.org/10.3102/0013189x020005008

Weideman, A. (2019). Degrees of adequacy: The disclosure of levels of validity in language assessment. Koers, 84(1), 1-15. https://doi.org/10.19108/koers.84.1.2451

Weigle, S.C. (2002). Assessing writing. Cambridge, UK: Cambridge University Press.

Wiggins, G. P. (1993). Assessing student performance: Exploring the purpose and limits of testing. Jossey-Bass.

Published

2023-05-31

How to Cite

Khan, Z., Khan, J., & Sarhandi, P. S. A. (2023). Fundamental Considerations for a Writing Test Construction. Academy of Education and Social Sciences Review, 3(2), 147–153. https://doi.org/10.48112/aessr.v3i2.484

Issue

Section

Articles

Similar Articles

1 2 3 4 5 6 > >> 

You may also start an advanced similarity search for this article.