The psychology of evaluation: Addressing the pressures teachers face

Evaluation processes are used to formatively inform improved instruction and summatively to determine the worth or value of teaching, schools, and students. These uses create pressures for teachers because they have conflicting goals around improvement vs. accountability. This perspective paper overviews the author’s understanding of evaluation, the challenges accountability presents to the conceptions teachers have about assessment and identifies a major obstacle to the impact of evaluation in the low information level of most so-called educational tests. A solution to the dilemma is recommended in the example of the Assessment Tools for Teaching and Learning software deployed in New Zealand schools.

https://doi.org/10.20500/rce.v18i41.54691

PT-BR

EN (English)

Referências

ARCHER, E.; BROWN, G. T. L. Beyond rhetoric: Leveraging learning from New Zealand's assessment tools for teaching and learning for South Africa. Education as Change, 17, n. 1, p. 131-147, 2013/05/01 2013.

BAKER, E. L. Technology: Something's coming-Something good. UCLA Graduate School of Education & Information Studies. 1999.

BLACK, P.; WILIAM, D. Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5, n. 1, p. 7-74, 1998.

BLOOM, B.; HASTINGS, J.; MADAUS, G. Handbook on formative and summative evaluation of student learning. New York: McGraw Hill, 1971.

BONNER, S. M. Teachers’ Perceptions about Assessment: Competing Narratives. In: BROWN, G. T. L. e HARRIS, L. R. (Ed.). Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016. p. 21-39.

BROWN, G. T. L. Teachers Conceptions of Assessment-Secondary Schools Long and Abridged. The University of Auckland 2003.

BROWN, G. T. L. Technologies and infrastructure: costs and obstacles in developing large-scale computer–based testing. Education Inquiry, 10, n. 1, p. 4-20, 2019.

BROWN, G. T. L. Reporting assessment information to teachers: Report of Project asTTle outputs design. University of Auckland, Project asTTle. Auckland, NZ. 2001.

BROWN, G. T. L. Teachers' conceptions of assessment: Implications for policy and professional development. Assessment in Education: Principles, Policy & Practice, 11, n. 3, p. 301-318, 2004/09/01 2004.

BROWN, G. T. L. Teachers' conceptions of assessment: Validation of an abridged version. Psychological Reports, 99, n. 1, p. 166-170, 2006 2006.

BROWN, G. T. L. Conceptions of assessment: Understanding what assessment means to teachers and students. New York: Nova Science Publishers, 2008. ix, 198 p. p. 9781604563221 (hardcover)

BROWN, G. T. L. Teachers’ self-reported assessment practices and conceptions: Using structural equation modelling to examine measurement and structural models. In: TEO, T. e KHINE, M. S. (Ed.). Structural equation modelling in educational research: Concepts and applications. Rotterdam, NL: SensePublishers, 2009. p. 243-266.

BROWN, G. T. L. Teachers' conceptions of assessment: Comparing primary and secondary teachers in New Zealand. Assessment Matters, 3, p. 45-70, 2011.

BROWN, G. T. L. Assessment of Student Achievement. New York: Routledge, 2018. 9781138061842.

BROWN, G. T. L. Evaluation in teacher training: An analysis of theoretical conceptions. In: DOS SANTOS, W. e STIEG, R. (Ed.). Evaluación Educativa en la Formación de Profesores: Brasil, Colombia, Chile, España, Inglaterra, México, Nueva Zelanda y Uruguay [Educational assessment in the Development of Teachers: Brazil, Colombia, Chile, Spain, England, New Zealand, and Uruguay]. Curitiba, Brazil: Appris Editora, 2021. p. 53-67.

BROWN, G. T. L. Assessments cause and contribute to learning: If only we let them. In: YAN, Z. e YAN, L. (Ed.). Assessment as learning: Maximising opportunities for student learning and achievement. London: Routledge, 2022. cap. 4, p. 38-52.

BROWN, G. T. L.; MICHAELIDES, M. P. Ecological rationality in teachers' conceptions of assessment across samples from Cyprus and New Zealand. European Journal of Psychology of Education, 26, n. 3, p. 319-337, 2011.

BROWN, G. T. L.; REMESAL, A. Teachers’ conceptions of assessment: Comparing two inventories with Ecuadorian teachers. Studies in Educational Evaluation, 55, p. 68-74, 2017/12/01/ 2017.

BROWN, G. T. L.; CHAUDHRY, H.; DHAMIJA, R. The impact of an assessment policy upon teachers' self-reported assessment beliefs and practices: A quasi-experimental study of Indian teachers in private schools. International Journal of Educational Research, 71, p. 50-64, 2015 2015.

BROWN, G. T. L.; KENNEDY, K. J.; FOK, P. K.; CHAN, J. K. S. et al. Assessment for student improvement: understanding Hong Kong teachers’ conceptions and practices of assessment. Assessment in Education: Principles, Policy & Practice, 16, n. 3, p. 347-363, 2009/11/01 2009.

BROWN, G. T. L.; LAKE, R.; MATTERS, G. Queensland teachers’ conceptions of assessment: The impact of policy priorities on teacher attitudes. Teaching and Teacher Education, 27, n. 1, p. 210-220, 2011.

BROWN, G. T. L.; O'LEARY, T. M.; HATTIE, J. A. C. Effective Reporting for Formative Assessment: the asTTle case example. In: ZAPATA-RIVERA, D. (Ed.). Score reporting: Research and applications. New York: Routledge, 2018. p. 107-125.

BROWN, G. T.; HATTIE, J. The benefits of regular standardized assessment in childhood education: Guiding improved instruction and learning. In: SUGGATE, S. e REESE, E. (Ed.). Contemporary educational debates in childhood education and development: Routledge, 2012. p. 287-292.

CANNELL, J. J. How public educators cheat on standardized achievement tests. Albuquerque, NM: Friends for Education, 1989.

CHEUNG, D. Measuring teachers' meta-orientations to curriculum: Application of hierarchical confirmatory analysis. Journal of Experimental Education, 68, n. 2, p. 149-165, 2000.

CIZEK, G. J. Validity: An integrated approach to test score meaning and use. Routledge, 2020. 9780367261382.

EDUCATIONAL RESEARCH INFORMATION CENTER (U.S.). Thesaurus of ERIC descriptors. 14th ed. Westport, CT: The Oryx Press, 2001.

EMBRETSON, S. E.; REISE, S. P. Item Response Theory for Psychologists. Mahwah, NJ: LEA, 2000.

GEBRIL, A.; BROWN, G. T. L. The effect of high-stakes examination systems on teacher beliefs: Egyptian teachers’ conceptions of assessment. Assessment in Education: Principles, Policy & Practice, 21, n. 1, p. 16-33, 2014/01/02 2014.

HARRIS, L. R.; BROWN, G. T. L. Assessment and Parents. In: PETERS, M. A. (Ed.). Encyclopedia of Educational Philosophy and Theory. Singapore: Springer Singapore, 2016. p. 1-6. Disponível em: http://dx.doi.org/10.1007/978-981-287-532-7_538-1.

HATTIE, J. A. Schools like mine: Cluster analysis of New Zealand schools. University of Auckland, Project asTTle. Auckland, NZ. 2002.

HATTIE, J. A.; BROWN, G. T. L. Technology for school-based assessment and assessment for learning: Development principles from New Zealand. Journal of Educational Technology Systems, 36, n. 2, p. 189-201, 2008.

HATTIE, J. A. C.; BROWN, G. T. L.; KEEGAN, P. J. A national teacher-managed, curriculum-based assessment system: Assessment Tools for Teaching & Learning (asTTle). International Journal of Learning, 10, p. 771-778, 2003.

HATTIE, J. A.; BROWN, G. T. Assessment and evaluation. In: Educational psychology: Concepts, research and challenges: Routledge, 2010. p. 116-131.

LEAHY, S.; LYON, C.; THOMPSON, M.; WILIAM, D. Classroom assessment minute by minute, day by day. Educational Leadership, 63, n. 3, p. 18-24, 2005.

LERNER, J. S.; TETLOCK, P. E. Accounting for the effects of accountability. Psychological Bulletin, 125, n. 2, p. 255-275, 1999.

LINGARD, B.; LEWIS, S. Globalization of the Anglo-American approach to top-down, test-based educational accountability. In: BROWN, G. T. L. e HARRIS, L. R. (Ed.). Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016. p. 387-403.

MEAGHER-LUNDBERG, P. Comparison variables useful to teachers in analysing assessment results. University of Auckland, Project asTTle. Auckland, NZ. 2000.

MEAGHER-LUNDBERG, P. Output reporting design: Focus group 1. University of Auckland, Project asTTle. Auckland, NZ. 2001a.

MEAGHER-LUNDBERG, P. Output reporting design: Focus group 2. University of Auckland, Project asTTle. Auckland, NZ. 2001b.

MOON, T. R. Differentiated instruction and assessment: An approach to classroom assessment in conditions of student diversity. In: BROWN, G. T. L. e HARRIS, L. R. (Ed.). Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016. p. 284-301.

NICHOLS, S. L.; HARRIS, L. R. Accountability assessment’s effects on teachers and schools. In: BROWN, G. T. L. e HARRIS, L. R. (Ed.). Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016. p. 40-56.

REMESAL, A. Primary and secondary teachers’ conceptions of assessment: A qualitative study. Teaching and Teacher Education, 27, p. 472-482, 2011.

ROSCOE, R. D.; CHI, M. T. H. Understanding Tutor Learning: Knowledge-Building and Knowledge-Telling in Peer Tutors' Explanations and Questions. Review of Educational Research, 77, p. 534-574, 2007.

SADLER, D. R. Formative assessment and the design of instructional systems. Instructional Science, 18, n. 2, p. 119-144, 1989/06/01 1989.

SCRIVEN, M. The methodology of evaluation. In: TYLER, R. W.;GAGNE, R. M., et al (Ed.). Perspectives of curriculum evaluation. Chicago, IL: Rand McNally, 1967. v. 1, p. 39-83.

SCRIVEN, M. Beyond formative and summative evaluation. In: MCLAUGHLIN, M. W. e PHILLIPS, D. C. (Ed.). Evaluation & education: At quarter century. Chicago, Il.: NSSE, 1991. v. 90, Part II, p. 19-64.

STOBART, G. The validity of formative assessment. In: GARDNER, J. (Ed.). Assessment and learning. London: Sage, 2006. p. 133-146.

TELTEMANN, J.; KLIEME, E. The impact of international testing projects on policy and practice. In: BROWN, G. T. L. e HARRIS, L. R. (Ed.). Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016. p. 369-386.

WILKINSON, I. A. G.; TOWNSEND, M. A. R. From Rata to Rimu: Grouping for instruction in best practice New Zealand classrooms. The Reading Teacher, 53, n. 6, p. 460-471, 2000.

WISE, S. L.; SMITH, L. F. The validity of assessment when students don’t give good effort. In: BROWN, G. T. L. e HARRIS, L. R. (Ed.). Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016. p. 204-220.

WRIGHT, B. D.; STONE, M. H. Best Test Design. Chicago, IL: MESA press, 1979.

YAN, Z.; BOUD, D. Conceptualising assessment-as-learning. In: YAN, Z. e YANG, L. (Ed.). Assessment as learning: Maximising opportunities for student learning and achievement : Routledge, 2022. p. 11–24.

Proposta de Política para Periódicos de Acesso Livre

Autores que publicam nesta revista concordam com os seguintes termos:

a. Autores mantém os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista.

b. Autores têm autorização para assumir contratos adicionais separadamente, para distribuição não-exclusiva da versão do trabalho publicada nesta revista (ex.: publicar em repositório institucional ou como capítulo de livro), com reconhecimento de autoria e publicação inicial nesta revista.

c. Autores têm permissão e são estimulados a publicar e distribuir seu trabalho online (ex.: em repositórios institucionais ou na sua página pessoal) a qualquer ponto antes ou durante o processo editorial, já que isso pode gerar alterações produtivas, bem como aumentar o impacto e a citação do trabalho publicado (Veja O Efeito do Acesso Livre).