School climate evaluation: designing and validating measurement instruments

Authors

Keywords:

School environment, Measurement instrument, Validity

Abstract

This study aims to present the process of designing, testing and validating measurement instruments to measure the school climate from the perspective of students from the 7th grade of primary education onwards, as well as their teachers and managers. We reviewed the national and international literature on the subject, built the concept, the reference framework formed by eight interrelated dimensions and the measurement instruments. Based on a sample of 11,516 respondents, we carried out the statistical and qualitative analyzes concerning the validation process: evidence content and construct validity. The dimensions and their respective items indicated good componential load and good reliability indices, which validates the measurement instruments.

Downloads

Download data is not yet available.

Author Biographies

Adriano Moro, Fundação Carlos Chagas (FCC), São Paulo (SP), Brasil

Doutor em Educação. Pesquisador do Departamento de Pesquisas da Fundação Carlos Chagas

Telma Pileggi Vinha, Universidade Estadual de Campinas (Unicamp), Campinas (SP), Brasil

Professora da faculdade de Educação da UNICAMP

 

 

Alessandra de Morais, Universidade Estadual Paulista (Unesp), Faculdade de Filosofia e Ciências, Marília (SP), Brasil

Professora assistente do Departamento de Psicologia da Educação e do Programa de Pós-Graduação em Educação da Faculdade de Filosofia e Ciências, UNESP

 

References

ALSTON, C. R. A causal comparative study of teacher and administrator perceptions of school climate within elementary schools in a school district. 2017. 176f. Tese (Doutorado em Educação) – Liberty University, Lynchburg, VA, EUA, 2017.

BLAYA, C. et al. Modos de organização da vida escolar nos estabelecimentos de ensino secundário inferior na Europa. In: THELOT, C. (org.). Quel impact des politiques éducatives: les apports de la recherche, Débat National sur l’avenir del’école. Paris: Débat National sur l’avenir del’école, 2004. p. 127-154.

BROWN, T. A. Confirmatory factor analysis for applied research. New York: The Guilford, 2006.

BRUNET, L. Climas Escolares e eficácia da escola. In: NÓVOA, A. As organizações escolares em análise. Lisboa: Dom Quixote, 1992. p. 121-140.

BRUNET, L. Climat organisationnel et efficacité scolaire. Universidade de Montréal, Faculté des Sciences de l’Éducation, 2001. Disponível em: http://www.f-d.org/climat-efficacite-brunet.htm. Acesso em: 29 jan. 2013.

CASASSUS, J. O clima emocional é essencial para haver aprendizagem. Revista Nova Escola, v. 218, dez. 2008.

CEULEMANS, E.; TIMMERMAN, M. E.; KIERS, H. A. L. The Hull procedure for selecting among multilevel component solutions. Chemometric and Intelligent Laboratory Systems, v. 106, n. 1, 2010.

COHEN, J. Social, emotional, ethical, and academic education: creating a climate for learning, participation in democracy, and well-being. Harvard Educational Review, v. 76, n. 2, 2006.

COHEN, J. School Climate: Engaging the Whole Village, Teaching the Whole Child. The Challenge. A Publication of the Office of Safe and Drug-free Schools. Department of Education, United States of America, University of Colorado and Boulder, v. 16, n. 4, 2010. Disponível em: http://www.edpubs.gov/document/ed005207w.pdf ?ck=97. Acesso em: 29 jul. 2015.

COHEN, J. The new standards for learning. Principal Leadership, Sept. 2012.

COHEN, J.; MACCABE, E.; MICHELLI, N.; PICKERAL, T. School climate: research policy, practice, and teacher education. Teachers College Record, v. 111, n. 1, p. 180-213, Jan. 2009.

COHEN, J.; PICKERAL, T.; McCLOSKEY, M. The challenge of assessing school climate. Educational Leadership: Realizing a Positive School Climate, v. 66, n. 4, Dec. 2008. Disponível em: http://www.ascd.org/publications/educational-leadership/dec08/vol66/num04/The-Challenge-of-Assessing-School-Climate.aspx. Acesso em: 1 abr. 2015.

CUNHA, M. B.; COSTA, M. O clima escolar de escolas de alto e baixo prestígio. In: REUNIÃO ANUAL DA ASSOCIAÇÃO NACIONAL DE PESQUISA EM EDUCAÇÃO – ANPED, 32., 2009, Caxambu, 2009. Anais [...]. Caxambu: Anped, 2009.

DAAR, S. E. School climate, teacher satisfaction, and receptivity to change. 2010. Tese (Doutorado) – Indiana State University, Indiana, 2010.

DEBARBIEUX, É.; ANTON, N.; ASTOR, R. A.; BENBENISHTY, R.; BISSON-VAIVRE, C.; COHEN, J.; GIORDAN, A.; HUGONNIER, B.; NEULAT, N.; ORTEGA RUIZ, R.; SALTET, J.; VELTCHEFF, C.; VRAND, R. Le “Climat scolaire”: définition, effets et conditions d’amélioration. Rapport au Comité scientifique de la Direction de l’enseignement

scolaire: Ministère de l’Éducation Nationale. MEN-DGESCO/Observatoire International de la Violence à l’École, 2012.

ELSABÉ, V. Educators’ perceptions of school climate in primary schools in the Southern Cape. 2006. Submitted in fulfillment of the requirements for the degree of Master of Education. University of South Africa, 2006. Disponível em: http://uir.unisa.ac.za/bitstream/handle/10500/1647/dissertation.pdf ?sequence=1. Acesso em: 10 fev. 2016.

FAN, W.; WILLIAMS, C.; CORKIN, D. D. M. A multilevel analysis of student perceptions of school climate: the effect of social and academic risk factors. Psychology in the Schools, v. 48, n. 6, p. 632-647, 2011.

FIELD, A. Descobrindo a estatística usando o SPSS. 2. ed. Porto Alegre: Artmed, 2009.

FORNELL, C.; LARCKER, D. F. Evaluating structural equations models with unobservable variables and measurement error. Journal of Marketing, v. 18, n. 1, p. 39-50, 1981.

FREIBERG, H. J. Measuring school climate: let me count the ways. Educacional Leadership: Realizing a Positive School Climate, v. 56, n. 1, p. 22-26, Sept. 1998.

FREIBERG, H. J. Three creative ways to measure school climate and next steps. In: FREIBERG, H. J. (org.). School climate: measuring, improving and sustaining healthy learning environments. New York: Taylor & Francis e-Library, 2005.

GANGI, T. A. School climate and faculty relationships: choosing an effective assessment measure. 2010. Tese (Doutorado) – St. John’s University, School Psychology Program, New York, 2010. Disponível em: http://www.schoolclimate.org/climate/documents/GangiTracydissertation10-20-09.pdf. Acesso em: 25 maio 2014.

GAULEY, J. Pathways to student engagement in school: exploring the effects of school climate on school engagement. 2017. 176f. Tese (Doutorado em Filosofia) – University of Wisconsin, Madison, EUA, 2017.

GAZIEL, H. H. O clima psico-social da escola e a satisfação que os docentes do segundo grau encontram no seu trabalho. Le Travail Humain, v. 50, n. 1, p. 35-45, 1987.

GOMES, C. A. A escola de qualidade para todos: abrindo as camadas da cebola. Ensaio: Avaliação e Políticas Públicas em Educação. Rio de Janeiro, v. 13, n. 48, p. 281-306, jul./set. 2005.

HAIR, J. F.; BLACK, B.; BARDIN, B.; ANDERSON, R. R.; TATHAN, R. L. Análise multivariada de dados. 6. ed. Porto Alegre: Bookman, 2009.

HOY, W. K.; HANNUM, J. W. Middle school climate: an empirical assessment of organizational health and student achievement. Educational Administration Quarterly, n. 33, p. 290-311, 1997.

JANOSZ, M.; GEORGES, P.; PARENT, S. L’environnement socioéducatif à l’école secondaire: un modèle théorique pour guider l’évaluation du milieu. Revue Canadienne de Psycho-Éducation, v. 27, n. 2, p. 285-306, 1998. Disponível em: http://www.f-d.org/climatecole/Janosz-article-1998.pdf. Acesso em: 21 nov. 2008.

LANE, S. School culture and climate at a middle school in Maine. 2017. 172f. Tese (Doutorado em Educação) – Northcentral University, Prescott Valley, Arizona, EUA, 2017.

LORENZO-SEVA, U.; FERRANDO, P. J. FACTOR: A computer program to fit the exploratory factor analysis model. Behavior Research Methods, v. 38, n. 1, p. 88-91, 2006.

LORENZO-SEVA, U.; TIMMERMAN, M. E.; KIERS, H. A. The hull method for selecting the number of common factors. Multivariate Behavioral Research, v. 46, n. 2, p. 340-364, 2011.

LOUKAS, A. What is school climate? High-quality school climate is advantageous for all students and may be particularly beneficial for at-risk students. Leadership Compass, v. 5, n. 1, 2007.

MELO, S. G. Relação entre clima escolar e desempenho acadêmico em escolas públicas de ensino médio representativas de um estado brasileiro. Dissertação (Mestrado) – Universidade Estadual Paulista “Júlio de Mesquita Filho”, Marília, SP, 2017.

REYNOLDS, K. J.; LEE, E.; TURNER, I.; BROMHEAD, D.; SUBASIC, E. How does school climate impact academic achievement? An examination of social identity processes. School Psychology International, v. 38, n. 1, p. 78-97, 2017.

SHERBLOM, S. A.; MARSHALL, J. C.; SHERBLOM, J. C. The relationship between school climate and math and reading achievement. Journal of Research in Character Education, v. 4, n. 1/2, p. 19, 2006.

TABACHNICK, B. G.; FIDELL, L. S. Using multivariate statistics. 5. ed. Boston: Allyn and Bacon, 2007.

THAPA, A. School climate research. In: DARY, T.; PICKERAL, T. (ed.). School climate practices for implementation and sustainability. New York: National School Climate Center, 2012. (A School Climate Practice Brief, n. 1).

THAPA, A.; COHEN, J.; GUFFEY, S.; HIGGINS-D’ALESSANDRO, A. A Review of school climate research. Review of Educational Research, v. 83, n. 3, p. 357-385, Sept. 2013.

THIÉBAUD, M. Climat scolaire, 2005, p. 1-6. Disponível em: http://www.relationsansviolence.ch/climatscolaire-mt.pdf. Acesso em: 12 out. 2015.

VALENTINI, F.; DAMASIO, B. F. Variância media extraída e confiabilidade composta: indicadores de precisão. Psicologia: Teoria e Pesquisa, v. 32, n. 2, p. 1-7, 2016.

VINHA, T. P.; MORAIS, A.; MORO, A. Manual de orientação para a aplicação dos questionários que avaliam o clima escolar. Campinas: FE/Unicamp, 2017. v. 1.

VINHA, T. P.; MORAIS, A.; TOGNETTA, L. R. P.; AZZI, R. G.; ARAGÃO, A. M. F.; MARQUES, C. A. E.; SILVA, L. M.F.; MORO, A.; VIVALD, F. M. C.; RAMOS, A. M.; OLIVEIRA, M. T. A.; BOZZA, T. C. L. O clima escolar e a convivência respeitosa nas instituições educativas. Estudos em Avaliação Educacional, São Paulo, v. 27, n. 64, p. 96-127, jan./abr. 2016.

WARNER, L.; HEINDEL, P. Student Success Built on a Positive School Climate. The Education Digest, Ann Arbor, v. 82, iss. 7, p. 10-15, March 2017.

Downloads

Published

2019-06-13

How to Cite

Moro, A., Vinha, T. P., & Morais, A. de. (2019). School climate evaluation: designing and validating measurement instruments. Cadernos De Pesquisa, 49(172), 312–335. Retrieved from https://publicacoesfcc.emnuvens.com.br/cp/article/view/6151

Issue

Vol. 49 No. 172: abr./jun.2019

Section

Articles

License

Copyright (c) 2019 Cadernos de Pesquisa

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors who publish in this journal agree to the following terms:

a. Authors retain the copyright and grant the journal the right to first publication, with the paper simultaneously licensed under the Creative Commons Attribution license that allows the sharing of the paper with acknowledgment of authorship and initial publication in this journal.

b. Authors are authorized to assume additional contracts separately, for non-exclusive distribution of the version of the paper published in this journal (for example publishing in institutional repository or as a book chapter), with acknowledgment of authorship and initial publication in this journal.

c. Authors are allowed and encouraged to publish and distribute their paper on-line (for example in institutional repositories or on their personal page) at any moment before or during the editorial process, as this can generate productive changes, as well as increase the impact and citation of the published paper (See The Effect of Open Access).