ºÚÁÏÉçÇø

Reading

Watching/Listening

Articles

•  
•  ()
•  
•  
•  
•  

Articles on Bias in Course Evaluations

Research on course evaluations increasingly finds evidence that bias impacts how instructors are rated. These studies underscore that gender, race, ethnicity, accent, sexual orientation, and disability status can impact ºÚÁÏÉçÇøs’ ratings of instructors. We include selected research on course evaluations below, to inform discussions and initiatives to address these trends and forms of bias.

. The impact of accent on college ºÚÁÏÉçÇøs' perceptions and evaluations of professors. Journal of Communications Media Studies, 4(1), 63+. This study looks at the effects of professors' ethnicity and accent on ºÚÁÏÉçÇøs' evaluations of their teaching effectiveness.

This study brings light to the cross-cultural challenges that foreign-accented speech professors encounter in the classroom, especially with a ºÚÁÏÉçÇø population from different ethnic, racial, and national backgrounds.

 . Inventing a Gay Agenda: Students' Perceptions of Lesbian and Gay Professors. Journal of Applied Social
Psychology, 41: 1538-1564.

Two studies were conducted on ºÚÁÏÉçÇøs’ perceptions of lesbian and gay professors. Students rated professors on topics such as political bias, professional competence, and warmth. The study results suggested that ºÚÁÏÉçÇøs might use varied criteria to evaluate LGBTQIA+ professors and their ability to teach courses objectively.

. Gender Patterns in College Students’ Choices of Their Best and Worst Professors. Psychology of Women
Quarterly, 30(1), 25–35.

Over 100 predominately white ºÚÁÏÉçÇøs were asked to describe their best and worst professors. The study shows that more female professors were chosen as “best” by female ºÚÁÏÉçÇøs and less by their male ºÚÁÏÉçÇøs. There was no gender difference for “worst” professors. “Best” professors were typically described as caring and knowledgeable. The findings suggest that gender dynamics should be paid greater attention to within the classroom and ºÚÁÏÉçÇø evaluations.

. Gender biases in ºÚÁÏÉçÇø evaluations of teaching. Journal of Public Economics 145:27-41.

This article uses data from a French university to examine gender biases in ºÚÁÏÉçÇø evaluations of teaching (SETs). The different teaching dimensions that ºÚÁÏÉçÇøs value in male and female professors were inclined to match gender stereotypes. Men are perceived by both male and female ºÚÁÏÉçÇøs as being more knowledgeable and having stronger class leadership skills (which are stereotypically associated with males), despite the fact that ºÚÁÏÉçÇøs appear to learn as much from women as from men.

. Exploring Bias in Student Evaluations: Gender, Race, and Ethnicity. PS: Political Science & Politics, 53(2), 270-274.
doi:10.1017/S1049096519001744

This article details the research showing that in instructor evaluations ºÚÁÏÉçÇøs are biased against women. This article also dives into the relationship between evaluations and gender and race/ethnicity. Findings of this research show that instructors who are female and persons of color receive lower scores on ºÚÁÏÉçÇø evaluations than those who are white males.

. Colleges are getting smarter about ºÚÁÏÉçÇø evaluations. here's how. The Chronicle of Higher Education.

This article describes a study on the relationship between ºÚÁÏÉçÇø evaluations and grade inflation conducted at the University of Oregon. The article continues on to describe the systemic changes that occurred as a result of findings of this research.

. Gender and cultural bias in ºÚÁÏÉçÇø evaluations: Why representation matters. PLoS ONE
14(2): e0209749.

Gendered and racial inequalities are present in even the most progressive of workplaces. In higher education, bias in performance evaluation has been hypothesized as one of the reasons as to why very few women make it to the top of the academic hierarchy. The findings of this study suggest that these biases may decrease with an increase of represented minority groups.

. What's really going on with respect to bias and teaching evals?

The study finds that course evaluations are greatly impacted by characteristics unrelated to actual instructor quality. Courses with lighter workloads or higher grading distributions do have better scores from ºÚÁÏÉçÇøs. Additionally, the study found that gender, race, ethnicity, accent, disability status, and sexual orientation had a great impact on teacher evaluations.

 CSUF professor examines accent bias and how we perceive others. Orange County Register.

This article discusses a series of studies conducted on accent bias and accent privilege, while working to identify what factors might help diminish people’s judgment of a person based solely on their accent.

. Inside higher ed. Teaching evaluations reflect colleges' commitment to diversity (opinion).

In this article, the author discusses how evaluations reflect the universities’ lack of commitment to diversity and provides three action items that institutions should implement.

. Analysis | ºÚÁÏÉçÇøs rate male instructors more highly than female instructors. We tried to counter that hidden bias. The
Washington Post.

Throughout academia, including in political science, women haven’t achieved parity with men. This series explores the implicit bias that holds women back at every stage, from the readings professors assign to the ºÚÁÏÉçÇø evaluations that influence promotions and pay, from journal publications to book awards.

. Evaluating Student Evaluations of Teaching: A Review of Measurement and Equity Bias in SETs and Recommendations for Ethical Reform. J Acad Ethics 20, 73–84.

Student Evaluations of Teaching (SETs) have minimal or no correlation with ºÚÁÏÉçÇø learning. Furthermore, data repeatedly finds that women faculty, faculty of color, and other marginalized groups are subject to bias in SETs.

 "What’s in a name: Exposing gender bias in ºÚÁÏÉçÇø ratings of teaching." Innovative Higher Education 40 (4):291-303.

In many cases, the career advancement and outcomes of teachers in higher education are based significantly on ºÚÁÏÉçÇø ratings and evaluations. In this study, instructors of an online course worked under two different gender identities. Results showed that the male identity was rated much higher than the female identity.

 "Gender bias in teaching evaluations." Journal of the European Economic Association 17 (2):535-566.

This paper provides new evidence on gender bias in teaching evaluations. It is noted that female teachers consistently received lower graded evaluation in comparison to their male counterparts. The authors suggest that there are indirect effects on the career progression of female teachers as a result of these evaluations.

 "The Tail Wagging the Dog; An Overdue Examination of Student Teaching Evaluations." International Journal of Higher
Education 4 (2):116-126.

The purpose of this research was to examine the impact of factors beyond the professor's control and subsequently, their unique impact on Student Teaching Evaluations (STEs). This research could have great social implications if widely read across academic circles as it shows the biases present in STEs.

. Scaling down inequality: rating scales, gender bias, and the architecture of evaluation. American Sociological Review. 84 (2),
248–274. DOI: 10.1177/0003122419833601.

Performance ratings heavily influence career advancement for employees. The authors discuss how evaluators tend to rate male workers significantly higher that female workers, even if their qualifications and performances are identical.

. Examining Student Evaluations of Black College Faculty: Does Race Matter? The Journal of Negro Education, 80(2), 149–162.

The purpose of this study was to characterize the undergraduate ºÚÁÏÉçÇø ratings of teaching effectiveness modeled on the traditional 36-item end-of-course evaluation form used at a predominantly white institution (PWI). Additionally, this study used critical race theory (CRT) as a way to compare the effectiveness of tenure-track faculty based on race (White, Black, and Other racial groups including Asians, Latinos, and Native Americans).

. “She does have an accent but…”: Race and language ideology in ºÚÁÏÉçÇøs' evaluations of mathematics instructors on RateMyProfessors. com." Language in Society 44 (1):35-62.

Nonnative English speakers (NNESs) who teach at English speaking, medium sized institutions in the United States (US) are often the subject of ºÚÁÏÉçÇø complaints. This study dives into the extent to which these preconceptions are consistent in ºÚÁÏÉçÇøs’ evaluations of ‘Asian’ math professors on the website RateMyProfessors.com (RMP).

General Articles

• Implicit Bias Insights as Preconditions to Structural Change
• Strike Three: Discrimination, Incentives, and Evaluation

Books on Bias

Videos and Podcasts

Books:

Podcasts:

Videos:

Articles:

• "Scaling success for low-income, first-generation in college, and/or racially minoritized ºÚÁÏÉçÇøs through a culture of ecological validation." by Kezar, A., Hallett, R. E., Perez, R. J., & Kitchen, J. A.

The Office of Transformational and Inclusive Excellence promotes communication practices that support and contribute to belonging for all members of the Miami community. Inclusive language puts our humanity at the forefront and allows everyone to feel recognized and valued. Learning about and using respectful, identity-affirming language is key to creating a welcoming environment for all members of our community. 

In alignment with strategic efforts around diversity, equity, and inclusion, this Inclusive Language Guide provides best practices and resources for language usage on 

• Forms
• Email templates
• Newsletters and 
• Other correspondence

This is a living document, and the Miami community is invited to contribute to our inclusive langauge approach. If you have any suggestions or recommendations, please email OIDI@miamioh.edu. 

.

Reading

Watching/Listening

Podcasts: 

Videos:

Books:

Articles: