Peer Review of Teaching

Teaching Excellence in Public Health | December 19th, 2018


Peer review of teaching is a process destined to improve instructional effectiveness of faculty and constitutes part of instructional mentorship and development. In some instances, schools/programs use summative evaluations to inform personnel decisions. Broadly, the process usually entails a preliminary interview with the teaching faculty, class observation, and a post observation meeting summarizing strengths and weaknesses. Class observations are directed to evaluate knowledge, instructional materials, class organization, presentation form and substance, teacher and student interaction, student participation, and assessment practices. Time and effort, potential bias, and collegiality issues typically limit peer review of teaching. Nonetheless, this process remains one of the methods to improve the quality of instruction.

The following summary tables present information retrieved from ASPPH Academic Affairs members. Information on peer review of teaching was requested from members, with a focus on both process and observation tools used. A total of 8 schools/departments responded to the request. Colorado School of Public Health provided information that they had gathered as part of a similar exercise. The table below summarizes processes and tools from 16 schools/programs, and provides information on an additional tool that is not classified as used by any school/program. In general, tools vary, some schools are using qualitative measures, some quantitative, and some a mixture of both approaches. Most schools use a pre observation assessment to evaluate materials, some including meeting with the instructor. In general, all observation tools address objectives, structure of session, and ability to engage the students. Some measures, however, assess not only the instructor’s behavior but the students’ behavior in class as well. While most programs did not specify if the process was used only for formative purposes, data from the ASPPH report, Innovations on Pedagogy survey, indicates that 33% of respondents (n=87) use peer reviews as a method for evaluation for promotion and tenure. This report also highlights that peer review of teaching is available in 47% of the schools/programs and reports that 37% of respondents find peer review very beneficial.

Full Description

Download All Measures

Colorado School of Public Health

Process used 3 step:

1. Pre-observation conference – with interview guide focused on goal and expectation of class, students, and teaching style

2. Classroom observation

3. Post-observation conference – with interview guide focused on reflections, including areas for improvement

Tool used Sorcinelli Observation Guide
Domains assessed as part of the observation Open-ended questions

  • Knowledge of subject matter (mastery)
  • Organization and clarity (structure, teaching strategy and closure)
  • Instructor-student interaction – discussion, kind of questions, level of questions, what is done with the questions and responses
  • Presentation and enthusiasm
  • Student behavior
  • Overall
Final purpose Class observation notes and post-observation go to the instructor and are shared with departmental chair or committee

Importance of emphasizing the constructive nature of the observation

University of North Carolina Gillings School of Global Public Health

Process used Same 3 step process as Colorado School of Public Health, listed above
Tool used Adapted from Sorcinelli
Domains assessed as part of the observation N/S*
Final purpose N/S

Yale School of Public Health

Process used In-class behavioral assessment of what the instructor and student are doing each minute from start to finish of the session
Tool used Modified version of Classroom Observation Protocol for Undergraduate STEM (COPUS) (Smith MK, Jones FHM, Gilbert SL, and Wieman CE. 2013. The Classroom Observation Protocol for Undergraduate STEM (COPUS): a New Instrument to Characterize University STEM Classroom Practices. CBE‐Life Sciences Education, Vol 12(4), pp. 618‐627)
Domains assessed as part of the observation Every two minutes student and instructor behaviors should be checked off under the following categories:

  • Student behavior: listening and taking notes, problem-solving, discussing in group, working in groups, answering questions, asking questions, engaged in class discussion, making a prediction or experiment, presentation by student, quiz/test, or waiting
  • Instructor behavior: lecturing, writing, follow up, posting questions, listening, or answering questions, guiding the class, one on one extended discussion with one student, showing a demo experiment or simulation, administration, or waiting
Final purpose Class observation and subsequent consultation are shared only with the instructor for formative purposes

Emory University Rollins School of Public Health

Process used In-class observation
Tool used N/S
Domains assessed as part of the observation 3 areas evaluated in a Likert scale (yes, somewhat, no , N/A)

  • Lesson organization
  • Lesson implementation – including focus on application, 7 areas
  • Delivery and Style – 6 areas
  • Strengths
  • Weaknesses and areas of improvement
Final purpose N/S

Penn State Department of Public Health Sciences

Process used Online assessment for online courses
Tool used Adapted from Penn State
Domains assessed as part of the observation Feasibility of finding and accessing the information (syllabus, calendar of assignments, courses, quizzes, examinations, requirements of synchronous or asynchronous courses)
Final purpose N/S

Penn State Department of Public Health Sciences

Process used Peer Review Activity Guide on process and tools including a first phase for selection and scheduling of peer observations

1. Pre observation: lesson plan, teaching style, focus of observation instructor response to student evaluations

2. Review of student evals and syllabus

3. Class observation

4. Post observation
a. student focus groups
b. post-observation assessment – instructor reflection (on lesson and teaching style)

5. Evaluation: discussion and improvement plan

Tool used Penn State
Domains assessed as part of the observation Likert scale

  • Variety and pacing of instruction
  • Organization
  • Presentation skills
  • Clarity
  • Content knowledge
  • Rapport
  • General
  • Comments on teaching methods and instructional strategies
  • Summary checklist
Final purpose Appears to affect promotion and tenure

UC Berkley School of Public Health

Process used Observation – live class
N/S
Domains assessed as part of the observation Overall open-ended comments on

  • Command
  • Clarity
  • Quality
  • Effectiveness use of teaching aids
  • Encouragement of use of feedback
  • Comments
Final purpose N/S

University of Central Florida College of Health and Public Affairs

Process used 1. Pre-meeting session: establish teaching philosophy and style

2. Observation of teaching

Tool used N/S
Domains assessed as part of the observation List of items suggested to observe

  • Familiarity with the subject – interest & current knowledge
  • Teaching presentation used – clarity, organization, preparation, speaking voice, delivery and manner
  • Teaching methods used – flexibility, variety, appropriateness, audiovisual aids
  • Classroom management – from timeliness to engagement and discussion
  • Creativity – adjusts to the learning style of students, enthusiasm
  • Availability – answers questions
  • Purpose and plan – outline at the beginning
  • Strengths
  • Weaknesses
  • Summary
Final purpose N/S

University of Arizona Mel and Enid Zuckerman College of Public Health (a)

Process used Observation tool
Tool used Adapted from Baskamp and University of Minnesota
Domains assessed as part of the observation Organized in 8 areas, but only 20 items within these areas are selected for observation

Likert scale on 4 points (very evident, evident mostly, evident during a portion of the class, not evident at all)

  • Lesson organization (other items included as opportunities to apply, frequent checks on student performance)
  • Content and knowledge
  • Relevance
  • Presentation
  • Instructor-student interaction
  • Collaborative learning techniques – focus on group task promoting learning objectives and engagement of non-engaged students
  • Lesson implementation – use of questions, probing, adequate pacing, promotion of critical thinking
  • Instructional material – what and how
  • Student responses – student behavior
  • What students learned
  • Strengths and weaknesses
Final purpose N/S

University of Arizona Mel and Enid Zuckerman College of Public Health (b)

Process used Observation template
Tool used N/S
Domains assessed as part of the observation Open-ended, but timed

Class activities were considered ahead of time as important for evaluation

Final purpose N/S

University of Minnesota School of Public Health

Process used 1. Observation of teaching

2. Peer review of class assignments and assessments: 4 p Likert scales

3. Peer review of examples of student performance: 4 p Likert scale (appears to be overall and includes grade distribution)

4. Peer review of syllabus

Tool used Peer Observation of Teaching protocol
Domains assessed as part of the observation Observation of Teaching – open-ended

Context or Background – setting

Observation areas:

1. Instructor goals

2. Significance of class activities

3. Student engagement

4. Examination of student achievement goals

Best practices: Assessments

Final purpose N/S

Skaggs School of Pharmacy and Pharmacological Studies (SSPPS)

Process used 5 steps:

1.
a. lesson overview: requirement from students, description of in-class learning strategies**, description of the assessments that will be used
b. instructional material overview

2. Observation

3. Co-assessor analyses and coordination
a. co-assessors meet to discuss most prominent points for discussion with the instructor: strengths & weaknesses, prior observations, and reassessment determination
b. post-observation conference

4. Re-observation

5. Incorporation of assessor’s comments based on observation

Tool used SSPPS Peer Teaching Assessment
Domains assessed as part of the observation Observation scale based on time of session

Learning objectives

Learning strategies**

Student engagement

Final purpose

**Active learning strategies: lecture, case studies, clickers, think pair and share, minute writes, muddiest point, notes exchange, Socratic questioning, debates, fishbowl, role play, student presentations, games, online supplementation, other

Albany State University of New York School of Public Health

Process used Peer observation checklist
Tool used Peer observation template
Domains assessed as part of the observation Observation – all based on instructor behavior

Check off if observed or not and provide comments on the following areas:

  • Clear communication
  • Examples and communication
  • Activities for student engagement
  • Challenges for students to think critically
  • Activities to assess understanding
  • Student to student interaction
  • Links to previously learned concepts
  • Use of visual and handouts
  • Requirement of students to be active
Final purpose N/S

Thomas Jefferson University College of Population Health

Process used Observation
Tool used Kent State College of Public Health – evaluation form
Domains assessed as part of the observation 5 point Likert scale (from excellent to poor)

  • Assesses number of students present
  • Overall experience
  • Assessment of material on overall level of difficulty and workload
  • Assessment review
  • Physical conditions of room
  • Student respect
  • Questions with ratings on strongly agree to strongly disagree, based on the type of class (lecture, pbl, or Socratic/discussion-based)
  • Knowledge of the class
  • Narrative section for the observer
Final purpose N/S

University of Maryland School of Public Health

Process used Process:

1. Pre-class meeting – course goals, strategies, and questions to get feedback on

2. Classroom – at least one, but more if it has multiple components observation

3. Post-observation meeting – discussion to enhance teaching effectiveness student engagement, course efficiency, list of questions to guide the discussion (around strengths and weaknesses)

4. Synthesis and documentation both the instructor and the observer can prepare a summary to reflect on the three meetings

Tool used Peer Teaching Observation Guide
Domains assessed as part of the observation Class observation ranked in Likert scale (yes, mostly, somewhat, no)

  • Logistics
  • Start and end on time
  • Well prepared
  • Class was used effectively
  • The student experience
  • Students were actively engaged in class
  • Questions were addressed
  • Positive environment
  • Tools were used effectively
Final purpose N/S

Wayne State University Department of Family Medicine and Public Health Sciences (from Vanderbilt)

Process used N/S
Tool used Peer-to-peer Classroom Observation form
Domains assessed as part of the observation Observation form – observer must check off on categories:

  • Objectives
  • Evident to students?
  • Target for level?
  • Instruction practices (coaching, discussion, hands-on, learning centers, modeling, presentation, providing directions, practice opportunities, teacher directed Q and A, testing, lecture)
  • Research-based instruction strategies (similarities and differences, summarizing, reinforcing, homework, mono-linguistic presentation, cooperative learning, testing hypotheses, questions, feedback)
  • Student actions
  • Instructional materials
  • Level of student work (based on Bloom’s)
  • Level of class engagement
  • Class environment
  • Evidence to responding to learning needs
Final purpose N/S

University of Miami Department of Public Health Sciences

Process used Observation, post-observation meeting, written summary
Tool used Teaching Observation Form
Domains assessed as part of the observation 6 point Likert scale (improvement necessary, effective, highly effective)

  • Lecture-based
  • Introduction – clear objectives stated, assessment of needs, gained attention and motivation
  • Body of lecture – clear organization, instructional material, and methods, use of transitions
  • Conclusion
  • Teacher dynamics – effective communication, engagement, encouraged further learning, well-prepared
  • Strengths and recommendations
Final purpose For teaching development only

Not Specified (from Colorado School of Public Health)

Process used Part A: to be completed before class – review of syllabus (clear goals and objectives, well planned activities, high expectations)

Part B: during class visit

Part C: completed after class – summary of teaching effectiveness (strengths and weaknesses)

Tool used Peer observation of teaching effectiveness
Domains assessed as part of the observation
  • Number of students present – type of class
  • Evidence of student learning – ask questions, answer questions, solve problems, present material, summarize ideas
  • Teaching style – knowledge, enthusiasm, creates comfortable teaching environment, well-organized, clear communication, interaction with students, high expectations, encourages participation, teaches students how to think, cultural aspects are infused, assesses student learning throughout the class period, and adapts teaching to in-class assessment
Final purpose N/S

Stony Brook University Program in Public Health (no form provided)

Process used 1. Student self-assessment of competency attainment (pre-course vs. post-course assessment)

2. Student end-of-semester course evaluation data

3. Student focus group data at the end of each course

4. Program director observation of teaching

5. Curriculum committee review of data collected (1-4 above)

Tool used N/S
Domains assessed as part of the observation Course content (meeting competencies)

  • Instructor presentation style and effectiveness
  • Student perceptions of adequacy of course content/materials in regards to competencies
  • Instructor-student interactions
  • Student behaviors
Final purpose 1. Data/feedback are shared with instructors to enhance/improve teaching

2. Program Director uses data to formulate comments about teaching for faculty promotion support letter

*N/S: not specified

Compiled by Viviana E. Horigian, M.D. University of Miami, Department of Public Health Sciences. Updated 8/3/2018