Peer Review of Teaching : Sharing Best Practices 2015

In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key aspects of the interactive peer review of teaching session we facilitated at STLHE 2014. We provide examples generated by participants of that session, as well as participants of Centre for Teaching, Learning and Technology workshops on peer review of teaching. We share future steps for the Peer Review of Teaching Program at UBC.


Introduction ow can you positively influence student learning by conducting peer review of teaching?
In what ways do you support colleagues who ask you to sit in on their classes and provide them with feedback?
Having been involved in different developmental stages of the Peer Review of Teaching (PRT) Program at the University of British Columbia (UBC), we led an interactive session on this topic at STLHE 2014, intended for people who have conducted peer reviews of teaching.Our goals were to have participants explore classroom peer reviews from a variety of perspectives and to leave the session being able to help colleagues at their institutions and contexts in new ways.
In this paper, we will provide an overview of our PRT Initiative at UBC, describe key elements of the conference session, and place peer review in the context of related work.

What do we mean by Peer
Review of Teaching?Chism (2007) defines peer review of teaching as a form of evaluation designed to provide feedback to instructors about their teaching in order to foster improvement or make personal and/or career decisions.Related terms are summarized by Cassidy and Lee (2011).Peer review of teaching occurs along a continuum from informal to formal.Informal peer review, usually conducted for developmental purposes, is often defined as formative peer review.Formal peer review, usually conducted for evaluation purposes, is defined as summative peer review.The terms formative and summative evaluation, first introduced by Scriven (1973) within the context of program evaluation, have now been widely adopted in the evaluation of teaching.
As noted in Cassidy and Lee (2011), The Center for Excellence in Learning and Teaching at Iowa State University conducted a literature review of peer evaluation of teaching, with links to best H practices.Peer review has gained prominence internationally and for online teaching as well, such as through the Australian Learning and Teaching Council.While programs of peer review of teaching now take place at several institutions (for example: University of Waterloo, Kansas State University, University of Nebraska, etc.), it was less common when we started this process at UBC.
Classroom peer reviews can be a transformative process for both reviewee and reviewer as it provides an opportunity for the reviewee to have feedback on their teaching, and it exposes the reviewer to different styles and techniques of teaching.Cassidy and Johnson (2006) designed and first implemented a 4-hour workshop, Developing your skills as a Peer Reviewer: Introductory workshop.The model, a three-part process, involves a preobservation meeting, class observation, and a postobservation meeting.Notes taken at each of the three stages comprise a report that is provided to the reviewee.They may wish to include it in their teaching dossier or application for a job, promotion and/or tenure.Additional steps such as meeting with the students, and/or post-observation meeting reflection have been described elsewhere (Buskist, Ismail, & Groccia, 2014;Hitchens, 2014).
Based on the Instructional Skills Workshop (ISW) model (http://iswnetwork.ca/about/iswprogram-in-detail/), the process is reviewee-focused and currently informs both formative and summative peer review of teaching processes.The model that Cassidy and Johnson (2006) developed and that Centre for Teaching, Learning and Technology (CTLT) continues to use fits the collaborative model described by Gosling (2014) where teaching is improved through constructive facilitated dialogue and self and mutual reflections.Reviewees may choose any aspect(s) of course design, teaching, student learning and/or assessment to be included during the review process.

History of the Peer Review of Teaching Initiative at the University of British Columbia
As will be explained below, the Formative PRT Program is one part of the broader Peer Review of Teaching Initiative at our institution.Peer Review began at UBC in 2006 as a request by one faculty member in Dentistry with one-year funding from the campus-wide Teaching and Learning Enhancement Fund.Cassidy and Johnson (2006), working at the Centre for Teaching and Academic Growth (TAG), now called the CTLT, designed a 4-hour training workshop called Developing your skills as a Peer Reviewer: Introductory workshop.To this day, we recommend that peer reviewers participate in this workshop to practice techniques they will use in a peer review.Thinking to the future, Cassidy and Johnson (2006) also designed an Advanced Workshop for trained colleagues who had completed several peer reviews.After this initial work, additional funding in 2009 and 2010 allowed workshops to be offered to a greater number of Faculties.
Some specialized workshops followed, such as for faculty within Pharmaceutical Sciences, and Teaching Assistants in Physics, Faculty of Science (co-facilitated by a Physics Teaching Assistant).A version of the workshop was modified as part of the Peer Teaching Network within Faculty of Science's Science Centre for Learning and Teaching (Cassidy & Lee, 2011).
As a broader Initiative, in 2008, a working group was tasked with developing principles and procedures for the formal summative evaluation of teaching, to inform decision making regarding reappointment, promotion and tenure.Principles include accuracy, integrity, transparency, diversity, credibility, and usefulness (Egan, 2010).
From 2010-2011, the working group initiated a program to train nominated representatives from each Faculty in the principles and practice of the summative peer review of teaching process.Those faculty members have been actively involved as leaders of the Summative PRT Program across UBC.
Today, each Faculty has developed and implemented a procedure suited for their individual needs.In some Faculties formative peer review of teaching is a mandatory process while in other Faculties it continues to be offered on a volunteer basis.
CTLT offers the Developing your skills as a Peer Reviewer: Introductory workshop three times per year to faculty members interested in learning more about both the formative and summative PRT process, as well as to those interested in learning the necessary skills needed in the peer review process.All interested participants are then invited to join a team of volunteer reviewers of the Formative PRT Program, described in more detail below.The three authors of this paper have all been reviewers in this program.
We also lead customized versions of the workshop on request.Over the past two years, we have designed and led such workshops for the Faculties of Forestry, Land and Food Systems, Law, Pharmacy, Sauder School of Business and Science as well as departments and other units such as Asian Studies, Botany, Cellular and Physiological Sciences, Electrical Engineering, Human Kinetics, Pathology, and Physics (for Teaching Assistants).
Additionally, over the past year, one of us (Golparian), in collaboration with CTLT colleagues, designed and implemented a customized PRT Program for Asian Studies, including reviewer training workshop development and facilitation, resources development, and program coordination.The program which consists of a 1.5 year long cycle of two formative peer reviews and a summative peer review, is required by all lecturers chosen to undergo this process.Golparian continues to offer consultation on the coordination of this program in her new role at CTLT.Now near the end of the second part of the cycle, Golparian has been in consultation with reviewers, reviewees and the department head, with program evaluation and redesign taking place throughout the process.The third phase of the first cycle, Summative reviews will take place in the fall of 2015.In the meantime, the second round of the program started in January 2015 and the feedback from the first round of reviews (from both reviewers and reviewees) will inform the modification and the redesign of the program for the second round.
CTLT has also been actively involved in Summative PRT processes at UBC. Leaders within faculties meet twice a year to discuss successes and challenges and to modify/redesign their implemented processes.
In 2014, in consultation with Dr. Simon Bates, CTLT Academic Director, one of us (Golparian) developed a program evaluation survey for formative and summative peer review of teaching processes at UBC.The survey, which was sent out to all faculty members at UBC, received 100 responses.These responses provide us with a list of challenges and opportunities that reviewers and reviewees have experienced as part of the Summative and Formative PRT processes, and highlight several action items including the need for clarification and better communication around the PRT process (i.e.: the importance of pre and post observation meetings; Faculty specific standards).Results, presented to the leaders of the Summative PRT Initiative, are being used to make decisions around the redesign of each of their faculties' peer review processes.

The Process of the Formative Peer Review of Teaching Program
The PRT workshop that we offer at the CTLT is designed to support reviewers and reviewees in both Summative and Formative PRT processes.The workshop provides reviewers with an opportunity to acquire and practice skills needed to conduct peer reviews of teaching, and it provides reviewees with an opportunity to familiarize themselves with the peer review of teaching as well as their roles and responsibilities throughout the process.
The processes for Formative (for developmental and mentoring purposes) and Summative (for reappointment and hiring purposes) reviews are different in each Faculty and/or department, however all processes (should) involve a pre-observation meeting, an observation and a postobservation meeting.The following explains a generic process for a formative peer review of teaching: To request a formative peer review of teaching, reviewees usually contact potential peer reviewers who would be listed on the department website.In certain cases reviewees are assigned to reviewers by the department and are then asked to communicate/connect with them.Formative reviews are often voluntary, however, in some departments, they are mandatory.
Whether the formative peer review is voluntary or mandatory, a reviewee contacts reviewers and provides the following information: • Contact information If the reviewee would like the reviewer to conduct a classroom observation, the reviewee then suggests possible dates, or a time frame and talk or email to set up details of a pre-observation meeting, classroom observation(s), and a post-observation meeting.
After the classroom observation, the reviewees reflect on what happened during the class and whether they feel they accomplished their objectives for the day.They record any issues or events that they would like to discuss with their peer reviewer.During the post-observation meeting, they review, reflect on, and possibly also respond to the peer reviewer's feedback report.Finally, reviewees decide whether or not to submit the peer reviewer's report (along with their own) to their employment file and/or to include it in their teaching portfolio/dossier.

Key Elements of the STLHE Session
We involved participants throughout the session, at the same time modelling some of the techniques, especially active listening and role-playing that form part of the workshop to become a peer reviewer.We invite you to modify the elements below for your own use.

Index Card Question
As people came into the room, we wanted to involve them right away.We asked them, in 10 words or less (noting that it would be shared with others), to write their answer to the following question on an index card: How does peer review of teaching (PRT) help students learn?

Role Play
We modelled a typical interaction between reviewer and reviewee in the pre-observation meeting.We did this to set the tone for the session and show in a real way how the pre-observation meeting works.We also wanted participants to reflect and draw on their personal experience to ask questions and share their experiences (Mundy & Chan, 2013).

Debrief and Overview of the Process
We explained that the pre-observation meeting is one of the three parts of the PRT process.A hand-out that noted each part, with links was distributed (Cassidy & Johnson, 2010).Since the design and implementation of the customized program in Asian Studies, CTLT has been contacted by a few other departments at UBC for support around the development of departmentspecific PRT Programs.We anticipate that other departments and faculties will also be contacting us for support around PRT Program design and additional customized workshops and programs.This process will be customized to suit the needs of individual departments (Toth & McKey, 2010).
We will also need to draw on the experiences from current active peer reviewers to understand modifications and adaptations made to the 3-step process originally developed.For instance, one of us (Chan) has conducted Small Group Instruction Feedback as requested by a reviewee, immediately after her classroom observation.In other cases preliminary reports were prepared prior to the postobservation meetings and subsequently revised after the meeting with the reviewee.These modifications, as well as those documented by Bell and Cooper (2013), Buskist et al. (2014), andHitchens (2014) should inform future development of the Peer Review of Teaching process.
CTLT is also in the process of developing a Peer Review Program for Graduate students, consisting of two components: Peer Review of Teaching and Peer Review of Presentations.The goal is to support graduate students in improving their teaching and presentations skills.Future information about this program can be found on the CTLT website.CTLT will also continue to share its experiences with the wider Peer Review of Teaching community and engage in conversations with other Educational Developers who are actively involved in the design, development and evaluation of such programs.