Developing and Using Effective Active-Learning Exercises in Class

On Friday, October 30, the Center for Educational Resources launched ouLogo for Lunch and Learn program showing the words Lunch and Learn in orange with a fork above and a pen below the lettering. Faculty Conversations on Teaching at the bottom.r Lunch and Learn—Faculty Conversations on Teaching series with two faculty presenting on developing and using effective active-learning exercises in their classes.

Vince Hilser, professor and chair, Department of Biology led off with a presentation [presentation slides] describing how he had used active learning to help students understand a core concept, equilibrium, in his Biochemistry course. Showing his sense of humor, Hilser presented a timeline for the first semester he taught the course in 2011: August—Hilser prepares (brilliant) lectures. September, October, November—Hilser delivers (brilliant) lectures to students. January 2012—Hilser receives student evaluations and realizes that students did not learn from (brilliant) lectures.

Vince Hilser's diagram of What is Biochemistry showing inverted triangle with Facts, Reasoning Skills and Core Concept.Convinced that understanding the principle of equilibrium would enable students to truly learn it, Hilser wondered if he could help his students actually see an example of equilibrium.  A classic demonstration of equilibrium is the so-called Apple Wars: An apple tree straddles the properties of two neighbors with yards separated by fences. Every fall the tree drops its fruit and the old man and young man throw the unwanted apples into each other’s yards. Ultimately, as they are throwing, the number of apples on each side will reach a constant state, which is at equilibrium.

In Hilser’s classroom (a large lecture hall), a long line of yellow police caution tape running from front to back stood for the fence. Ping pong balls represented the apples. Students on one side were the young man and could fetch and throw with both hands, on the other side, the old man students were handicapped by being allowed to fetch and throw with the left hand only. A blast from a whistle started the students throwing ping pong balls across the fence, retrieving and throwing back. At the end of a timed sequence the balls were gathered on each side and counted. The exercise was repeated and the results echoed those of the first round. Then Hilser introduced the equation for equilibrium, filling in the results from the ping pong war demonstration to demonstrate the application of variables.  Once the students have seen in real life what equilibrium is, the equation make sense to them. They can then move on to methods of inquiry and how biological systems work.

Hilser could see from course assessments that students had a firmer grasp of the concepts. Evaluations showed that 86% of the students felt that the apple wars demonstration was effective in helping them to understand and apply the concept of chemical equilibrium. Students trusted the facts because they had experienced the proof. One student commented, “This really made me believe that organized randomness occurs in nature,” a statement that shows a high level of perception and extrapolation. Hilser’s presentation demonstrated that a good active-learning exercise can be worth more to students than a lot of words from the sage on the stage.

Todd Hufnagel, Professor in the Department of Materials Science and Engineering, presented [presentation slides] on his experience with using peer instruction in his Structure of Materials course. This class typically has 20 to 25 students.

Photograph showing students in the active learning classroom in Todd Hufnagel's Structure of Materials course.In 2011 Hufnagel received a grant from the National Science Foundation (NSF). In response to the broader impacts requirement, he decided pursue an educational research project. For Hufnagel, a core principle underscores his teaching philosophy as articulated in this quote from Herbert A. Simon: “Learning results from what the student does and thinks and only from what the student does and thinks.” The grant allowed him to test whether student learning outcomes would be better if the course was taught using an active-learning model or using a traditional lecture style by teaching it twice each way in alternating years.

He turned to a model developed by Harvard’s Professor of Physics, Eric Mazur, involving the use of concept inventories and peer learning. “A concept inventory is a criterion-referenced test designed to determine whether a student has an accurate working knowledge of a specific set of concepts.” Students are given a concept inventory test at the beginning of the semester and again at the end of the semester to measure their learning gains.

During the semester, the concept questions are used as a basis for peer instruction. Hufnagel introduces a slide with a multiple choice question. Students use their clickers to vote on what they think is the correct answer. Hufnagel shows them a histogram of all the answers. If the histogram indicates that students are confused as to the correct answer, he asks students to discuss the question in pairs of small groups.  Based on the idea that the best way to learn something is to teach it, students who know the correct answer will explain the concept to those who don’t.

After discussing the question, the students are asked to vote again. The instructor can then determine the level of understanding and proceed with a full explanation, a quick clarification, or simply affirm that the students are correct and move on to the next concept.

Is active learning better? Hufnagel’s comparison of teaching the class two ways showed that improvement in concept inventory scores in lecture version of class was 63%, for the active learning classes the improvement was 100%. He also surveyed the students about how their confidence in understanding the material.  Interestingly, the lecture course students rated their knowledge much higher than the active learning students. Hufnagel thought this is because the active learning setting makes students realize how much they don’t know, while the lecture course students aren’t as aware of what they don’t know.

Hufnagel detailed the pros and cons of using a peer-instruction approach. On the plus side, students learn more, and the instructor gets more effective feedback on what they students actually know as s/he circulates through class listening to their discussion. Hufnagel also noted that this approach was much more fun for him as a teacher. The drawbacks are that it can be more difficult to “cover the material,” and there is a significant time commitment on the part of the faculty. For the first, Hufnagel noted that the important thing is that students understand the material that is covered, and that students can be made responsible for learning some of the content outside of class. As to the second, while it is easier and faster for faculty to write lectures, once the concept questions are written, they have a long shelf life and can be re-used. In the end, the strong evidence of improved student learning gains with active learning is a compelling argument for using these teaching strategies.

Faculty attendees had questions and made comments during the discussion period. Following is a summary of some of the main points.

On ways of handling coverall “all the material,” Hufnagel assigns reading and watching videos outside of class. He finds the students like the videos as they can tackle content on their own schedule and repeat as often as needed to understand the material. There is quick four question quiz on the assignment to encourage students to both do the work and to help them retain the concepts. Research tells us that students learn by being asked to recall content frequently. He spends the first five minutes of class talking informally, perhaps brining in a topical information to increase interest, then spends the rest of the class on concept questions. Typically he will get through about six questions per class. He tells his students that he has data that show students learn better with active learning and that helps with buy-in to what may be a new learning experience.

To faculty questioning how much time had to be allocated for active learning exercises, Hilser explained that the ping pong ball demonstration takes an entire class, but it establishes an understanding of a concept so fundamental to the course that is it worth the time spent.

A question, “What about teaching the facts?  What if students don’t absorb enough factual knowledge?” led to a response by Hilser that there are many facts that are critically important as base knowledge, absolutely required facts. But he and Hufnagel agreed that beyond the core facts, students can look up information. The instructor’s role is to provide context.

One attendee noted that he has participated as an instructor in a department where lecture and active learning course covering the same content are running in parallel.  The active learning class do slightly better (10%) on exams, but they are much happier in class–more satisfaction is seen in the active learning students.

Johns Hopkins Krieger School of Arts & Sciences and Whiting School of Engineer faculty will receive email invitations for the forthcoming Lunch and Learn presentations. We will be reporting on all of the sessions here at The Innovative Instructor.

*******************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image sources: Lunch and Learn logo by Reid Sczerba, Center for Educational Resources. Other images were taken from the presentations by Vince Hilser and Todd  Hufnagel.

Leveraging Peer Instruction

This post is based on an article written for our print Innovative Instructor series.

Instructors often seek student-centered, active-learning teaching practices. These teaching methods are intended to increase student retention and engagement but the ways in which they are implemented is important for success.

Professor Todd Hufnagel, Department of Material Science and Engineering (MSE), was interested in pedagogical techniques that are potentially more effective than the traditional lecture-based format for the course, Structure of Materials.

Professor David Neufeld, Department of Physics and Astronomy, planned to change his teaching approach in a 100-level, large lecture physics course in an effort to identify students’ misunderstandings and improve comprehension of the course content.

These courses – Structure of Materials and General Physics – are gateway courses. Students’ mastery of the course learning objectives is critical to success in subsequent, advanced courses. Research demonstrates that the use of active-learning strategies can lead to increased student retention in science and engineering majors. [Felder, R., G. Felder, and E.J. Dietz. (1998) “A Longitudinal Study of Engineering Student Performance and  Retention. V. Comparisons with Traditionally-taught Students.” Journal of Engineering Education, 87(4), 469-480.  Springer, L., M. Stanne, and S. Donovan. (1999). “Effects of Small-Group Learning on Undergraduates in Science, Mathematics, Engineering and Technology: A Meta-Analysis.” Review of Educational Research. 69(1), 21-5.]

Two heads in silhouette facing with light bulb betweenIndependently, the two professors adopted the Peer Instruction method pioneered by Eric Mazur in his physics courses at Harvard University in the 1990s. Peer Instruction is a popular, research-based pedagogical tool among physics faculty; it is being used increasingly in other disciplines as well. “The basic goals of Peer Instruction are to exploit student interaction during lectures and focus students’ attention on underlying concepts,” using ConcepTests – short conceptual questions on the topic being discussed. [Mazur, E. (1997). Peer Instruction: A User’s Manual. Upper Saddle River: Prentice Hall. Page 10.]

In Mazur’s implementation of Peer Instruction, students first gain exposure to content before class by reading texts, watching videos, or completing other activities. Instructors then solicit pre-class feedback on that content, usually in the form of questions about what students found difficult or confusing.

The in-class cycle is as follows: after a brief presentation on the topic, the instructor presents a question (i.e., ConcepTest) to the class. Students individually respond after briefly reflecting on the question. The instructor then asks students to discuss their answer, with 1-2 other students who have different answers before responding again. The instructor always debriefs the question by discussing with the students the rationale behind the correct answer and providing a short lecture on the underlying concept, depending on the percentage of students who answer correctly.

Professor Hufnagel’s use of Peer Instruction starts with the introduction of a ConcepTest with four multiple-choice answers, often including an illustration. He asks the students to think about the question individually before voting using clickers. He then uses the iClicker software to show a histogram of the results. Students talk with their neighbors for a few minutes and then vote again. Professor Hufnagel shows the new results, explaining which answer is correct and why. The depth of explanation depends on how well the class is mastering the concept. If, based on the histogram, the class has not mastered the concept; he will ask another question on the same concept, repeating as necessary.

In Professor Neufeld’s physics course, students watch online content before class as a replacement for the traditional lecture. By flipping the lecture, Professor Neufeld can spend class time using ConcepTests. If there is general agreement about the correct answer after the first vote, he moves on to the next question. If there is substantial disagreement, then students are directed to discuss their answers for 1-2 minutes with those sitting around them. After a second vote, Professor Neufeld asks students who changed their answers to explain why they did so. This often leads to further class discussion.

In Professor Hufnagel’s course, students were administered a concept inventory at the beginning and end of a semester during which he lectured and the semester during which he employed Peer Instruction. The concept inventory included 20 questions measuring student mastery of the course learning objectives. During the semester in which he used Peer Instruction, student gains were twice those of the students in the semester in which he primarily lectured. Additional assessments will be conducted in the future to see if these gains are replicated.

Professor Neufeld used the Force Concept Inventory (FCI), a standard assessment instrument used in university-level Newtonian physics. Student learning gains measured by the FCI tend to be higher in courses with active-learning strategies compared to traditional lecture courses. In Professor Neufeld’s class, results were similar to those reported by faculty at other universities using traditional lecture methods. The gain was not what he hoped, but this is not uncommon. Sometimes the method requires a few tweaks. While disappointed, he suspects the results reflect the fact that it was his first time using Peer Instruction. He is committed to teaching with Peer Instruction again, and the FCI will be used in future semesters to determine if gains increase as he acquires more experience.

One of the challenges of using Peer Instruction is that instructors cannot script class time as they can with a lecture. It is difficult to estimate how many ConcepTests can be completed during class because the length of follow-up student discussions varies. Despite some concerns about how to structure class time, both Hufnagel and Neufeld were pleased with how engaged students were during class discussions.

The first time you try Peer Instruction can be challenging, especially when creating or selecting ConcepTests. To assist instructors, Julie Schell and Eric Mazur established The Peer Instruction Network (https://www.peerinstruction.net), a database of Peer Instruction users with links to their available ConcepTests.

Peer Instruction can be used as one of several active-learning strategies during class time. For example, at several stages in Professor Hufnagel’s course, groups of students spent class time working out detailed problems that traditionally might have been presented as part of a lecture. Professor Hufnagel mentors student groups as needed during these exercises.

Additional resources:
• Mazur, Eric. Peer Instruction: A User’s Manual. Prentice Hall, 1997
• Turn to Your Neighbor Blog. The Official Blog of Peer Instruction: http://blog.peerinstruction.net 
• Article on “flipping the classroom”, Lectures On Demand: http://www.cer.jhu.edu/ii/InnovInstruct-Ped_LectOnDmnd.pdf
• Article on “clickers”, In-Class Voting (‘Clickers’):
http://www.cer.jhu.edu/ii/InnovInstruct-Tech_Clickers.pdf

Michael J. Reese, Associate Director, CER, Johns Hopkins University
Mike Reese is the associate director of the Center for Educational Resources and a doctoral student in the Department of Sociology.

Julie Schell, Educational Researcher, Harvard University
Dr. Julie Schell is the senior educational researcher within the Mazur Group at Harvard University and an instructional designer at the Center for Teaching and Learning at the University of Texas at Austin. She is an expert in innovative flipped teaching and Peer Instruction. She co-founded the Peer Instruction Network and authors the official Peer Instruction blog, Turn to your Neighbor.


Image Source: © 2013 Reid Sczerba