Developing and Using Effective Active-Learning Exercises in Class

On Friday, October 30, the Center for Educational Resources launched ouLogo for Lunch and Learn program showing the words Lunch and Learn in orange with a fork above and a pen below the lettering. Faculty Conversations on Teaching at the bottom.r Lunch and Learn—Faculty Conversations on Teaching series with two faculty presenting on developing and using effective active-learning exercises in their classes.

Vince Hilser, professor and chair, Department of Biology led off with a presentation [presentation slides] describing how he had used active learning to help students understand a core concept, equilibrium, in his Biochemistry course. Showing his sense of humor, Hilser presented a timeline for the first semester he taught the course in 2011: August—Hilser prepares (brilliant) lectures. September, October, November—Hilser delivers (brilliant) lectures to students. January 2012—Hilser receives student evaluations and realizes that students did not learn from (brilliant) lectures.

Vince Hilser's diagram of What is Biochemistry showing inverted triangle with Facts, Reasoning Skills and Core Concept.Convinced that understanding the principle of equilibrium would enable students to truly learn it, Hilser wondered if he could help his students actually see an example of equilibrium.  A classic demonstration of equilibrium is the so-called Apple Wars: An apple tree straddles the properties of two neighbors with yards separated by fences. Every fall the tree drops its fruit and the old man and young man throw the unwanted apples into each other’s yards. Ultimately, as they are throwing, the number of apples on each side will reach a constant state, which is at equilibrium.

In Hilser’s classroom (a large lecture hall), a long line of yellow police caution tape running from front to back stood for the fence. Ping pong balls represented the apples. Students on one side were the young man and could fetch and throw with both hands, on the other side, the old man students were handicapped by being allowed to fetch and throw with the left hand only. A blast from a whistle started the students throwing ping pong balls across the fence, retrieving and throwing back. At the end of a timed sequence the balls were gathered on each side and counted. The exercise was repeated and the results echoed those of the first round. Then Hilser introduced the equation for equilibrium, filling in the results from the ping pong war demonstration to demonstrate the application of variables.  Once the students have seen in real life what equilibrium is, the equation make sense to them. They can then move on to methods of inquiry and how biological systems work.

Hilser could see from course assessments that students had a firmer grasp of the concepts. Evaluations showed that 86% of the students felt that the apple wars demonstration was effective in helping them to understand and apply the concept of chemical equilibrium. Students trusted the facts because they had experienced the proof. One student commented, “This really made me believe that organized randomness occurs in nature,” a statement that shows a high level of perception and extrapolation. Hilser’s presentation demonstrated that a good active-learning exercise can be worth more to students than a lot of words from the sage on the stage.

Todd Hufnagel, Professor in the Department of Materials Science and Engineering, presented [presentation slides] on his experience with using peer instruction in his Structure of Materials course. This class typically has 20 to 25 students.

Photograph showing students in the active learning classroom in Todd Hufnagel's Structure of Materials course.In 2011 Hufnagel received a grant from the National Science Foundation (NSF). In response to the broader impacts requirement, he decided pursue an educational research project. For Hufnagel, a core principle underscores his teaching philosophy as articulated in this quote from Herbert A. Simon: “Learning results from what the student does and thinks and only from what the student does and thinks.” The grant allowed him to test whether student learning outcomes would be better if the course was taught using an active-learning model or using a traditional lecture style by teaching it twice each way in alternating years.

He turned to a model developed by Harvard’s Professor of Physics, Eric Mazur, involving the use of concept inventories and peer learning. “A concept inventory is a criterion-referenced test designed to determine whether a student has an accurate working knowledge of a specific set of concepts.” Students are given a concept inventory test at the beginning of the semester and again at the end of the semester to measure their learning gains.

During the semester, the concept questions are used as a basis for peer instruction. Hufnagel introduces a slide with a multiple choice question. Students use their clickers to vote on what they think is the correct answer. Hufnagel shows them a histogram of all the answers. If the histogram indicates that students are confused as to the correct answer, he asks students to discuss the question in pairs of small groups.  Based on the idea that the best way to learn something is to teach it, students who know the correct answer will explain the concept to those who don’t.

After discussing the question, the students are asked to vote again. The instructor can then determine the level of understanding and proceed with a full explanation, a quick clarification, or simply affirm that the students are correct and move on to the next concept.

Is active learning better? Hufnagel’s comparison of teaching the class two ways showed that improvement in concept inventory scores in lecture version of class was 63%, for the active learning classes the improvement was 100%. He also surveyed the students about how their confidence in understanding the material.  Interestingly, the lecture course students rated their knowledge much higher than the active learning students. Hufnagel thought this is because the active learning setting makes students realize how much they don’t know, while the lecture course students aren’t as aware of what they don’t know.

Hufnagel detailed the pros and cons of using a peer-instruction approach. On the plus side, students learn more, and the instructor gets more effective feedback on what they students actually know as s/he circulates through class listening to their discussion. Hufnagel also noted that this approach was much more fun for him as a teacher. The drawbacks are that it can be more difficult to “cover the material,” and there is a significant time commitment on the part of the faculty. For the first, Hufnagel noted that the important thing is that students understand the material that is covered, and that students can be made responsible for learning some of the content outside of class. As to the second, while it is easier and faster for faculty to write lectures, once the concept questions are written, they have a long shelf life and can be re-used. In the end, the strong evidence of improved student learning gains with active learning is a compelling argument for using these teaching strategies.

Faculty attendees had questions and made comments during the discussion period. Following is a summary of some of the main points.

On ways of handling coverall “all the material,” Hufnagel assigns reading and watching videos outside of class. He finds the students like the videos as they can tackle content on their own schedule and repeat as often as needed to understand the material. There is quick four question quiz on the assignment to encourage students to both do the work and to help them retain the concepts. Research tells us that students learn by being asked to recall content frequently. He spends the first five minutes of class talking informally, perhaps brining in a topical information to increase interest, then spends the rest of the class on concept questions. Typically he will get through about six questions per class. He tells his students that he has data that show students learn better with active learning and that helps with buy-in to what may be a new learning experience.

To faculty questioning how much time had to be allocated for active learning exercises, Hilser explained that the ping pong ball demonstration takes an entire class, but it establishes an understanding of a concept so fundamental to the course that is it worth the time spent.

A question, “What about teaching the facts?  What if students don’t absorb enough factual knowledge?” led to a response by Hilser that there are many facts that are critically important as base knowledge, absolutely required facts. But he and Hufnagel agreed that beyond the core facts, students can look up information. The instructor’s role is to provide context.

One attendee noted that he has participated as an instructor in a department where lecture and active learning course covering the same content are running in parallel.  The active learning class do slightly better (10%) on exams, but they are much happier in class–more satisfaction is seen in the active learning students.

Johns Hopkins Krieger School of Arts & Sciences and Whiting School of Engineer faculty will receive email invitations for the forthcoming Lunch and Learn presentations. We will be reporting on all of the sessions here at The Innovative Instructor.

*******************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image sources: Lunch and Learn logo by Reid Sczerba, Center for Educational Resources. Other images were taken from the presentations by Vince Hilser and Todd  Hufnagel.

Where Goes the Lecture, Reprise

Black and white image of universal sign figure at podium with a point, overlaid with red prohibited sign -- a circle with a question mark over it.Lectures were the topic of the last post, and usually I adhere to the adage that variety is the spice of life. Lectures, however, have been a hot topic in education news recently, and there was a comment on the previous post with a link that I wanted to share. Therefore, lectures, take two.

First, Illysa Izenberg, lecturer for the Center for Leadership Education in the Whiting School of Engineering at Johns Hopkins University, commented on the previous post, “I think maybe the best way to teach may be to teach in many different ways.” She wrote an article for Faculty Focus (a free e-newsletter and website that publishes articles on effective teaching strategies for the college classroom) titled, The Eight-Minute Lecture Keeps Students Engaged, August 31, 2015. Izenberg writes: “When I began teaching in 2006, I assumed that students could read anything I say. Therefore, my classes consisted of debates of, activities building on, and direct application of theories taught in the readings—no lectures. But I noticed that students had difficulty understanding the content in a way that enabled accurate and deep application without some framing from me. In short, I needed to lecture—at least a little. This is when I began the eight-minute lecture.” She then describes how to prepare students for using this methodology and how to implement it in your course. An example from a course she taught provides specificity. Although this technique might be more difficult to apply in a traditional large lecture hall, it would work well in any classroom space that allows for flexible seating arrangements.

On October 17, 2015, Molly Worthen, an assistant professor of history at the University of North Carolina, Chapel Hill, and a contributing opinion writer for the New York Times, wrote an op-ed piece for the Times Sunday Review, Lecture Me. Really. Worthen pushes back against the “active learning craze” in favor of the traditional lecture, especially for humanities courses. “Lectures are essential for teaching the humanities’ most basic skills: comprehension and reasoning, skills whose value extends beyond the classroom to the essential demands of working life and citizenship.” Students should be exposed to “absorbing a long, complex, argument” that requires them to “synthesize, organize and react as they listen.” Along with this she cites the value of learning hand-written note-taking skills, which recent research has shown help students better remember course content.

Rebecca Schuman, an education columnist for Slate, responded to Worthen on October 21, 2015 with Professors Shouldn’t Teach to Younger Versions of Themselves, offering a reality check. Worthen’s concept represents an ideal situation with ideal students, Schuman says, but those may not be the students in your classroom. “The American professoriate shouldn’t gear their courses exclusively to students who are so bright and motivated they could learn the material on their own. They should also include components designed for the average, real, very-much-not-ideal student they will actually meet.”

Regardless of what you choose as the method for content delivery, you will want to consider classroom climate and teaching to diversity, making sure that you are fostering an inclusive classroom.

*********************************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Image remixed from Pixabay.com images

Do Your Students Understand the Assignment?

An article in The Chronicle of Higher Education caught my attention this past week: The Unwritten Rules of College by Dan Berrett (September 21, 2015), profiled art history professor Mary-Ann Winkelmes and her quest to help students learn how to learn.

Black and white line drawing of the upper torso of a young male in a thinking pose. Two question marks are on either side of his head.Winkelmes, the former director of Harvard’s Derek Bok Center for Teaching and Learning, has also trained faculty in teaching at the University of Chicago, the University of Illinois at Urbana-Champaign, and, currently, at the University of Nevada, Las Vegas where she is principal investigator of  Transparency in Teaching and Learning in Higher Education. This project seeks “to improve higher education teaching and learning experiences for faculty and students through two main activities:

  • promoting students’ conscious understanding of how they learn, and
  • enabling faculty to gather, share and promptly benefit from current data about students’ learning by coordinating their efforts across disciplines, institutions and countries.

A primary focus for Winkelmes has been reaching out to students who are first generation college students or otherwise may not understand what she calls “the secret, unwritten rules of how to succeed in college.” [See: Winkelmes, Mary-Ann. “Equity of Access and Equity of Experience in Higher Education.” National Teaching and Learning Forum, 24, 2 (February 2015), 1-4.] “As an increasingly broad and diverse cross section of students enters higher education, knowing those rules matters more than ever. Without them, students stumble. They might miss the point of a paper, drift during discussions, or feel overwhelmed or aimless. But all students can thrive, Ms. Winkelmes says, if the tacit curriculum is made plain.”

Winkelmes’ findings from the Transparency in Teaching and Learning in Higher Education project point to giving assignments in a transparent manner as having a “significant effect on students.” Faculty involved in the project considered three questions when creating assignments: the task, the purpose, and the criteria.

Defining the task means that the students are told exactly what they are to do. Students should also know the purpose of the assignment. Why are they being asked to do this and what is the instructor’s goal? What are the criteria that will be used to evaluate the work that the students submit?

The article provides details on how several faculty took assignments they had used in the past, reviewed them using the three questions, and then implemented improved versions of the assignments in their classes. While some faculty have pushed back on the process, others have found it to be valuable, saying that clarifying the assignment at the outset helps save time in the long run.

This relatively easy technique has proved to have a big impact. “In the classroom, knowing the task, purpose, and criteria can help motivate students and make their courses relevant. In other areas, the information can help them navigate an intimidating system. To Ms. Winkelmes, the protocol helps students meet higher expectations of rigor, which, in turn, can ensure equity in educational quality.”

*********************************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay.com

The CIRTL MOOC is Back!

Last fall I blogged several times about the CIRTL MOOC. CIRTL—the Center for the Integration of Research, Teaching and Learning—is an NFS funded consortium of 21 universities whose “…mission is to enhance excellence in undergraduate education through the development of a national faculty committed to implementing and advancing effective teaching practices for diverse learners as part of successful and varied professional careers.” CIRTL promotes three core ideas: Teaching-as-Research, Learning Community, and Learning-through-Diversity.

Screenshot of Coursera course description page for An Introduction to Evidence-Based Undergraduate STEM Teaching.CIRTL offers a number of courses, some of which are open to participation to those who are not in CIRTL member institutions. Last fall (2014), An Introduction to Evidence-Based Undergraduate STEM Teaching, developed by CIRTL member faculty at Vanderbilt University, Michigan State University, Boston University and University of Wisconsin-Madison, was launched. You can see this description on the CIRTL website:

  • Instructors: Faculty and staff from across the CIRTL Network.
  • Duration of course: September 28, 2015 – November 20, 2015
  • Format: MOOC on Coursera (https://www.coursera.org/)
  • Suggested Credits: Coursera version is noncredit; local MOOC-centered learning communities may offer credit locally.
  • Open to: Early or advanced graduate students, post docs, academic staff and faculty
  • Technology Requirements: internet access
  • Accessibility: We strive to be inclusive of anyone interested in participating in our activities, programs, and courses. If you have specific accessibility needs, please let us know in advance so that we may make the necessary accommodations.

The Coursera website description adds: “This course will provide graduate students and post-doctoral fellows in the STEM disciplines (science, technology, engineering, and mathematics) who are planning college and university faculty careers with an introduction to evidence-based teaching practices. Participants will learn about effective teaching strategies and the research that supports them, and they will apply what they learn to the design of lessons and assignments they can use in future teaching opportunities. Those who complete the course will be more informed and confident teachers, equipped for greater success in the undergraduate classroom.”

I took the course last fall and found it to have great videos on topics such as learning objectives, assessment, peer instruction, inquiry based labs, learning through writing, and problem based learning. My assessment is that it is not just appropriate for STEM instructors; anyone teaching at the higher education level could benefit from the course content.

Here are links to last year’s The Innovative Instructor blog posts inspired by the course content:

One thing that I really like about MOOCs is that if you are not taking one for credit or certification, you can go at your own pace, take what you need and skip over content that is not relevant. Moreover, in this case, you will continue to have access to course materials after the MOOC has finished. While you lose the benefit of participation in discussion threads and getting feedback on assignments, being able to view the videos and readings has value.

Whether you are STEM or STEAM (Science, Technology, Engineering, Arts, Mathematics), just starting out in your teaching career or a seasoned professional looking for some new ideas, sign up for An Introduction to Evidence-Based Undergraduate STEM Teaching.

*********************************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Screen shot https://www.coursera.org/course/stemteaching

Quick Tips: Guidelines for Inquiry-Based Project Work

Following last week’s post on definitions of inquiry-based learning, problem-based learning, case-based learning, and experiential learning, a colleague pointed me to a post from the Tomorrow’s Professor Mailing List that provides a rubric for team-based, inquiry-based work. The guidelines are taken from the book Teaching in Blended Learning Environments: Creating and Sustaining Communities of Inquiry by Norman D. Vaughan, Martha Cleveland-Innes, and D. Randy Garrison. [2013, Athabasca University Press]. A free PDF of the book is available.

Three students engaging in field work, taking soil measurements in agricultural setting.The display of the table with the rubric on the Tomorrow’s Professor site is difficult to read; a better version can be found here at the University of Regina’s Teaching Resources website.

The rubric covers eight dimensions to consider in inquiry-based project work: authenticity, academic rigor, assessment, beyond the school, use of digital technologies, connecting with experts, and elaborated communication. It provides a sound starting place for guiding your implementation of inquiry-based learning.

*******************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay

Definitions

Recently, in discussion with some colleagues, confusion was expressed about the terms inquiry-based learning, problem-based learning, case-based learning, and experiential learning. How are these alike and how are they different? Are there overlaps? What distinguishes one from another? I thought providing some short definitions of these terms, along with a few resources, might be useful to others seeking clarity.

Group of students working togetherInquiry-based learning (IBL) is a term used broadly to include pedagogical approaches that put the students at the center of the learning process, allowing them to undertake investigations by asking questions to solve problems. The University of North Carolina has published an annotated bibliography of resources on IBL.

Problem-based learning (PBL) is described by the Institute for Transforming Undergraduate Education site, Problem-Based Learning at University of Delaware: “In a problem-based learning (PBL) model, students engage complex, challenging problems and collaboratively work toward their resolution. PBL is about students connecting disciplinary knowledge to real-world problems—the motivation to solve a problem becomes the motivation to learn.”

And in Why PBL?, “In a problem-based learning (PBL), students work together in small groups to solve real-world problems. PBL is an active and iterative process that engages students to identify what they know, and more importantly, what they don’t know. Their motivation to solve a problem becomes their motivation to find and apply knowledge. PBL can be combined with lecture to form a hybrid model of teaching, and it can be implemented in virtually all courses and subjects.”

A widely cited book by Maggi Savin-Baden, Problem-Based Learning in Higher Education: Untold Stories [McGraw-Hill International, 2000], provides an in-depth look at PBL. See an excerpt here.

The Center for Teaching at Vanderbilt University has a teaching guide on team-based learning. “Team-based learning (TBL) is a structured form of small-group learning that emphasizes student preparation out of class and application of knowledge in class. Students are organized strategically into diverse teams of 5-7 students that work together throughout the class.  Before each unit or module of the course, students prepare by reading prior to class.” The guide provides information on theory and structure, as well as a section called Where can I learn more?, which references the Team-Based Learning Collaborative as well as books and articles.

Case-based learning employs the use of discipline-specific, situational narratives as a launch pad for student learning. A case-based learning wiki from the Department of Educational Psychology and Instructional Technology, University of Georgia tells us that “[c]ase-based learning can cover a wide variety of instructional strategies, including but not limited to, role plays, simulations, debates, analysis and reflection, group projects and problem-solving. It provides a great deal of flexibility at the practical level.” The wiki not only describes the characteristics of case-based learning, but also discusses how to implement it – defining both the instructor’s and the students’ roles, offers some information about developing cases and designing learning activities, gives an overview of assessment, and provides references. See also The Innovative Instructor post Quick Tips: Using Case Studies.

The Center for Teaching and Learning at the University of Texas Austin defines experiential learning as “any learning that supports students in applying their knowledge and conceptual understanding to real-world problems or situations where the instructor directs and facilitates learning.” These experiences can take place in a number of settings including classrooms, labs, studios, or through internships, fieldwork, community service, clinical or research projects. The UT Austin webpage on experiential learning discusses the importance of this method, how it works, what it looks like in practice, and describes the forms it can take. A list of reference is provided. See also: Learning by Doing – Case-in-Point, an Innovative Instructor blog post by Adriano Pianesi.

As this compendium demonstrates, these terms are interconnected.  Inquiry-based learning is an umbrella for the pedagogies described. Case-based learning and team-based learning may be used as strategies in implementing IBL or problem-based learning. Experiential learning allows students to engage in authentic experiences with an instructor or facilitator acting as a guide.

*************************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay

Bringing Digital Humanities into the Classroom

I recently attended a professional conference where Digital Humanities (DH) was the hot topic. For those of you in other disciplines, DH is a field of scholarship (and pedagogy) that is often described as being at the intersection of humanities and computing. The idea is that humanities scholars who have traditionally worked alone in the ivory tower, or more accurately, in archives, libraries, museums, and in the field, are now engaging in collaborative, cross-disciplinary research endeavors that involve large data sets, computational analysis, and new methods of visualizing information. Publication for DH scholars had moved from the monograph to open access, web-based, collaborative, and social media outlets. Twitter, in particular, is the social medium of choice for the DH field.  At the conference I attended, everyone seemed to be tweeting.

A wordle created from The Digital Humanities and Humanities Computing: An Introduction, Schreibman, S, Siemens, R, and Unsworth, J.If you’d like to learn more about DH, there is concise guide provided by the University of Richmond Boatwright Memorial Library that includes a few seminal texts as well as links to resources, tools, and examples of projects.  A comprehensive bibliography, which can be downloaded as a Word document, has been put together by some of my colleagues in the Visual Resources Association. Two DH organizations to look at are the Alliance of Digital Humanities Organizations and HASTAC (Humanities, Arts, Science, and Technology Alliance and Collaboratory). Beyond the research aspect of DH, I am interested in how one might take DH into the classroom.

A Google search on “digital humanities teaching” yields a lot of results. Two guides to check out are the University of Delaware Library’s Digital Humanities: Teaching Resources, and University of Kansas Libraries guide to Digital Humanities: TEACHING: digital humanities in the classroom. There is a book that includes some case studies, which range from a course at the doctoral level to a freshman writing course, published as open access–Digital Humanities Pedagogy: Practices, Principles and Politics (edited by Brett D. Hirsch). You can download it as a PDF. Perhaps most illuminating from my perspective was a blog post by Ryan Cordell, Assistant Professor of English at Northeastern University in Boston, Massachusetts and a Mellon Fellow of Critical Bibliography at the Rare Book School in Charlottesville, Virginia. How Not to Teach Digital Humanities (February 1, 2015) chronicles Cordell’s evolution in thinking about and teaching what started out as an introduction to digital humanities course.

My own thinking, which is aligned with Cordell’s, is that in teaching undergraduate humanities courses we need to be most concerned with the essential practices and methods of DH work. I agree with Cordell that our students may be called digital natives, but many of them are not digitally (or visually) literate. They may not be fully comfortable with the intricacies of technology in spite of their abilities to text at astonishing speeds. The DH practices that point to skills that would be useful for students to develop have to do with working collaboratively, thinking critically, understanding the importance of narrative and visual communication, and communicating using new media. Arguably, these are abilities that will be useful to students pursuing any 21st century career path. Many DH practitioners would add coding to the list. I agree that humanities students should be introduced to and encouraged to learn coding of some flavor. Cordell cites TEI (text encoding initiative) as a low-barrier example that allows students to see the power that coding might have in humanities research.

Cordell used non-traditional assignments to introduce students to new media: “Those assignments push them beyond their comfort zone—for English students, their comfort zone is writing a 7 page paper—asking them to consider the medium as well as the message of their own research and arguments.” The Center for Educational Resources, where I work, has been encouraging faculty to explore non-traditional assignments with output in video, blogs, wikis, electronic posters, timelines, visualizations, and applications such as Omeka, WordPress, and a mapping tool developed in house.

Whether or not DH is still a hot topic in the future, Cordell imagines a positive outcome if “…DH methodologies have become widely-accepted as possible ways (among many) to study literature, history, and other humanities subjects….” I see that exposing our students to these ways of thinking and communicating will also have a positive outcome.

Macie Hall, Senior Instructional Designer, Center for Educational Resources

Image Source: Digital Humanities Wordle created from The Digital Humanities and Humanities Computing: An Introduction, Schreibman, S, Siemens, R, and Unsworth, J. [Anonymous] http://www.wordle.net/show/wrdl/5672950/Digital_Humanities

The Toolkit for Inclusive Learning Environments

The Innovative Instructor has featured several posts recently on inclusivity and diversity in the classroom. This is an important issue, and one that is very much on my radar screen as I have been involved in developing TILE–the Toolkit for Inclusive Learning Environments (see post here). On Wednesday, March 25th, we had our first session with interested faculty to explore best practices.

As part of the program, we introduced three examples of the types of course components we envision for the toolkit. These could be in-class activities, assignments, projects, case studies, role-playing, experiential learning, best practices or recommendations.

1. CRITICAL THINKING EXERCISE

Screen shot from Twitter Feed of the PR firm StrangeFruit showing the two women founders explaining that they thought the term strange fruit could mean something different than it did historically.

Twitter.com screen shot.

Pedagogical Approach: Critical Thinking Exercise 

Students can do this in class on their laptops, tablets, or smart phones.

In 2014 a food and entertainment PR firm was the subject of a media backlash because of their chosen company name. What is wrong with the name? What is the history of the name both past and more recently? How would you have advised the firm to remedy the situation? [By the way, you can find the full story here.]

 Potential Learning Outcomes:

  • Students will be able to discuss why basic research and information literacy skills are imperative to making business decisions.
  • Students will understand the negative consequences of 1) not doing basic research, and 2) not being culturally competent and/or sensitive.
  • Students will understand the importance of gaining cultural competence when it comes to issues or terms that they may not personally understand but may be a sensitive subject for others.
  • Students will have a broader knowledge of a tumultuous time in recent US history.
  • Students will be able to articulate the meaning and history of a song labeled “The Song of the Century” by Time magazine in 1999.
  • Students will be able to discuss the meaning of the term “strange fruit.”

2. CASE STUDY

Male crash test dummy in driver's seat.

Brady Holt http://de.wikipedia.org/wiki/Crashtest-Dummy#/media/File:IIHS_crash_test_dummy_in_Hyundai_Tucson.jpg

Pedagogical Approach: Case Study

Adapted from Stanford’s Gendered Innovations, Pregnant Crash Dummies Case Study. In 1949 the US military developed Sierra Sam, the first crash test dummy based on a 95th percentile male body. A female body type was introduced in the 1970s, children crash test dummies in the 80s, and babies in the 90s. There is one group/body type that is not required in vehicle crash tests and yet accounts for the number one fatality rate among a certain group. Any guesses?

“Conventional seatbelts do not fit pregnant women properly, and motor vehicle crashes are the leading cause of fetal death related to maternal trauma (Weiss et al., 2001). Even a relatively minor crash at 56km/h (35 mph) can cause harm. With over 13 million women pregnant across the European Union and United States each year, the use of seatbelts during pregnancy is a major safety concern (Eurostat, 2011; Finer et al., 2011).”

What are the dangers to the fetus with the current seat belt system? Could you design something better? Given what you know, what requirements or federal policies or disclaimers would you require that are currently not in place? Do the standard seatbelt and seat requirements leave any other segments of the population at risk? If so, who?

Potential Learning Outcomes:

  • Students will understand the importance of a diverse team.
  • Students will be able to discuss the dangers in design when diversity is NOT considered.
  • Students will understand that a one-size-fits-all approach in design overlooks important segments of the population.
  • Students will understand the need for policies that require design for all segments of the population.
  • Students will create a solution that requires inclusive design considerations.

Citations

Eurostat. (2011). Fertility, Figure 1: Number of Live Births, EU-27, Legally Induced Abortions by Year, Country, and Mother’s Age, EU-27. http://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=demo_fabort&lang=en

Finer, L., & Kost, K. (2011). Unintended Pregnancy Rates at the State Level. Perspectives on Sexual and Reproductive Health, 43 (2), 78-87.

Weiss, H., Songer, T., & Fabio, A. (2001). Fetal Deaths Related to Maternal Injury. Journal of the American Medical Association, 286 (15), 1863-1868.

3. RECOMMENDATION FOR BEST PRACTICE—GUEST LECTURES OR PANEL OF EXPERTS

Image showing a number of faces of people, male and female, of different ages, races, ethnic, and cultural groups. The images are staggered and framed with brightly colored lines suggesting computer monitors.

Pixabay http://pixabay.com/en/system-network-news-personal-591225/

Pedagogical Approach: Guest Lecture or Panel of Experts

Identify minority experts in your field and bring them in as a guest lecturer or for a class discussion. They should spend most of the time on their scholarship and area(s) of expertise and only speak about their minority status in the field when and if they themselves choose.

Potential Learning Outcomes:

  • Students will see someone as a role model for both minorities and non-minorities based on that person’s accomplishments and expertise in their shared area of study.
  • If the expert is respected by the student’s professor, the students will also show/gain respect for the expert.
  • Due to professor’s modeled behavior, students could also potentially treat minority experts as equals when they encounter them in the field.
  • Students may evolve into professionals who support and understand some of the challenges that minorities face in their field.

We have asked those interested in contributing their own examples to submit a PowerPoint slide with the following format: on a single slide, start with an image that is relevant to the example. We ask that the images be rights-free or have a Creative Commons license with attribution in either case. In the Notes section below the slide, describe the pedagogical approach, give the information necessary to implement the example, and list potential learning outcomes.

You are invited, too. If you have an example you’d like to submit, please contact me via the comments with a brief message and an email address. We are looking forward to sharing your contributions.

Macie Hall, Senior Instructional Designer, Center for Educational Resources

 

A Guide to Bloom’s Taxonomy

A few years ago at an instructional workshop for university professors the following question was posed to the attendees: “What do you know about Bloom’s Taxonomy of the Cognitive Domain?” Most of the respondents answered, “Whose taxonomy of what?”

That answer indicates a general lack of knowledge about one of the most basic pedagogical principles in education. Here are some straightforward guidelines on what Bloom’s taxonomy is and how you can use it in your class.

In 1956, Benjamin Bloom (an American educational psychologist),with collaborators Max Englehart, Edward Furst, Walter Hill, and David Krathwohl, published a framework for categorizing educational goals: Taxonomy of Educational Objectives familiarly known as Bloom’s Taxonomy. The framework consisted of six major categories: Knowledge, Comprehension, Application, Analysis, Synthesis, and Evaluation. The categories after Knowledge were presented as “skills and abilities,” with the understanding that knowledge was the necessary precondition for putting these skills and abilities into practice.

The New Version of Bloom's TaxonomyIn 2001 Bloom’s taxonomy was revised by a group of cognitive psychologists, led by Lorin Anderson (a former student of Bloom). To update the taxonomy to reflect 21st century work the authors used verbs to re-label the six categories and included “action words” to describe the cognitive processes by which learners encounter and work with knowledge. The figures accompanying this article reflect that work. This revised Bloom’s taxonomy proves to be a very useful tool that can be used in all classrooms for several reasons listed below.

Table showing Bloom's levels of understanding and related actions.About ninety percent of the questions students handle in any class are memory questions. The memory level is perfectly respectable and even essential in many learning situations. There are, however, disadvantages in using pure memory that an instructor should keep in mind. The memory level is a tool that promotes the use of short term memory, and the information may be forgotten if it is not used. Another problem with the memory level is that it does not guarantee understanding. We often assume that just because a student can cough up words, facts, and figures that s/he has “learned” and understands the material. That is simply not the case. By moving up the scale to teaching that involves students understanding, applying, and analyzing information, their learning outcomes will improve.

That is not likely to happen, though, without some thoughtful preparation. In instructional design, questioning strategies can be as simple as the intentional progression of questions leading to higher levels of thinking and involvement. Bloom’s revised taxonomy can provide a framework for constructing those questions.

Some examples of how to incorporate Bloom’s taxonomy into classes include the following:

1. Creating Course Learning Objectives 

In education, learning objectives are brief statements that describe what students will be expected to learn by the end of a course, unit, or class period. Instructors can benefit from using a framework to construct and organize learning objectives for themselves and for students. Having an organized set of learning objectives helps instructors plan and deliver appropriate instruction, design valid assessment tasks and strategies, and ensure that instruction and assessment are aligned with the objectives.

For example, learning objectives following Bloom’s revised taxonomy could be constructed as follows.
Students should be able to:

  1. Exhibit previously learned material by recalling facts, terms and basic concepts.
  2. Demonstrate understanding of facts and ideas by organizing, comparing, interpreting and giving descriptions and stating main ideas.
  3. Solve problems by applying acquired knowledge, facts, techniques and rules in a different way.
  4. Examine and break information into parts by identifying motives or causes; making inferences, and finding evidence to support generalizations.
  5. Compile information together in a different way by combining elements in a new pattern or proposing alternative solutions.
  6. Present and defend opinions by making judgments about information, validity of ideas or quality of work based on a set of criteria.

2. Asking Questions

In-class questioning can be varied from the most simple to those that require more thought. These questions can be categorized following Bloom’s hierarchy of cognitive skills. Here are some examples of questions asked about the story Goldilocks and the Three Bears. Do you remember the story line? The little girl Goldilocks visits the home of the papa, mamma, and baby bear where she sleeps in their beds, eats their food, and sits in their chairs.

Remembering: List the items used by Goldilocks while she was in the Bears’ house.
Understanding: Explain why Goldilocks liked Baby Bear’s chair the best?
Applying: Demonstrate what Goldilocks would use if she came to your house.
Analyzing: Compare this story to reality. What events could not really happen?
Evaluating: Propose how the story would be different if it was Goldilocks and the Three Fish.
Creating: Judge whether Goldilocks was good or bad. Defend your opinion.

3: Constructing Test or Exam Questions

This is a combination of the above two points. If the course is arranged around learning objectives, designed with Bloom’s taxonomy in mind, then those objectives can be used to construct test and exam questions. This process will ensure alignment between instruction and assessment and provide validity to your evaluation of students’ knowledge and skills.

Additional Resources

  1. Anderson, L. W., & Krathwohl, D. (Eds.). (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. New York: Longman.
  2. Bloom, B., Englehart, M. Furst, E., Hill, W., & Krathwohl, D. (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York, Toronto: Longmans, Green.
  3. Davis, B.G (2009) Tools for Teaching, 2nd edition, Jossey-Bass, San Francisco
  4. Southey, R. (1837) The Three Bears. [Note this original version involves a nameless old woman instead of the little girl Goldilocks.]

Richard Shingles, Lecturer, Department of Biology
Director, TA Training Institute and The Summer Teaching Institute, Center for Educational Resources

Richard Shingles is a faculty member in the Biology department and also works with the Center for Educational Resources at Johns Hopkins University. He is the Director of the TA Training Institute and The Summer Teaching Institute on the Homewood campus of JHU. Dr. Shingles also provides pedagogical and technological support to instructional faculty, post-docs and graduate students

Image Source – CC Revised Bloom’s Taxonomy: Andrea Hernandez
Image Source – Bloom’s Levels of Understanding – Actions: Preparing Future Faculty Teaching Academy, Johns Hopkins University
http://www.cer.jhu.edu/graduatestudents/pffta.html

A Manual for Flipping Your Classroom

The Innovative Instructor has featured several posts on flipping your classroom (see here, here, here, and here) a technique that has students learning content on their own time and using class time to work on problems, discuss materials, or engage in collaborative activities.

Text reading flipping the classroom with the classroom upside downJust in time for the upcoming semester, the Chronicle of Higher Education has published A Guide to the Flipped Classroom, available for free download. The manual, in PDF form, collects seven case studies and articles on the process of flipping the classroom that appeared in the CHE over the past three years. Faculty teaching evolutionary biology, chemistry, mathematics, and business topics weigh in on their experiences.

The experiences of Andrew Martin, a professor of ecology and evolutionary biology at the University of Colorado, Boulder, are highlighted in the first article. The article notes that innovations in pedagogy, technology such as clickers, support and advocacy from those who want to improve higher education, and economic realities have helped to popularize this teaching technique.

The second article describes a student’s view of a flipped chemistry course at Southwestern University in Georgetown, Texas. With the flipped classroom, learning takes center stage over teaching.

Stephen Neshyba describes his experience flipping his chemistry class at University of Puget Sound noting that moving to a flipped class may change “which kinds of students excel and which ones struggle.”

Two articles by Robert Talbert, a mathematician and educator at Grand Valley State University, look at the pedagogical reasons and advantages for flipping a class, and why students may push back when a course is flipped. There are suggestions on how to handle this. Talbert also blogs for the CHE at Casting Out Nines, where he has documented in detail his experiences with flipping his classes.

A study shows that physics faculty often try new methods and then abandon it in the face of student challenges. An article addresses what faculty who want to explore new teaching methods can learn from this research.

Finally there is a profile of Norman Nemrows, a professor of business at Brigham Young University. He began recording his lectures about 15 years ago. His experience raises the question “Are professors willing to become sidekicks to slick video productions?”

At the end of the manual there is a short list of resources to help you whether you are a novice or a seasoned flipper.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: © Macie Hall, 2013