Lunch and Learn: Active Learning Techniques

Posted on March 20, 2024 by abrusini

On Tuesday, March 12th, the Center for Teaching Excellence and Innovation (CTEI) hosted a Lunch and Learn on Active Learning Techniques: Advice and Guidance from Experienced Faculty. Faculty panelists included Nate Brown, Senior Lecturer, University Writing Program (KSAS); Robert Leheny, Professor and Department Chair, Department of Physics and Astronomy (KSAS); and Michael Falk, Vice Dean of Undergraduate Education and Professor, Department of Materials Science and Engineering (WSE). Caroline Egan, Teaching Academy Program Manager, moderated the discussion.

Caroline began the session by asking panelists how they got started with active learning and what they would recommend to those who were thinking about implementing it.

Nate Brown described how he heavily relied on his lecture notes to deliver content to students when he first started teaching. As he’s gained more experience, he’s moved away from using lecture notes and actively involves students in their learning. Brown structures his classes now in such a way that the students drive the conversation and solve problems collectively, leading to greater retention of information and increased engagement. He makes a point of having students think about “why they are doing what they are doing.”

Robert Leheny recalled how the Provost’s Gateway Sciences Initiative from several years ago provided funding to support the redesign of gateway science courses, such as the Introduction to Physics course, which he teaches. The goal of the Gateway Sciences Initiative was to evolve the pedagogy in large introductory science courses to produce better student outcomes.

The Intro to Physics redesign, which was modeled after similar large lecture style courses at NC State and MIT, moved away from a traditional lecture style to a much more interactive experience. Students are divided into groups and sit at round tables instead of in rows, and they solve problem sets together during class rather than at home. This in-class work is partly enabled by a flipped classroom approach which enables students to review the content before coming to class. Leheny said the department now offers two versions of Introduction to Physics that students can select from: an active learning style and a more traditional auditorium/lecture style.

Michael Falk first started implementing active learning by using clickers in a 200-student Introduction to Computer Programming course at the University of Michigan several years ago. Since he’s been at Hopkins, his classes have been smaller, allowing him to approach active learning in different ways. Falk gave an example of how he flipped an upper-level materials science course (which is now also part of the Gateway Computing program) so that students work in an online textbook outside of class and do more collaborative work during class. Another example is a First-Year Seminar class taught by Falk, Turing’s Shadow: Uncovering What’s Hidden in STEM. This discussion-based course covers a range of topics, some of which are sensitive, and students are often afraid to speak up. To address this, Falk created a series of discussion cards to help ease students’ discomfort. The cards provide discussion prompts for students, such as “Clarification: Ask for further explanation about something,” and they also inject some fun elements into the conversation by asking respondents to present their response “in the form of a song,” or “while walking around the room very quickly,” for example. It turns the exercise into a game and helps students to feel more comfortable participating in class.

Caroline continued by asking the panelists what their definition of active learning is and to provide a counter-example of it, which would bring its definition into better relief.

NB: I think it involves giving students a stake in what we’re doing. For example, helping to define the parameters of a paper we’re going to write. I see the professorial role as one of support, like “air traffic control.” With active learning, students are involved in the creation of their own learning.

RL: The primary component of active learning in physics is peer instruction. Students need to be able to solve problems. We don’t use class time to introduce students to concepts, but instead give students an opportunity to practice solving problems where there are resources to help facilitate these skills. For example, students are divided into groups of three and explain to each other how they would go about solving a problem. The act of explaining the problem to someone else helps to solidify their own understanding. A counter example would be the old way of the instructor speaking from the blackboard, talking uninterrupted for most of the class period.

MF: Active learning is learning by doing. Students are engaging with content in a supportive environment. We are teaching a different group of students at Hopkins now – there are many more first- generation, limited-income, and/or underrepresented students with very different backgrounds. We need to think proactively about leveling the playing field for students. This is evident in the data around class outcomes: classes taught using active learning techniques have lower levels of students failing or dropping out. This is even more true for students in underrepresented groups.

RL: We also see this in Intro to Physics. We have the two versions of the course: one in the auditorium (which may have some active learning elements in it), and one designed specifically as an active learning course. The homework and exams are the same in both courses. The outcomes show that failing grades are much less likely to occur in the active learning course.

MF: I used to think my job as an instructor was to deliver content and material. Now, with active learning, I think my job is to deliver an experience.

Caroline continued by asking panelists for a simple active learning technique that instructors can implement right away.

NB: This may sound crazy – it comes from a writer colleague of mine. I was having students read out loud in class and noticed they were struggling: they didn’t feel comfortable, they were shy, or were experiencing language barriers, etc. I then asked them all to read in chorus (at the same time). No one understood what they were hearing, but it shocked them into it being ok to share. It really helped them get over their nerves.

RL: Think-Pair-Share. This technique works very well in a large lecture environment. We give students a multiple choice question and have everyone vote on the answer. Next, they have to find someone who voted differently and try to convince them to change their answer. We then ask students to vote again. The results are that there are usually more correct answers the second time. You do need good questions for this to be effective.

MF: An idea for STEM classes, figure out a way to shorten your lecture and hand out the problem set at the end of class. Allow students to work on them with each other. Ask students to write down the steps on how they would solve the problem, but not actually solve it. Allow time for a report out at the end. This gives them a chance to support each other while organizing information.

CE: A complimentary Humanities example: In my first-year writing class, I hand out labeled strips of paper to students with our class readings on them and ask them to organize the strips in a way that would help the students use the readings in their papers. Also, I give students writing prompts, break them into groups, and ask them to find out where they would find the answers to the prompts. This helps to get them in the right mindset of locating good sources.

Two other examples of active learning were mentioned by faculty guests. One instructor explained how she has students use Legos to construct the analysis of an argument. They connect more and more Legos to build supportive elements of their argument and take away those that they disagree with. Another instructor mentioned that she has students act out responses in class.

The session continued with questions from the audience for the panelists:

Q: In reference to Think-Pair-Share, have you observed any competitiveness among students or reluctance to participate in these activities?
MF: We tell students it has nothing to do with their grade.
RL: We do the same. We also tell them there is no curve and it is possible for everyone to get an A, which reduces overall competitiveness.
NB: One of the great things about this exercise, where students are engaging with each other, is that they get to hear from peers that are from all over the world. We turn it into a social space where they can feel comfortable sharing.

Q: (From a librarian) I recently had about 30 minutes to work with students in a research class. I received feedback from a student that I didn’t do enough active learning in the class, despite doing a brainstorming exercise with them. What do you do when you need more active learning in such a short amount of time?
RL: Explain to students why you structured the class like you did. It will help if you get their buy-in. Maybe the answer is to announce at the beginning that what you’re doing is in fact active leaning.
MF: Students like playing – it makes for a positive learning experience. Perhaps turn part of it into a game/play. And then explain what and why you’re doing it this way.

Q: Are there any active learning experiences to share when you’re guest lecturing? Do you use the same or different strategies?
MF: It needs to be a different strategy. As a guest, you don’t have the advantage of repetition or control of the environment. Explain to students what you’re doing and do the best you can with the constraints that you’re under.
CE: Be very intentional about your choices. At the end, ask them one thing they will remember from the class. This is a good recall exercise.
NB: As a guest speaker, you already are a bit novel since your presence is different than their regular day. Maybe use a novel activity that they will remember.

Q: Could you each share how you put groups together intentionally instead of having students self-form?
RL: Students are put into groups of three. Groups are engineered this way – we switch a few times during the semester. The students don’t know it, but we add them to groups according to their performance on the midterm. In each group, there is one person that scored at the top, one from the middle, and one from a low level. The top level person gets more practice articulating ideas. The lower level person gets the benefit of working with someone who has command of the material. We also group according to gender: we avoid placing two men and one woman in a group to avoid women being excluded. There is research that supports this.
NB: We also do a lot of group work. Halfway through the semester, I ask students to work with someone they haven’t worked with before. I also ask them to sit next to someone different. It results in a richer peer review experience.
MF: I have students do a self-assessment at the very beginning of the course and use the results of the assessment to group students.

For more information about the active learning topics discussed at the event, please see this Active Learning For Distribution folder of materials developed by Caroline Egan.

Amy Brusini, Senior Instructional Designer
Center for Teaching Excellence and Innovation

Image source: Lunch and Learn logo, Unsplash, Pixabay

Lunch and Learn: Canvas Show and Tell

Posted on December 11, 2023 by abrusini

On Wednesday, November 1^st, the Center for Teaching Excellence and Innovation (CTEI) hosted a Canvas Show and Tell: Share and Learn about Engaging and Effective Uses of Canvas. Alison Papadakis, Teaching Professor and Director of Clinical Psychological Studies in the Department of Psychological & Brain Sciences, hosted the discussion. She was joined by Emily Braley, Assistant Dean for Undergraduate Academic Affairs and Associate Teaching Professor in the Department of Mathematics, and Jamie Young, Lecturer in the Department of Chemistry. Beth Hals, Brian Cole, and Caroline Egan from the CTEI helped facilitate the event.

Alison Papadakis opened the discussion describing how her interest in Canvas began with her kids, who were using it during COVID. (JHU was still using Blackboard at that time.) Watching her kids struggle with poorly designed Canvas classroom interfaces influenced the way she organized her own Canvas classroom once JHU adopted it as our new learning management system (LMS). One big decision she made was to stay away from using the Module function, which is often the most common way to organize content in Canvas. Instead, Papadakis explained how she used the Canvas Page function to create a page with a table outlining her course schedule with hyperlinks to the rest of her content. The homepage of her Canvas site looks like a calendar with hyperlinks for each class day. She regularly checks in with her students, asking if they have trouble finding anything in the course and they always assure her that they do not. Papadakis also makes the Files area in Canvas available to her students, as an additional way for them to access course content, but they tell her they don’t use it. She says the course schedule page is not the “prettiest” display of content, but the functionality works very well for her course and students can easily find what they need for each class period.

Papadakis also does a lot of student advising and needed a place to post links and share information with students. She decided to use a community site, which is similar to a website, but built inside of Canvas. All majors and minors have access to the site as well as other faculty; it is also possible to add other users to the site if necessary. Brian Cole clarified that the key difference between a standard Canvas course and community site is that a standard site is for credited courses and is automatically generated by JHU’s Student Information System (SIS). Community sites, which all faculty have the ability to request, are for non-credit activities and are intended to share information and resources across multiple populations.

Emily Braley described how the mathematics department is using a community site to host their math placement exam. The university’s switch to Canvas provided an opportunity to revise the exam, which was previously hosted in Blackboard. In Canvas, students are provided with more information about why they are taking the exam as they are guided through a series of steps to help them decide which exam to take. With the help of CTEI staff, Braley described how they embedded a Microsoft form inside of Canvas that asks students what math courses they took in high school, including AP courses. The branching feature of the form then directs students to the appropriate placement exam based on their answers. There are also practice tests that students can take before the actual exam.

The exam itself is set up using a Canvas feature called Mastery Paths. This feature allows an instructor to set up to three ranges of scores for the exam; once they take the exam, student scores are translated into a recommendation for enrollment. Braley also created a customized grading scheme for the exam, which contains information about interpreting the results as well as the actual score for the students.

Braley is very excited about the potential for data analytics with the revised exam process. Using the form provides the department with data which can help identify trends and determine if students are being placed correctly. All incoming math students are encouraged to take a math placement exam; so far this fall, close to 1100 students have taken the placement exam.

Jamie Young was looking for a way to avoid having to answer the same questions repeatedly from the 640 students in his Introduction to Chemistry lab course. Using HTML code, he was able to create a dropdown FAQ page in Canvas containing embedded links. He estimates he has received 50-60% less questions this semester so far since posting the FAQ page. He also used HTML to add buttons and links to his syllabus that link out to everything in the course, similar to Alison Papadakis’s course schedule. He believes this saves time for students as they are able to find many things very quickly. Additionally, Young embedded a live Google Document into the course that contains his course schedule. This makes it really easy to update the schedule when necessary as any changes made will immediately be pushed to Canvas – no need to upload an edited document each time a change is made.

In another course, with a combined lecture and lab, Young struggled with displaying a large amount of content. He initially put everything into modules but wasn’t happy with how disorganized they became after adding so much material. He has since turned each module into its own page and links everything from the page. This has been working out much better – again, students are able to find things quickly and easily. Young insists you don’t need much coding knowledge to take advantage of these features in Canvas; you do need to know – or have access to – a few HTML commands.

The discussion included the following questions from the audience:

Q (for Alison Papadakis): Do you need coding experience to create this [the course schedule]?
AP: I just created it in Word and cut and pasted it in – no coding necessary.

Q (for Alison Papadakis): How do you link the “tone” of your course to the course schedule?
AP: This is an in-person course, so there is a lot of in-class discussion around the course and how it works at the beginning. The course schedule is just the pragmatic piece so we can keep things organized.

Q (for Alison Papadakis): It looks like you assign readings before the semester begins – do you plan everything ahead of the semester, before it starts?
AP: I have taught this course over ten times, so I know basically what’s coming. I put placeholders in for things I don’t know yet. You’ll notice it says ‘Tentative Schedule’ so I can allow for shifting things around if needed. I do need to remember to update the Canvas calendar when making changes to my course schedule.

Q (for Alison Papadakis): Can anyone access the community site?
AP: No, they have to be added to the roster.

Q: (For Beth Hals, CTEI’s Sr. Instructional Technologist) Can you explain Mastery Paths? Is it the same as locking/unlocking a Module?
BH: Mastery Paths are affiliated with some sort of assessment in Canvas. As the instructor, you can set three different sets of score ranges that you use to then send students on their next ‘path’ based on their results. Unlocking modules is a little different – you first set prerequisites on a module that must be completed before the module will unlock.

Q (for Jamie Young): To a neophyte, it’s a little overwhelming to see what you’ve done – there seem to be many ways of doing the same thing. Could you compare and contrast the ways of organizing your syllabus?
JY: You can use the Rich Content Editor (RCE) in Canvas to build your syllabus. If you want to add something like buttons, you would then toggle the RCE to view the HTML editor. Using HTML is more complicated for sure, but with some basic knowledge you can do it. I would be happy to share what I’ve done and then you can just fill in your information and cut and paste it into your course. To embed the Google Form, I followed online directions that I googled.

Brian Cole, CTEI’s Associate Director for Instructional Technology: You don’t need any HTML knowledge to embed anything into Canvas. You can use the Rich Content Editor (RCE) to do this. There is an “embed” option in the menu of the editor. You also don’t have to do every page. You can pick and choose what parts of your course to make pretty.

Q: Did Jamie build his syllabus in AEFIS?
BC: No, Jamie built his syllabus using the Canvas Syllabus page. You can still use your own syllabus in conjunction with the AEFIS syllabus – they can coexist. (Note: New name for AEFIS is Heliocampus.)

Q (for Jamie Young): Could you provide a little more information on creating tabs?
JY: They are just HTML code. I used HTML 5. You have to go into the HTML editor in Canvas and use “div” tags to build tabs. Start with the blank tabs in html, then go back to the RCE and fill in the text as needed. You can use copy and paste to make it easier.

Q: Can I move JavaScript headers into Canvas?
BC: No, Canvas will strip them out. An alternative is to embed the page into the Canvas page.
BH: There is something called the Redirect tool that may help. This tool adds an item to your navigational menu. You pick the text for what will display in your menu and it will link to a particular page.

Q: Any ideas about making grading easier?
EB: We use auto grading on all quizzes. We also use banks of questions, so that each quiz pulls from different banks. New Quizzes has matching question types that are more work for students, more robust, but still auto graded. Another thing about New Quizzes is the ability to render Latex [a typesetting software for math symbols]. This has been very useful for us – it’s so much cleaner for students. It renders as accessible MathML, which can be read by a screen reader. This is much better than posting a PDF that is read as an image.
We also use Gradescope, which is an external tool that helps us streamline grading. Students upload their work to Gradescope (inside of Canvas) and you can set it up to help auto grade problems.
JY: We also use Gradescope extensively in Chemistry. We scan written work into Gradescope and it is automatically graded. The system has gotten better at reading handwriting. It has made handwritten assignments so much easier to grade. One caveat about Canvas quizzes: they don’t allow for numbers past 4 decimal places, which we need.

A word about accessibility in Canvas:
EB: You can have Canvas tell you if your material is accessible or not. Use the accessibility checker in the RCE to help you with this.
BH: I also wanted to mention that it’s very easy to duplicate pages in Canvas – build it once, duplicate the page, then fill in what you need to change. It’s like building a template for yourself and reusing it.

For more information about topics discussed at the event, please see this Canvas resource developed by Beth Hals.

Amy Brusini, Senior Instructional Designer
Center for Teaching Excellence and Innovation

Image source: Canvas logo

Lunch and Learn: First-Year Seminars

Posted on March 7, 2023 by abrusini

On February 15, 2023, the Center for Teaching Excellence and Innovation (CTEI) and the First-Year Seminar program hosted a Lunch and Learn with a panel of faculty members to share their experiences teaching First-Year Seminars (FYS) in the Fall of 2022 as well discuss emerging best practices. The panel included Christopher Celenza, Dean of the Krieger School of Arts and Sciences, and Professor of History and Classics; Marisa O’Connor, Associate Teaching Professor, University Writing Program; Lilliana Mason, SNF Agora Institute, Associate Professor of Political Science; and Karen ní Mheallaigh, Professor of Humanities, Classics Chair. Aliza Watters, Assistant Dean for the Undergraduate Curriculum and Director of First-Year Seminars, moderated the discussion.

Dr. Watters began with a short introduction to the FYS program, as well as some high-level reflections on lessons learned from Fall 2022. Part of a series of curricular recommendations from the Second Commission on Undergraduate Education (CUE2), FYS welcomes students to the university in a small cohort experience (12 students per seminar), each one unique, but with shared goals focused on intellectual rigor and curiosity, peer community, and faculty-student interaction and mentorship. FYS were first piloted two years ago in the Fall of 2020; since then there have been over sixty FYS piloted. The Fall 2022 semester was the first semester where FYS were required for all incoming students in the Krieger School of Arts and Sciences. Seminars are three credits, students are graded Satisfactory/Unsatisfactory (S/U), and faculty form communities of practice each fall to discuss and learn from experiences across the approximately 75 courses. Watters shared student survey results from Fall 2022 which averaged or exceeded 90% for intellectual experience, connection with faculty, and overall enjoyment.

The presentation continued with each faculty panelist briefly describing their seminar, including approach, highlights, and something learned along the way.

Dean Celenza began with his course, Books, Authenticity, and Truth, which examines the search for truth among selected texts from Roman antiquity through the mid-17^th century. Unique to the seminar and most memorable for students were the weekly hands-on encounters they had with texts in the library’s rare books collection, an experiential learning component that complemented the analytical discussions. Early in the semester, Dean Celenza reckoned with the difficulty of some of the sources he was assigning. Rather than a formal introduction to his field, with a focus on developing discipline-specific, complex knowledge, he considered the ethic of the group’s learning in the moment – and the personal and communal stakes of that learning. For him, it was more important to meet students “where they are” in terms of background knowledge rather than try and cover every detail. He also commented that he so enjoyed getting to know his students more personally in the context of FYS, that the S/U grading scheme is essential to this, and how, institutionally, FYS enables faculty to have a far richer understanding of the overall landscape experienced by our first-year students.

Professor Mason continued with her seminar, The Psychology of Mass Politics in the United States. Her course focused on the various misperceptions we have about how people make decisions based on politics, how our thoughts can be influenced and biased through deliberate misinformation, and in getting students to note these practices in the real world. Mason purposely varied the way she presented material to students, regularly using film, video, and podcasts in addition to journal articles, and alternating weeks of heavier and lighter reading. One particularly enjoyable assignment for students was to design and develop a false story about Johns Hopkins University as a way of self-consciously inoculating them against misinformation. Surprised at the divergent levels of basic political knowledge students had coming into her class, including the different branches of government, Professor Mason plans to include more introductory material going forward and even more attention to annotated reading practices. Like Dean Celenza, Mason enjoyed getting to know her students and began all her classes with a more personal check-in before turning to the week’s material.

Dr. O’Connor continued with her course, Is a Corporation a Person?, which presents students with a legal framework for examining personhood and its related rights to free speech in the U.S. The seminar asks students to examine this concept from various viewpoints, including other cultures, political movements, and literature. Dr. O’Connor draws on a great diversity of sources for her students to analyze: film, photographs, political cartoons, websites, and scholarly articles, among others. At one point during the course, O’Connor asked students to read articles by two scholars who had vastly different opinions about a particular subject; students were incredulous that these “experts in the field” were disagreeing with each other so starkly. Dr. O’Connor noted how transformative this experience can be for students: to see intellectual disagreement so explicitly rendered and to be invited, themselves, into the scholarly conversation. And that is how Dr. O’Connor’s course culminates: with each student proposing a research question and project that engages debates of personhood.

Professor ní Mheallaigh described her course, Lunar Histories, as imagining the moon as a magic door or portal for students: how it was perceived by ancient people, how it factored into religious practices, and how it eventually emerged into scientific literature and later became a lodestar for truth in the modern world. Professor ní Mheallaigh found that students enjoyed the interactive parts of the seminar best. To help them process ancient material that could be dense, or overly-technical, she regularly asked students to draw or otherwise visualize what they thought the author was trying to convey in early texts. Another activity that was especially memorable for students was going to the JHU Archeological Museum to examine various ancient artifacts, including a wand used to cast spells. These active learning practice helped take the pressure off of having to comprehend every historical detail while engaging students in the abiding imaginative components of lunar histories. Professor ní Mheallaigh also maintained that they helped engage the students emotionally as well as intellectually.

Dr. Watters summarized some of the emerging themes in the presentations and for FYS more broadly, including the need for source diversity and dynamism, modulating overly technical or discipline-specific content, incorporating experiential learning, and creating the space for more personal, low-key interactions between and among students and faculty. She then began the question-and-answer portion of the workshop which yielded active discussion with audience members. Here are some of the queries the panelists addressed:

Q: What is one concrete thing you did that worked really well?

CC: I asked students how they were doing and what was going on at the beginning of each class; it was a good way to “take the temperature” of the students and the room overall.
MO: I had students look at all sources we used in class, build a case, and present results. Finding evidence in the moment and figuring out how to talk about it worked well.
LM: Each week I had students do a written reflection asking what they learned, what questions they still have, etc.
KN: Examining ancient objects and exploring multimedia were very successful.

Q: I’ve heard from students that some FYSs are a lot of work. How did you all think about the work that you assigned to students?

KN: The feedback from my students was that the assigned work was actually light.
LM: I varied the workload each week. Sometimes there was a lot of reading, but then I lightened things up the next week with a podcast or some other activity. They seemed comfortable.
MO: I assigned different sources – documentaries, readings, etc. I tried to have them do something very short before class – fun and relatively easy – but enough that they were prepared to talk about something.
CC: I tried to keep assignments short. Short was key – I wanted to give all students a chance to participate.

Q: When you give writing assignments, do you comment on the writing? Are we trying to make these students better writers in FYS?

KN: Yes, I provided comments. I thought this was a core part of what we were doing and I wanted to help them.
CC: The fact that all students will take a writing-intensive course in the spring semester after their FYS (part of Krieger’s First Year Foundation of FYS plus First-Year Writing), takes the pressure off. I don’t think we need to spend too much time commenting on their writing.
LM: I graded all of my assignments complete/incomplete. I kept my comments at a higher level.
MO: I had the students focus on writing in smaller bits, which kept it doable for them, and therefore, not much commenting from me.

Another faculty member in the audience shared that when teaching his FYS, he included writing assignments where students had to write to different audiences, such as a letter to their parents or through the lens of an art critic. He said this kept them accountable to the sources, but that the versatility helped keep things “new and exciting” for students.

Q: Were students in your FYS from the same intended major or discipline, or were they varied in their academic interests?

A: All panelists said their students intended to major in different fields; the students seemed to realize FYS was their chance to try something different, outside of their intended major or its related requirements. Several students commented to their instructors that the FYS sparked a genuine interest in a new field of study for them.

Q: Who can we contact if we have concerns about something going on with first-year students?

A: Dr. Watters responded that being receptive to student experiences in the context of FYS is crucially important and encouraged instructors to contact the students’ advisors if needed. She also noted the role FYS can play in understanding and responding to broader trends percolating among students.

Q, from another FYS faculty member: In one of my courses, I allow students to co-design the syllabus for the class. Although it can be scary, it also takes some of the pressure off of me, as the students tend to be more prepared for things. Did you design the whole course, or did you allow students to develop any of it?

A: While none of the panelists allowed students direct involvement in developing their syllabi, some commented that they did give students varying degrees of freedom in their assignments (such as what sources to use), some authority over class discussions, and independence in final projects.

Q: What is something you hope your students got out of your class?

KN: I think the social dimension that is built into this environment is enormously beneficial. For example, I took my students to a local diner, Paper Moon on 29^th Street. It was so simple, but I felt like I really got to know them.
CC: Students want to get to know their professors – they are looking for mentor relationships and FYS helps develop those.
MO: The S/U aspect and small size of the seminars supports the social aspect. Students felt comfortable talking to me about their first semester. I was a non-threatening person in their life, despite being one of their instructors. I really enjoyed getting to know them in this way.
LM: I agree, about getting to know the students. I’m already writing recommendation letters for some of them! My hope, though, is that they maintain a curiosity for and joy of learning.

Dr. Watters concluded the session by reading an anonymous quote from the FYS student survey:

My FYS was my favorite class. Most of my other classes were large lecture style classes with 200 people so engaging with 11 of my peers in a small seminar environment helped me build meaningful connections. The instructor was also fantastic and he really got to know me. This was not just a ‘fun’ class. It was a class that was instrumental to making my first semester enjoyable. I made at least 4 friends in my FYS. I went to Peabody and the Visionary Arts Museum with my FYS group and explored Baltimore. Equally as important, it challenged me a lot and I gained skills that are critical.

Aliza Watters
Assistant Dean for the Undergraduate Curriculum and Director of First-Year Seminars
Krieger School of Arts and Sciences

Amy Brusini, Senior Instructional Designer
Center for Teaching Excellence and Innovation

Image Sources: Lunch and Learn Logo, Beth Hals

Lunch and Learn: Inclusive Pedagogy

Posted on November 15, 2021 by abrusini

On Tuesday, October 19, 2021, the Center for Educational Resources (CER) hosted a virtual Lunch and Learn: Inclusive Pedagogy. Karen Fleming, Professor in Biophysics, and Mike Reese, Associate Teaching Professor in Sociology and CER director, each presented strategies that are important to them in helping to make their classes more inclusive:

Recognize that everyone comes from a different place with different experiences. Fleming mentioned The Privileged Poor, a book by Anthony Jack, that addresses the struggles faced by less privileged students after being admitted to elite universities. She explained that taking students’ backgrounds into consideration and embracing differences is vital to their success.
Try to instill a growth mindset. In her teaching, Fleming acknowledges to her students that the work is difficult, it can be a struggle at times, and it’s ok if you don’t get it right the first time – this is all part of learning. She tells her students that everyone has unlimited potential and encourages them to keep practicing and they will come away with new skills. Fleming stressed the importance of trying to get students to internalize this way of thinking and offers her students a great deal of positive reinforcement throughout the semester.
Show the humanity of science and diversify materials. Fleming described how she makes an effort to showcase diverse scientists who are working in the field – people of color, women, etc. Students need to see role models and images of people that look like them. Like Fleming, Reese explained how he also makes an effort to display photos of diverse experts in the fields as he discusses key findings or theories in sociology..
Learn students’ names. Reese acknowledged this can be a challenge if the class is large. He suggested instructors print out the student photo roster from SIS and/or bring tented name cards to the first class for students to display on their desks (if teaching in person) to help learn names. Reese stated that students are more engaged and come to office hours more often when he makes an effort to learn their names.
Use non-competitive grading strategies. Reese noted that this was one of the recommendations in JHU’s Second Commission on Undergraduate Education (CUE2) report. Using straight grading, rather than curved, is one example. Another example is to add a standard number of points to every students final score if they overall average is lower than expected, which might suggest the test was more challenging than intended.
Conduct a mid-semester survey. Reese described how he administers a brief mid-semester survey that is anonymous. He tells students ahead of time that he may not be able to address every concern, but will do his best to support them. Once submitted, he summarizes the results for students and outlines any changes he plans to make.
Explain the purpose of different components in your class. Reese gave the example of something basic like office hours. First generation students may not understand the purpose or value of office hours – it is a chance to ask for help but also discuss career goals with instructors. Taking the time to explain resources that are available to students has proven very useful.
Follow the principles of Universal Design for Learning (UDL). UDL is an approach to designing instruction in flexible ways in order to reduce barriers to learning. For example, instructors can provide alternatives when giving an assessment – some students may take an exam, others may submit a paper, etc. Reese acknowledged that this often means more work on his end, as he will be grading different types of assignments. He noted that although the format may be different, he is assessing students according to the same learning objectives.

The presentation continued with faculty attendees offering comments and suggestions of their own:

One faculty member explained how she thinks very carefully about what language she uses with students to mitigate her own implicit biases. She thinks about how certain words (i.e. binary language) may unintentionally signal something to students and is careful to avoid this whenever possible. Fleming agreed and stated how important it is that we all regularly examine our own biases; we should be open with students and let them know we are making an effort to communicate without bias. Reese mentioned the Harvard implicit bias test which is a tool that can help all of us discover our own hidden biases.
Another faculty member shared how she has found success with specifications grading to help instill a growth mindset. With specifications grading, students have multiple chances to succeed and are given lots of feedback to help them reach their goals. The faculty member also pointed out that using specifications grading is another example of a non-competitive grading strategy as students are only graded on the work they choose to complete.
An engineering faculty member has made an effort to proactively host events that feature speakers of varied races, cultures, and identities in order to show students who make up this particular field of study.
Another faculty member stressed the importance of using live captions and how beneficial they are to students and how much students appreciate them.

Towards the end, there were a few questions from the audience:

Q: Regarding growth mindset, what exactly do you say to students?

A: Fleming responded that she tells her students everyone can be successful with whatever task they are working on, that practice is important, and failure is ok. Some students feel that if they don’t succeed quickly, they are a failure and may lose motivation to persist on difficult topics. She described how she explains the process to students like a journey – you will get to a better place than you are now and you will become more confident with time and practice. Fleming gives her students lots of encouragement throughout the semester.

Reese added that he consistently provides feedback to students throughout the semester and continually shows them examples of their success.

Q: What about students’ own biases? This comes up in teaching evaluations.

A: Fleming explained how she includes a discussion about implicit bias with her students at the beginning of the semester. She tries to make her class a positive, inclusive environment and asks that students do the same by honoring and respecting others’ opinions. She also discusses stereotypes of scientists and asks students not to evaluate her in that way.

Q: I find that most of the time, female students do not speak up. What can we do about this?

A: Reese responded that if working in groups, a best practice is to ensure no group contains a minority of underrepresented minorities. For example, with groups of 3 there should be 0,2, or 3 woman in each group. He also suggested giving students multiple ways to participate, such as sharing questions through different modalities (email, chat, raising their hand to comment).

Q: Can we expand the time on assessments to accommodate everyone?

A: Reese replied yes, giving everyone more time will lower the pressure for everyone on that assessment. However, there are rules that still need to be followed. Reese suggested working with Student Disability Services if there are specific questions about accommodating students. Another option would be to allow students an alternative to a timed assessment.

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Lunch and Learn Logo, Pixabay

Lunch and Learn: Working with Teaching Assistants

Posted on March 2, 2021 by abrusini

On December 16, 2020, the Center for Educational Resources (CER) hosted a Lunch and Learn: Working with Teaching Assistants (TAs). Rebecca Pearlman, Senior Lecturer in Biology, and Reid Mumford, Instructional Resource Advisor in Physics and Astronomy, shared strategies for how to best work with TAs to support student learning. Mike Reese from the CER moderated the discussion.

Pearlman manages a mix of graduate and undergraduate level TAs in the Biology department each semester and has worked with hundreds of TAs during her career at Hopkins. Mumford manages approximately 30 graduate level TAs each semester as well as a group of undergraduate learning assistants who help with classroom tasks but do not take part in grading. The following is a combined list of strategies that the presenters shared during the presentation:

Set clear expectations – This could include a contract, job overview, checklist of duties, etc.
Provide tips for TAs so they are prepared for the semester – This may include training documents, resources, and tools they will need.
Take advantage of technology – Google Forms for identifying availability, Doodle polls for arranging meetings, Blackboard site to store answer keys, Slack/MS Teams to communicate among the instructional team.
Build community – Take an interest in the TAs and get to know them. This helps to establish positive relationships between the instructor and TAs and among the TAs themselves.
Meet weekly – Review upcoming course content, monitor progress of each section, ensure TAs understand their upcoming tasks. Mumford also uses his weekly meetings to provide feedback and encouragement to the TAs.
Designate a head TA, if possible – If you have a large number of TAs, it may be beneficial to designate a head TA to help you manage the rest of the group. With his large number of TAs each semester, Mumford relies heavily on his head TA to make sure weekly instructions and tasks are assigned appropriately.
Consider feedback from students – TA evaluations can offer helpful feedback to both TAs and instructors. Pearlman noted that student feedback is especially helpful if she needs to make decisions about rehiring a TA. She can pull quotes directly from the evaluations. Mumford noted that he always meets individually with each of his TAs to review their evaluations.

There were some questions from other faculty members after the presentation:

Q: To what extent do you use undergraduate TAs?

A: Mumford responded that by policy, all of the TAs in his department are graduate students. He went on to say that he finds that experienced TAs are valuable, but it is harder to change their behavior. If they are first year TAs, he has more of an opportunity to shape them. He does hire undergraduate learning assistants who assist with day to day tasks in the classroom but do not take part in any grading.

Pearlman stated that it seems to vary by department, but in biology, they have a mix of graduate and undgraduate TAs, and all of them participate in grading. She enjoys working with both populations, noting that the undergraduates tend to be self-starters, while the graduates bring a wealth of knowledge from the lab.

Q: To what extent is it useful for TAs to TA twice?

A: Pearlman responded that the undergraduate TAs often stay with her for years. They help each other and learn a lot by continuing in the role. They enjoy teaching the material more than once.

Q: How do you select your TAs?

A: Pearlman replied that the graduate level TAs are assigned to her department, but the undergraduates apply for the position. In the Fall 2020 semester she had 50 students apply for 18 positions. She uses a Google Form to ask them questions such as “why are you excited to be a TA? – or “what can you bring to the position?” Pearlman says she does review their grades, but they are not necessarily a priority; it often comes down to who is available at the right time.

Mumford responded that graduate TAs are assigned, but for the undergraduate learning assistants, he relies on referrals from the graduate TAs. He specifically asks them to recommend great students. He then follows up with an interview process. Mumford is able to choose his head TA and strongly considers diversity when choosing this person.

Other faculty shared various characteristics that they use to select TAs: enthusiasm for the subject matter, respect for others, patience with students, familiarity with course material, interest in teaching, and above average grades.

Q: What can I do about TAs who do not prioritize their TA duties, such as grading?

A: Reese suggested making expectations very clear but acknowledged that it is a struggle when the TAs have obligations to research faculty as well as their TA duties.

Mumford responded that he checks in with his TAs every week to try and keep them on task. If they are non-responsive, he escalates the issue to the graduate committee to handle. If it continues, he will also reach out to the student’s research advisor and discuss the situation with that person as well.

Pearlman suggested contacting the people who run the graduate program or the department chair for assistance. She also suggested bringing the issue up at a faculty meeting.

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Lunch and Learn Logo, Pixabay

Lunch and Learn: Alternatives to the Traditional Textbook

Posted on November 2, 2018 by Macie Hall

On Thursday, October 25, the Center for Educational Resources (CER) hosted the first Lunch and Learn for the 2018-2019 academic year. Marian Feldman, Professor and Chair of History of Art, Professor of Near Eastern Studies; and Joanne Selinski, Associate Teaching Professor and Director of Undergraduate Studies, Computer Science; presented on Alternatives to the Traditional Textbook.

Marian Feldman started with a presentation on the Open Educational Resource (OER) she created several years ago for her courses on ancient Mesopotamian art [see slides]. She commented that Mesopotamian art may seem esoteric; not many people are readily familiar with the subject matter. Mesopotamian culture began in the 10^th millennium BCE, centered in (but at times extending well beyond) what is now Iraq, and flourished in the Bronze and Iron Ages with the Sumerian, Akkadian, Babylonian, Assyrian, Neo-Assyrian, and Neo-Babylonian empires from the 3^rd millennium to the 6^th century BCE.

“Open Educational Resources are free and openly licensed educational materials that can be used for teaching, learning, research, and other purposes.” (creativecommons.org) Feldman’s motivation for creating OER for her course stemmed in large part from the fact that there was no good textbook available. The only text, The Art and Architecture of the Ancient Orient (Frankfort) was published in 1954, and though new editions were released up until 1996, the material was not updated. In 2017, a new text, Art of Mesopotamia (Bahrani), was published, but at $90 a copy, Feldman plans to stick with the OER she developed as a free alternative for her students that is also more directly relevant to the materials she covers.

The OER has other value as well. When Mesopotamian art is introduced in a standard survey of art course, a $90 textbook is overkill, while the modularity of her OER works perfectly for an introductory approach. Feldman was also interested in highlighting these works of art in a time when many cultural heritage sites and objects in the region have been destroyed or are under threat. The OER as an open resource puts information in the public domain where it is easily accessible.

Feldman applied for and won Technology Fellowship Grants (2015 and 2016) from the Center for Educational Resources (CER) that allowed her to work with two graduate students in Near Eastern Studies, Megan Lewis and Avary Taylor, to undertake the project. The CER advised her on a platform for sharing the modules—OpenStax CNX at Rice University. From the website: “OpenStax publishes high-quality, peer-reviewed, openly licensed textbooks that are absolutely free online and low cost in print.” OpenStax CNX was a good fit because Feldman was not particularly technology oriented, and it offered a relatively easy-to-use platform. She also liked the “knowledge chunks” concept where content modules can be aggregated into a custom “text” for students. The platform uses a Creative Commons license and content is freely accessible to all.

Feldman and her graduate students created 15 modules over two years. Each module is stand alone, and many incorporate videos. The modules can be downloaded as a PDF—which students found useful for study purposes—although multimedia content such as videos is not viewable in the PDF. She noted that because the platform is open, she cannot track use by individual students to be sure that they are viewing the modules. However, end-of-course surveys of the students indicated that they had found the OER modules to be valuable course content. She received positive feedback from colleagues as well. The one complaint from students was that at times the platform was slow, particularly when playing multimedia clips and downloading materials.

There were challenges with creating the OER modules. Feldman acknowledged that it was a lot of work. All multimedia content—images, videos, interactive materials—had to be in the public domain or permission had to be obtained from the rights holders. There were some technological challenges with the platform. Feldman described it as “clunky” at times. The built in HTML editor was easy to use, but limiting for formatting purposes. She had hoped that having the students use the modules might allow her to do less in-class lecturing, but that was not the case.

Feldman has run some analytics on the modules, using Google Analytics, and discovered that beyond her own use (and that of her students), the modules have been viewed by others, but perhaps not as much as she might have hoped. Over a 12-month period excluding JHU use, the various modules were viewed between 6 and 150 times. There was a big spread on the IP access—viewers came to the site from around the world. The relatively small numbers of viewers for her modules on OpenStax CNX are in contrast to a TED-Ed Animation project she worked on during the same time period, targeted at the K-12 constituency. The Rise and Fall of the Assyrian Empire has received over a million views!

Joanne Selinski introduced the audience to zyBooks, billed as an affordable, interactive, online textbook platform for STEM disciplines. Selinski is piloting the use of a zyBook for the Gateway Computing course she is teaching, although she had previously used a limited version of zyBooks in teaching a Java course. While zyBooks is not free, it is relatively low-cost, about $50 per student depending on instructor customizations.

Selenski noted that she had the opposite problem from Feldman—her field, computer science, is constantly changing and advancing so that texts become outdated quickly and must be updated frequently. Print texts simply can’t keep up with the changing curriculum. Moreover, courses are not standardized across departments and institutions, so a standardized text may not be flexible enough for adaptation to a particular curriculum. And, every instructor teaches standard courses differently, so there really is no such thing as a one-size-fits-all textbook. Thus the discipline has seen a move from print books to courseware on interactive platforms.

In Selinski’s experience, students didn’t read textbooks and she would have to repeat the information in class. Homework assignments applied the work done in class. Using zyBooks allowed her to flip her class model, with students learning concepts outside of class and doing applied work in class individually or in groups. She had wanted to flip her class previously, but didn’t want to use only videos for outside-of-class instruction. While she does use some videos as a supplement, zyBooks provided a great overall solution.

Selinski gave a demonstration of the customized zyBook that she developed for her Gateway Computing course. The modules are a mix of various types of demonstrations and exercises interspersed with fill-in-the-blank, true-false, and multiple choice questions. She finds that the quizzing while doing method is beneficial to student learning. There are challenge activities for students looking for more advanced work, but they are not required as in-class group work covers the challenge material. Everything is auto-graded. Selinski can choose which assignments will be graded. The biggest benefit is that students get introduced to the core material before they come to class.

Selinski noted that the company worked closely with her (and other JHU faculty in the pilot) to develop their texts from a menu of pre-created modules. She liked that zyBooks offers lots of options for customization. The interface is easy to use. She can add notes on the modules for specific instructions or to make comments. More advanced students can take advantage of extra materials. She was able to add a student who enrolled in the class late and change the deadlines/due dates for that individual. And, she can see who has done what in terms of the on-line work. Overall, zyBooks has great reporting features. Her one caveat was that students won’t do work unless it is required.

Because this is the first semester of use, she does not yet have data on student response to the platform, however informal comments suggest that students like it overall. She responded to student complaints that too much was required in the early part of the semester and reduced required material to some extent. She will like be more selective when using zyBooks next semester.

A lively discussion followed the presentations. There was a question about whether material from these alternative texts could be integrated into Blackboard, JHU’s course management system. In both cases, the answer is no, that these are separate platforms. Links to material can be provided in Blackboard, but the content resides on the platform—OpenStax or zyBooks.

Selinski was asked to elaborate on what students do during class time. Classes are small sections of 19 or fewer students, and she has a teaching assistant, so she can have them working individually or in small groups and oversee them all. Generally, there is an in-class assignment, activity, or problem to be solved that reflects the material covered in zyBooks. Sometimes students are working on paper, others times on their laptops, other times on the board. For some activities she may do a brief lecture for background before the students start working.

There were questions about the zyBooks platform, course development, and subscription model, and the availability of materials for students on both platforms after a course has ended. Selinski elaborated that zyBooks offers general texts that are updated frequently and can be customized by each instructor for their use. A course can be saved and copied for use in a subsequent semester. There is no sharing across institutions—another institution cannot readily see a JHU instance of a course. Students subscriptions are for the duration of the semester; after which they cannot access the course. They are able to download PDFs of content during the semester they are enrolled. Feldman noted that OpenStax CNX is by nature open and free accessible to anyone at any time.

There was some discussion about the benefits of interactivity, and there was agreement that modality should match the content being presented. As for print versus online, it is clear that it may come down to personal preference–some prefer reading online while others want a hard copy of a text. Feldman noted that the evolution of the Internet has led to a re-thinking of the concept of an intellectual canon for an area of humanistic study. The Internet allows a break from such narratives with inherent advantages and drawbacks. This has implications for how faculty teach and students learn. [See M.H. Feldman, Rethinking the Canon of Ancient Near Eastern Art in the Internet Age, Published Online: 2017-06-22, DOI: https://doi.org/10.1515/janeh-2016-0002.]

Finally, Mike Reese, Associate Dean of University Libraries, Director of the CER, and lecturer in Sociology, offered another alternative to the textbook that is free to students. In the courses he teaches he is committed to students not having to pay for textbooks. Instead he assigns materials such as e-books and research articles that are available to students through the library. This Lunch and Learn session demonstrated that there is more than one way to lower the cost of textbook materials for your students.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Sources: Web page screenshots

Lunch and Learn: Constructing a Comprehensive Syllabus

Posted on February 23, 2017 by Macie Hall

On Thursday, February 16, the Center for Educational Resources (CER) hosted the third Lunch and Learn—Faculty Conversations on Teaching—for the 2016-1017 academic year. Katie Tifft, Lecturer Biology, and Jane Greco, Associate Teaching Professor Chemistry, shared best practices for creating a comprehensive syllabus.

Tifft and Greco presented as a team, reflecting their commitment to collaboration, and gave an impressive overview of the process they follow. Here are their slides for review. They started by sharing a quote by Gary Gutting “Why Do I Teach?” [New York Times 5/22/2013]: “College education is a proliferation of . . . possibilities: the beauty of mathematical discovery, the thrill of scientific understanding, the fascination of historical narrative, the mystery of theological speculation. We should judge teaching not by the amount of knowledge it passes on, but by the enduring excitement it generates. Knowledge, when it comes, is a later arrival, flaring up, when the time is right, from the sparks good teachers have implanted in their students’ souls.”

This represents an ideal, but in real world practice your experience may differ. One way to ensure that students leave your classroom with the knowledge you hope they will gain is to think about how to construct your course so that the desired learning outcomes align with your pedagogical approaches.

Tifft and Greco noted that standard course planning path is to choose a textbook/readings, produce a syllabus, write or revise lectures and prepare slides, and then create assessments (exams and assignments). This is a teacher-centric approach as it revolves around the content that you as the instructor plan to disseminate.

But what if you wanted to develop a course that was student-centric? Then you might take an approach known as backward design. With backward design you start the course planning process by formulating broad learning goals, then defining specific, measurable learning objectives. To clarify, learning goals express what you want students to get out of the course, while learning objectives detail the specific skills and level of understanding you want students to obtain. Next you design the assessments that will be used to evaluate the students’ mastery of the learning objectives. Finally, you develop the course content and activities and choose supporting texts and readings. This process will help you to create a syllabus that informs the students what you expect them to be able to do at the end of the course, as you will share both the broad learning goals for the course and the learning objectives for each course section on the syllabus.

Tifft and Greco reported that research has shown that the longer and more detailed a syllabus is, the more comfortable students will be, because they can see ahead to what will be coming in the class. They suggest keeping a positive tone, focusing on rewards rather than consequences. They both emphasize collaborative work in their courses, and on the syllabi, which fosters a student-centric environment.

What should the syllabus include? The course schedule in some detail, along with the detailed learning objectives for each unit. The course content will be a major part of your syllabus. Policies for absences and missed work should be included and should be transparent, fair, and set an easily achievable bar by accommodating situations that are bound to occur, such as illness, sports team events, etc. One way to do this is to drop the lowest score if you give multiple quizzes, exams, or homework assignments. Tifft and Greco noted that well thought out and clearly written policies are essential in a large enrollment course, and will help reduce the number of emails from students.

The syllabus should give information about assessments and assignments including due dates, descriptions, the link to learning objectives. Setting the test and assignment dates in stone, so to speak, on the syllabus will help your students know what to expect when. Having a variety of assignments is a good practice as it speaks to the diversity of student learning styles. This isn’t always practical in a large lecture class, but should be considered.

If you are using clickers (classroom polling devices) you will want to include policies for use, credit given for participation, credit for correctness, and contribution to grade. Tifft and Greco do not give credit for correctness as they see that getting something wrong contributes to the student’s learning process.

Grades are a major concern for students at Johns Hopkins; Tifft and Greco said that it is important to be as specific and transparent as possible when describing grading criteria and distribution on the syllabus. Doing so will reduce student complaints and misunderstandings. Some practices to consider in creating a grading scheme include the concept of revision/redemption—giving students a chance to drop a low score or revise a paper. They recommend against grading on a curve to reduce competition and facilitate student collaboration.

Don’t forget to list sources of help for students: office hours, names and contact information for teaching assistants, dates and times for recitations/review sessions, and information about the Learning Den tutoring program or PILOT (peer led team learning) program if applicable.

Finally, Tifft and Greco mentioned the required and recommended statements of policy, such as those on ethics, accommodations for students with disabilities, and copyright compliance. And in closing, they recommend adding a line in your syllabus that reads: “The information on this syllabus is subject to change at any time for any reason.”

Discussion by the faculty in attendance followed. One question asked was “How do you get students to read the syllabus? Should you go over the syllabus in class?” Greco stated that since she is teaching first semester freshman, she spends about 20 minutes on the first day of class going over key points, especially the learning goals and her teaching philosophy. Tifft, who teaches upperclassmen does give a brief summary of key points.

Faculty also shared experiences with grading schemes. Many like the idea of dropping the lowest scores on tests and/or assignments and the concept of redemption, especially when based on how the student has done on other parts of the course work. Some faculty give several section-based exams followed by a comprehensive final. Students who have aced the section exams, are not required to take the final.

The use of extra-credit and make-up work to improve grades was debated. It was agreed that it was important to be transparent in these cases, and to make sure that all students are offered the same opportunities. Greco recommended that faculty not allow students to wait until the end of semester to do make up or extra-credit work as it puts too much burden on you as a grader.

The session ended with Tifft and Greco sharing this cartoon from PhD (Piled Higher and Deeper) by Jorge Cham, something anyone who has ever created a syllabus will relate to.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Image generated by http://www.keepcalm-o-matic.co.uk/

Developing and Facilitating Research-Based Assignments

Posted on December 16, 2015 by Macie Hall

On Tuesday, December 8, the Center for Educational Resources hosted the second offering in the new Lunch and Learn—Faculty Conversations on Teaching series with two faculty presenting on their experiences in developing and facilitating research-based assignments.

Elizabeth Rodini, Director, Program in Museums and Society and Teaching Professor in the Department of History of Art, led off with a presentation [presentation slides pdf] Incorporating Research into Teaching: 10 tips (in no particular order). Rodini has taught many courses during her time at JHU with students doing research-based assignments. While in some of these students have produced research papers, in many cases the assignments have been less traditional.

Here are Rodini’s ten tips:

Teach Skills—begin with your librarians, who can help students learn basic research skills. Invite a librarian to your class. Other discipline-specific skills include close looking and reading, descriptive writing, proper handling of objects, and learning how to reach out to experts for help.
Experiment with Format—move beyond the traditional research paper and have students make posters, create actual or virtual exhibitions (involves researching material, writing text, conceptualizing the whole), or develop an audio tour for an exhibition. Students learn alternative ways of presenting information (visual, oral) and can benefit from the potential public face of this work.
Let Content Drive Form—make sure that the content and your learning goals drive the format rather than choosing the form first and trying to build around it.
Smaller Is Often Better—doing too many projects in a semester can pose problems for you and your students. Consider how you can break one project into parts. Have students focus on doing one thing well.
Focus on Building Blocks—drawing from the previous teaching skills and smaller is better ideas, consider having students do the background work of a research paper without writing it up. For example, they turn in an annotated bibliography, an outline, and abstract, an opening paragraph, or they produce a research portfolio on a particular topic, gathering and ordering the information, perhaps giving an oral presentation. This approach is particularly effective for younger students who are just learning research skills.
Look to Other Disciplines—in a science lab, students have the opportunity to see project research as a collaborative process with contributors ranging from the senior faculty on down to undergraduates. This isn’t the case in the humanities. For humanities students the science lab model could be replicated in a group museum project, where the project research is conducted collaboratively toward a shared end with a public presentation. Some of the benefits: a “building block” approach to a project where different people contribute different things; students learn from/teach each other; use of a “lab meeting” format where students give regular, brief updates; and the professor can be part of the team, serving as a model for students.
Be A Locavore—encourage students to work on objects/materials/texts we have here in Baltimore. Local venues offer opportunities to connect, see, work with relevant archival material, meet experts, and do original
Vary The Feedback—writing comments on papers feels futile when you know they won’t be read. So try other things like oral presentations (use the final exam slot for this in a seminar), or poster sessions, and have outside experts come to these presentations to critique.
Practice Asking Questions—another skill/building block that many students are lacking is how to ask new questions of texts and images. In one of my freshman classes we start on the first day with, “What can you observe about an old pair of shoes and what else do you want to know?” [See the educational exercise from an exhibit at the Bata Shoe Museum, 50 Ways to Look at a Big Mac Box].
Insist on Revisions—to eliminate useless final comments and make the project worthwhile you can incorporate revisions to work starting early in the semester. Students benefit from genuine critiques to which they must respond.

Joel Schildbach, Professor in the Department of Biology and KSAS Vice Dean for Undergraduate Education, presented [presentation slides pdf] on his research-based course Phage Hunting. The course description reads: “This is an introductory course open to all freshman regardless of intended major. No science background is required. This is … a year-long research-based project lab course in which students will participate in a nation-wide program in collaboration with undergraduates at other colleges. Students will isolate and characterize novel bacteriophages (viruses that infect bacteria) from the environment using modern molecular biological techniques.”

The Hopkins Phage Hunters lab comes to JHU from the Howard Hughes Medical Institute’s Science Education Alliance – Phage Hunters Advancing Genomics and Evolutionary Science program (SEA-PHAGES). HHMI provides training for instructors and teaching assistants and support for this program across the country. The program is based the work of HHMI Professor Graham Hatfull, University of Pittsburgh.

Negotiating the network to find available positions in research labs around the University can be difficult, particularly for incoming freshman. The goal of this course is to provide freshmen students with a lab experience in a small course setting. Enrollments in the sections are limited to 24 students. Work in the lab starts on the first day, when students bring in a sample of dirt. They then begin a process of isolating a bacteriophage. Because phages are so numerous, it is likely that each of the isolated phages will have not been previously identified. During the course students isolate the phage, purify the DNA, and use an electron microscope to identify it. Assuming their phage has not been previously identified, the student gets to name it and send the record to a national archive. One phage per section is selected for genetic sequencing. The process is both challenging and rewarding.

The benefits to students include experiencing a quick time from the start to seeing progress;, gaining comfort in a lab setting; learning to deal with the failures, repeating processes, and finally, sense of achievement that define lab research; having a sense of ownership of their work; and developing a community of peers.

Schilbach noted that the labs are staffed with both instructors and PhD-level teaching assistants. He stressed that for faculty seeking to implement similar programs, it is essential to have sufficient resources—budget and staff—to ensure success.

For more on this course, see the blog, JHU Phage Hunters, with posts authored by students and instructors.

In the discussion that followed, attendees asked questions and talked about the mechanics of collaborative work and grading group projects. Not all students like group work because they don’t have control over the process, yet many of them will be required to work in teams once they graduate into the workforce. There was consensus that, at least for humanities projects, groups of three were a good number. Larger groups may encourage a phenomenon one faculty member called “social loafing” where a team member relies on others to do the work. It was suggested using contracts for group work, which the students can create themselves, to define the roles and responsibilities of each team member and criteria for evaluation. These can be used at the end of the project for the students to grade themselves and each other. This can them supplement the instructor’s grade. It is also possible for students to work in a group, but submit individual assignments. Elizabeth Rodini pointed out that some group projects may bear more fruit than others, so it is important to have multiple aspects on which to assess students.

In a related discussion, Joel Schildbach was asked about how students deal with failure in the lab. For the phage hunting course, this has not been a big issue, as historically, almost all students have been successful. The idea of repeating a process until you get results is integral to scientific research and the students in the course generally embrace this concept. As to grading, Schildbach uses a multi-tiered grading system based on benchmarks and time lines. There are also graded presentations and a paper at the end of the semester. He noted that freshman first semester grades are covered, which allows students to take some risks.

In regards to managing a number of end of the semester presentations, when those are substituted for a traditional paper, it was suggested that the slotted exam time could be used. Sometimes students are willing to meet in a special session for these presentations, particularly if refreshments are provided. A poster session is an efficient way to handle a larger group of presentations, especially if you invite other faculty or outside experts to assist in the review process.

Johns Hopkins Krieger School of Arts & Sciences and Whiting School of Engineer faculty will receive email invitations for the forthcoming Lunch and Learn presentations. We will be reporting on all of the sessions here at The Innovative Instructor.

*********************************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image sources: Lunch and Learn logo by Reid Sczerba, Center for Educational Resources. Other images were taken from the presentations by Elizabeth Rodini and Joel Schildbach.

Developing and Using Effective Active-Learning Exercises in Class

Posted on November 9, 2015 by Macie Hall

On Friday, October 30, the Center for Educational Resources launched our Lunch and Learn—Faculty Conversations on Teaching series with two faculty presenting on developing and using effective active-learning exercises in their classes.

Vince Hilser, professor and chair, Department of Biology led off with a presentation [presentation slides] describing how he had used active learning to help students understand a core concept, equilibrium, in his Biochemistry course. Showing his sense of humor, Hilser presented a timeline for the first semester he taught the course in 2011: August—Hilser prepares (brilliant) lectures. September, October, November—Hilser delivers (brilliant) lectures to students. January 2012—Hilser receives student evaluations and realizes that students did not learn from (brilliant) lectures.

Convinced that understanding the principle of equilibrium would enable students to truly learn it, Hilser wondered if he could help his students actually see an example of equilibrium. A classic demonstration of equilibrium is the so-called Apple Wars: An apple tree straddles the properties of two neighbors with yards separated by fences. Every fall the tree drops its fruit and the old man and young man throw the unwanted apples into each other’s yards. Ultimately, as they are throwing, the number of apples on each side will reach a constant state, which is at equilibrium.

In Hilser’s classroom (a large lecture hall), a long line of yellow police caution tape running from front to back stood for the fence. Ping pong balls represented the apples. Students on one side were the young man and could fetch and throw with both hands, on the other side, the old man students were handicapped by being allowed to fetch and throw with the left hand only. A blast from a whistle started the students throwing ping pong balls across the fence, retrieving and throwing back. At the end of a timed sequence the balls were gathered on each side and counted. The exercise was repeated and the results echoed those of the first round. Then Hilser introduced the equation for equilibrium, filling in the results from the ping pong war demonstration to demonstrate the application of variables. Once the students have seen in real life what equilibrium is, the equation make sense to them. They can then move on to methods of inquiry and how biological systems work.

Hilser could see from course assessments that students had a firmer grasp of the concepts. Evaluations showed that 86% of the students felt that the apple wars demonstration was effective in helping them to understand and apply the concept of chemical equilibrium. Students trusted the facts because they had experienced the proof. One student commented, “This really made me believe that organized randomness occurs in nature,” a statement that shows a high level of perception and extrapolation. Hilser’s presentation demonstrated that a good active-learning exercise can be worth more to students than a lot of words from the sage on the stage.

Todd Hufnagel, Professor in the Department of Materials Science and Engineering, presented [presentation slides] on his experience with using peer instruction in his Structure of Materials course. This class typically has 20 to 25 students.

In 2011 Hufnagel received a grant from the National Science Foundation (NSF). In response to the broader impacts requirement, he decided pursue an educational research project. For Hufnagel, a core principle underscores his teaching philosophy as articulated in this quote from Herbert A. Simon: “Learning results from what the student does and thinks and only from what the student does and thinks.” The grant allowed him to test whether student learning outcomes would be better if the course was taught using an active-learning model or using a traditional lecture style by teaching it twice each way in alternating years.

He turned to a model developed by Harvard’s Professor of Physics, Eric Mazur, involving the use of concept inventories and peer learning. “A concept inventory is a criterion-referenced test designed to determine whether a student has an accurate working knowledge of a specific set of concepts.” Students are given a concept inventory test at the beginning of the semester and again at the end of the semester to measure their learning gains.

During the semester, the concept questions are used as a basis for peer instruction. Hufnagel introduces a slide with a multiple choice question. Students use their clickers to vote on what they think is the correct answer. Hufnagel shows them a histogram of all the answers. If the histogram indicates that students are confused as to the correct answer, he asks students to discuss the question in pairs of small groups. Based on the idea that the best way to learn something is to teach it, students who know the correct answer will explain the concept to those who don’t.

After discussing the question, the students are asked to vote again. The instructor can then determine the level of understanding and proceed with a full explanation, a quick clarification, or simply affirm that the students are correct and move on to the next concept.

Is active learning better? Hufnagel’s comparison of teaching the class two ways showed that improvement in concept inventory scores in lecture version of class was 63%, for the active learning classes the improvement was 100%. He also surveyed the students about how their confidence in understanding the material. Interestingly, the lecture course students rated their knowledge much higher than the active learning students. Hufnagel thought this is because the active learning setting makes students realize how much they don’t know, while the lecture course students aren’t as aware of what they don’t know.

Hufnagel detailed the pros and cons of using a peer-instruction approach. On the plus side, students learn more, and the instructor gets more effective feedback on what they students actually know as s/he circulates through class listening to their discussion. Hufnagel also noted that this approach was much more fun for him as a teacher. The drawbacks are that it can be more difficult to “cover the material,” and there is a significant time commitment on the part of the faculty. For the first, Hufnagel noted that the important thing is that students understand the material that is covered, and that students can be made responsible for learning some of the content outside of class. As to the second, while it is easier and faster for faculty to write lectures, once the concept questions are written, they have a long shelf life and can be re-used. In the end, the strong evidence of improved student learning gains with active learning is a compelling argument for using these teaching strategies.

Faculty attendees had questions and made comments during the discussion period. Following is a summary of some of the main points.

On ways of handling coverall “all the material,” Hufnagel assigns reading and watching videos outside of class. He finds the students like the videos as they can tackle content on their own schedule and repeat as often as needed to understand the material. There is quick four question quiz on the assignment to encourage students to both do the work and to help them retain the concepts. Research tells us that students learn by being asked to recall content frequently. He spends the first five minutes of class talking informally, perhaps brining in a topical information to increase interest, then spends the rest of the class on concept questions. Typically he will get through about six questions per class. He tells his students that he has data that show students learn better with active learning and that helps with buy-in to what may be a new learning experience.

To faculty questioning how much time had to be allocated for active learning exercises, Hilser explained that the ping pong ball demonstration takes an entire class, but it establishes an understanding of a concept so fundamental to the course that is it worth the time spent.

A question, “What about teaching the facts? What if students don’t absorb enough factual knowledge?” led to a response by Hilser that there are many facts that are critically important as base knowledge, absolutely required facts. But he and Hufnagel agreed that beyond the core facts, students can look up information. The instructor’s role is to provide context.

One attendee noted that he has participated as an instructor in a department where lecture and active learning course covering the same content are running in parallel. The active learning class do slightly better (10%) on exams, but they are much happier in class–more satisfaction is seen in the active learning students.

*******************************************************************************************

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image sources: Lunch and Learn logo by Reid Sczerba, Center for Educational Resources. Other images were taken from the presentations by Vince Hilser and Todd Hufnagel.

The Innovative Instructor

Pedagogy – Best Practices – Technology

Tag Archives: Lunch and Learn

Lunch and Learn: Active Learning Techniques

Lunch and Learn: Canvas Show and Tell

Lunch and Learn: First-Year Seminars

Lunch and Learn: Inclusive Pedagogy

Lunch and Learn: Working with Teaching Assistants

Lunch and Learn: Alternatives to the Traditional Textbook

Lunch and Learn: Constructing a Comprehensive Syllabus

Developing and Facilitating Research-Based Assignments

Developing and Using Effective Active-Learning Exercises in Class