Author Archives: abrusini

Teaching Cinema with Omeka

Posted on by
Reply

Since the death of the DVD player, several challenges have emerged for media-based courses: How can we give students access to a wide range of audiovisual, image, and text sources located on multiple different online platforms? What is the most efficient way for the instructor to access these materials in class spontaneously, and for students to be able to work with the materials on their own? Can we do this in a way that allows for critical engagement and sparks new associations? Can we make that engagement interactive? To address these challenges, graduate fellow Hale Sirin and I discovered Omeka, an open-source exhibition software tool developed at George Mason University. We found the Omeka platform optimal for creating media-rich digital collections and exhibitions.Omeka website Home page for Comparative Cinema

In Fall 2019, funded by a Center for Teaching Excellence and Innovation (CTEI) Technology Fellowship Grant, we created and customized an instance of Omeka with the specific goal of designing a web-based environment to teach comparative cinema courses. We implemented the Omeka site in Spring 2020 for the course “Cinema of the 1930s: Communist and Capitalist Fantasies,” further supported by a CTEI Teaching Innovation Grant. This course compares films of the era in a variety of genres (musical, epic, Western, drama) from different countries, examining the intersections between politics and aesthetics as well as the lasting implications of the films themselves in light of theoretical works on film as a medium, ethics and gender. We adapted the online publishing software package into an interactive media platform on which the students could watch the assigned films, post comments with timestamps, and help expand the platform by sharing their own video essays. We built this platform with sustainability in mind, choosing open-source software with no recurring costs so that it could be used over the years and serve as a model for future interdisciplinary and comparative film and media courses.

When building this website, our first task was to organize the digital archive of film clips and film stills for the course. These materials were then uploaded to Panopto, the online streaming service used by JHU, and embedded in the Omeka site.screenshot of embedded film hosted in Kanopy We also embedded the films that were publicly available on YouTube, Kanopy, and other archives, such as the online film archive of the production studio Mosfil’m, designing the Omeka site to serve as a single platform to stream this content. Each film, clip, text, or image was tagged with multiple identifiers to allow students to navigate the many resources for the course via search and sort functions, tags and hyperlinks, creating an interactive and rich learning environment. We added further functionality to the website by customizing interactive plugins, such as the “Comments” function, which allowed us to create a thread for each film in which students could respond to the specific prompts for the week and to timestamp the specific parts of the film to which their comments referred.

In order to abide by copyright laws, only films in the public domain were streamed in their entirety. For other films, we provided selected short clips on Omeka, which we were able to easily access during class. Students were able to access the films available on Kanopy through our website by entering their JHU credentials.

Teaching comparative cinema with the interactive website powered by Omeka provided the students with a novel way of accessing comparative research in film studies. The website served as a single platform, interconnecting the digital material (video, image and text) and creating an interactive and rich learning environment to enhance student learning both in and outside of class time. Rather than the materials being fixed to the syllabus week to week, students could search film clips by director, year, country, or theme. Students were thus able to compare and contrast many images and films from across cultural divides on a unified online platform.

Students were not only able to access the course materials on the Omeka site, but also to expand and re-structure the content. screenshot of Scarlett Empress film clip in Omeka site Over the course of the semester, students contributed to the annotation of film clips by uploading their comments to the films and timestamping important sequences. Since they were also required to draw their presentations from material in the exhibition, their engagement on the site was quantifiable on an on-going basis. As their final projects, they had the option of creating a video essay, which involved editing together clips from the films, and recording an interpretive essay over them, like a commentary track. Their video essays were shared with their peers on the Omeka site.

After switching to online learning in Spring 2020 due to Covid19, the Omeka site not only performed its original task, but was flexible enough to give us the opportunity to build an asynchronous, alternative educational environment, now not only hosting the course materials and discussion forums, but also the weekly recorded lectures, recordings of our Zoom discussion sessions, and students’ final video essays.

We thank the Center for Teaching Excellence and Innovation (previously known as the Center for Educational Resources) and the Sheridan Libraries for their support and continual guidance during this project.

Additional Resources:

https://omeka.org/

https://blogs.library.jhu.edu/2016/08/omeka-for-instruction/

Authors’ Backgrounds:

Anne Eakin Moss was an Assistant Professor in JHU’s Department of Comparative Thought and Literature, a board member of the program in Women, Gender, and Sexuality and of the Center for Advanced Media Studies. She was the 2017 recipient of the KSAS Excellence in Graduate Teaching/Mentorship Award and a Mellon Arts Innovation Grant, and a 2019 KSAS Discovery Award winner. Since the fall of 2021, she has been at the University of Chicago where she is an Assistant Professor in the Department of Slavic Languages & Literatures.

Hale Sirin is a Ph.D. Candidate in the Department of Comparative Thought and Literature. A recipient of the Dean’s Teaching Fellowship and the Women, Gender, and Sexuality teaching fellowship, she has taught courses in comparative literature, philosophy, and intellectual history. Her research interests include early 20th-century philosophy and literature, theories of representation and media in modernity, and digital humanities.

Image source: Hale Sirin

Lunch and Learn: Evaluating Teaching Effectiveness

Posted on by
2

This post summarizes recent Lunch and Learn discussions among Homewood faculty about methods for evaluating teaching effectiveness. This discussion supported the work of the Provost’s ad hoc Committee on Teaching Evaluations. Provost Kumar established this committee in response to the Second Commission on Undergraduate Education report, which included a recommendation to establish a new system for the assessment of teaching and student mentoring by faculty.  This was the first of multiple conversations the committee will hold with faculty, graduate students, and undergraduates.

Fifty faculty joined one of two discussions (February 16th and 22nd) moderated by Vice Deans of Undergraduate Education, Michael Falk and Erin Rowe, along with Mike Reese of the Center for Teaching Excellence and Innovation (CTEI).

The Vice Deans reviewed principles and objectives drafted by the committee to collect faculty feedback and suggestions for improvement. Attendees then discussed methods of improving how we evaluate teaching based on these principles and objectives that go beyond the current system of teaching evaluations.  The following summarizes some of the attendees’ comments.

  • Teaching Evaluations serve multiple purposes: students use them to choose courses, faculty use them to improve their teaching, Homewood Academic Council uses them in promotion and tenure decisions, and schools use them for program assessment and accreditation. One mechanism – course evaluations (or student evaluations of teaching) – should not serve all these purposes.
  • Using multiple methods of evaluating teaching (peer evaluation, review of course materials, etc.) and not just traditional course evaluations, will minimize student bias against underrepresented minorities.
  • An attendee shared that when she worked at a more teaching-focused college, it included a committee of peer evaluators – faculty trained to provide feedback. The instructor would meet with the peer evaluator before class to discuss lesson plans and then debrief after the observation. Junior faculty were reviewed more frequently than senior faculty. They tried to find a peer match based on discipline. This review was used as a formative assessment and also summative assessment when someone came up for promotion.
  • Another professor shared that at West Point, instructors attended formal training on how to teach. Senior faculty came in three times during the semester to observe new instructors in class with a defined rubric that was shared beforehand. As for course evaluations, only the instructor saw them; the department chair did not. Student comments did not play any role in promotion.
  • With more faculty recording their classes, peer evaluators could review those recordings and provide feedback on those videos. This is apparently done at the Harvard Business School.
  • Someone raised the question, what is considered “quality teaching?” and suggested there must be some standard.  We need to consider how much we weight the entertainment value of sitting in class or comfort level of students as opposed to being inspired to pursue a career or digging in deeper [learning more about topic].  Who decides that focus for course evals and how to do it? Another person asked the individual who raised the question for his thoughts on this question. He responded, “In engineering, every class must have an objective and we need to demonstrate we are collecting data to show we are meeting it. Another is to have an expert – maybe in sociology or psychology – to write a question that measures if the class in interesting or stimulating to be in.”
  • One instructor raised the question of who are the experts to conduct evaluations. Attendees mentioned instructional design staff at the Center for Teaching Excellence and Innovation, but also felt that discipline-based education experts were needed. Teaching faculty familiar with discipline-specific teaching strategies (e.g., math, engineering, humanities seminars) should also be considered.
  • For evaluation of teaching effectiveness, the most important thing is measuring what the students have learned and, ideally, retained over long periods. We need concept inventories and tests of student knowledge beyond the end of a class, possibly in future semesters.  Peer evaluations could be part of the process of helping instructors improve, but they don’t really measure learning.
  • An instructor shared, “At my previous institution, we assessed teachers through narratives describing changes they made [in their course] based on new studies that have been published in their areas, in addition to participation in teaching workshops/conferences, and adoption of new practices. I would also suggest we evaluate teaching rigor in some of the same ways we evaluate scientific rigor. Look at whether faculty make their resources open and accessible, use OER, etc.”
  • One professor suggested faculty share with students the purpose of course evaluations and how they will be used. It may discourage complaining. “I tell them I read their comments and my boss reads them. I’ve seen biased comments decline since I shared that with students.”
  • Another instructor said the dean’s offices could provide a script for instructors to read about how course evaluations are used and the importance of students civilly communicating feedback.
  • Course evaluations should be filtered for racist and misogynistic comments so faculty are not subject to them.
  • Course evaluations could include a checklist of comments so student feedback is more specific. Students would select the statements that are relevant to their instructor in addition to entering open comments.
  • It would make the surveys longer, but someone suggested every comment students make should be required to include at least one specific example as evidence.
  • One instructor asked, “How do we tease apart teaching effectiveness so they focus on learning and not grading?”
  • Is it possible to ask students to reflect on gateway or core classes sometime in the future to identify how the course provided foundational skills for future courses or co-curricular activities (e.g., internships)? Someone added, “This week I had a senior tell me, ‘I didn’t realize that those concepts really would come up over and over in my other classes, but they did!’” Another attendee shared, “They also report back 3+ years after graduating to say that they use something they learned in class that during the time they thought would be useless.”
  • Perhaps it would also be helpful to leverage our alumni network as one way to capture the enduring effects of learning from various classes.
  • Another instructor mentioned that it can also help to ask students for feedback during the semester so you can adjust instructional methods.
  • Whatever system is developed should not place undue administrative burden on faculty who are already taking on more administrative burdens.
  • An instructor remarked that once a change is implemented, faculty will need training on the new system of evaluation. It will also help encourage professors to be open to this process. Support for instructors assessing the results of evaluations will be critical.

One faculty member shared two books to inform the committee’s future work:

If you have questions or comments about the teaching evaluation process, feel free to email Mike Reese.

Mike Reese, Associate Dean and Director, CTEI
Mike Reese is Associate Dean of University Libraries and Director of the Center for Teaching Excellence and Innovation. He has a PhD from the Department of Sociology at Johns Hopkins University.

Image Source: Lunch and Learn Logo, Unsplash

 

Transitioning to Canvas: an Update on the University’s LMS Migration Process

Posted on by
Reply

On Tuesday, December 7, 2021, the Center for Educational Resources (CER) hosted a virtual Lunch and Learn that reviewed the university’s upcoming migration to Canvas, the new learning management system (LMS) that will replace Blackboard. Brian Cole, Associate Director for the CER and leader of the LMS migration committee, provided an update and summary of the process which was followed by faculty Q and A.

Cole began with a brief explanation of why the university is migrating to Canvas: the university’s contract with Blackboard will end at the end of this fiscal year so we must choose a new system. In addition, our current version of Blackboard is outdated and increasingly unreliable, especially when using the more complex tools such as tests. Last spring, a university-wide LMS evaluation process was held and the majority of stakeholders (faculty, staff, and students) selected Canvas as the future LMS.

Key dates for faculty to keep in mind:

  • Spring 2022 – The university will run a small Canvas pilot, with approximately 50 courses from across all JHU divisions.
  • Summer 2022 – ASEN summer courses will be ‘opt-in:’ ASEN instructors can choose between staying in Blackboard or using Canvas for Summer 2022 courses. (If you are teaching a summer course that is not in ASEN, please check with your division’s teaching and learning center.)
  • Fall 2022 – No courses offered in Blackboard, everything in Canvas.
  • December 1, 2022 – Blackboard access turned off.

Faculty will have a choice between building a new course from scratch in Canvas, or migrating existing course content over from Blackboard. Cole highly encouraged faculty to build from scratch if the course is mostly content-based and does not use many complicated tools; this will give faculty an opportunity to learn their way around Canvas.  If a course uses more complicated features, such as tests, faculty might want to consider a migration, either on their own, or with CER assistance.

The CER will provide multiple opportunities for training and help throughout the migration process. Training for Homewood faculty will begin in late spring of 2022. There will also be live and on-demand trainings led by Canvas professionals available to JHU faculty.

Cole concluded with a brief demo of Canvas which led to a Q and A session:

Q: How much time will it take to migrate a course?
A: This will depend on how complex your course is, how many tools you use now.

Q: Can faculty use the free Canvas site?
A: Yes, if faculty want to experiment and get to know Canvas, they can create a free account available at https://canvas.instructure.com/register,  but anything posted there becomes the intellectual property of Canvas. We will not support migrating any content created using the free account to your JHU Canvas account. Also, not all features available in the free environment will be available in the JHU environment.

Q: What about third party tools (VoiceThread, Panopto, Turnitin, etc.)?
A: Most third party tools will be available in Canvas. The appearance of a tool may differ from the way it appears in Blackboard, but the functionality should be similar.

Q: What about section merges? Will we still be able to do that?
A: Yes. Sections will work differently in Canvas – child courses will be more integrated with parent courses. The process of creating merged sections will change, but it should work more efficiently.

Q: Can you copy directly into the content editor?
A: Yes, you can copy directly into the content editor and it should work better than when you copy into Blackboard’s content editor.

Q: Does Canvas have a good discussion board that can replace Piazza?
A: There are two versions of discussion boards in Canvas. The old one is very similar to Blackboard. The newer one is updated and is closer to the way Piazza works – there are features such as a TA or instructor being able to approve an answer, it has a ‘mentions area,’ like Piazza, but it does not have everything.

Q: How will courses that are not migrated from Blackboard be archived?
A: Blackboard archive file are .zip files – they are only readable by the Blackboard system. We will advise exporting certain pieces – gradebook/grades, for example. But we have to be careful with grades for FERPA reasons. IT@JH will archive as much as they can, but it will be kept in an offline state, for accreditation purposes only. The archiving process is not entirely worked out yet.

Q: How do you give feedback to students in Canvas?
A: Assignments are graded using something called Speedgrader – this is similar to the way Blackboard assignments are graded. There are also more analytical tools available to give you an idea of how your students are doing in the course. These tools may help to streamline who you may need to contact. It is very easy to message students from different areas of a course.

Q: Will there be integration with Teams, Sharepoint, and OneDrive?
A: It is anticipated that Teams and OneDrive integration will be ready for the Fall 2022 semester.

Q: Will faculty have early access to their courses?
A: Faculty may begin working on a migrated or developmental version of their course as early as April. Official Summer 2022 and Fall 2022 courses will be available in Canvas in roughly the same timeframes as they were in Blackboard.

Q: What about archiving in Canvas?
A: It is very easy to move or reference material stored in a previous Canvas course. Course copy works much better in Canvas than in Blackboard – it is much more granular. There is also the ability to create specific modules that can be developed and shared among departments.

For additional information about the transition to Canvas, faculty can access: http://canvas.jhu.edu. There is also a mailing list faculty can join to stay informed: https://jh.qualtrics.com/jfe/form/SV_5bWaTLyFV5WJTg2

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Lunch and Learn Logo, Canvas Logo

Lunch and Learn: Inclusive Pedagogy

Posted on by
Reply

On Tuesday, October 19, 2021, the Center for Educational Resources (CER) hosted a virtual Lunch and Learn: Inclusive Pedagogy. Karen Fleming, Professor in Biophysics, and Mike Reese, Associate Teaching Professor in Sociology and CER director, each presented strategies that are important to them in helping to make their classes more inclusive:

  • Recognize that everyone comes from a different place with different experiences. Fleming mentioned The Privileged Poor, a book by Anthony Jack, that addresses the struggles faced by less privileged students after being admitted to elite universities. She explained that taking students’ backgrounds into consideration and embracing differences is vital to their success.
  • Try to instill a growth mindset. In her teaching, Fleming acknowledges to her students that the work is difficult, it can be a struggle at times, and it’s ok if you don’t get it right the first time – this is all part of learning. She tells her students that everyone has unlimited potential and encourages them to keep practicing and they will come away with new skills. Fleming stressed the importance of trying to get students to internalize this way of thinking and offers her students a great deal of positive reinforcement throughout the semester.
  • Show the humanity of science and diversify materials. Fleming described how she makes an effort to showcase diverse scientists who are working in the field – people of color, women, etc. Students need to see role models and images of people that look like them. Like Fleming, Reese explained how he also makes an effort to display photos of diverse experts in the fields as he discusses key findings or theories in sociology..
  • Learn students’ names. Reese acknowledged this can be a challenge if the class is large. He suggested instructors print out the student photo roster from SIS and/or bring tented name cards to the first class for students to display on their desks (if teaching in person) to help learn names. Reese stated that students are more engaged and come to office hours more often when he makes an effort to learn their names.
  • Use non-competitive grading strategies. Reese noted that this was one of the recommendations in JHU’s Second Commission on Undergraduate Education (CUE2) report. Using straight grading, rather than curved, is one example. Another example is to add a standard number of points to every students final score if they overall average is lower than expected, which might suggest the test was more challenging than intended.
  • Conduct a mid-semester survey. Reese described how he administers a brief mid-semester survey that is anonymous. He tells students ahead of time that he may not be able to address every concern, but will do his best to support them. Once submitted, he summarizes the results for students and outlines any changes he plans to make.
  • Explain the purpose of different components in your class. Reese gave the example of something basic like office hours. First generation students may not understand the purpose or value of office hours – it is a chance to ask for help but also discuss career goals with instructors. Taking the time to explain resources that are available to students has proven very useful.
  • Follow the principles of Universal Design for Learning (UDL). UDL is an approach to designing instruction in flexible ways in order to reduce barriers to learning. For example, instructors can provide alternatives when giving an assessment – some students may take an exam, others may submit a paper, etc. Reese acknowledged that this often means more work on his end, as he will be grading different types of assignments. He noted that although the format may be different, he is assessing students according to the same learning objectives.

The presentation continued with faculty attendees offering comments and suggestions of their own:

  • One faculty member explained how she thinks very carefully about what language she uses with students to mitigate her own implicit biases. She thinks about how certain words (i.e. binary language) may unintentionally signal something to students and is careful to avoid this whenever possible. Fleming agreed and stated how important it is that we all regularly examine our own biases; we should be open with students and let them know we are making an effort to communicate without bias. Reese mentioned the Harvard implicit bias test which is a tool that can help all of us discover our own hidden biases.
  • Another faculty member shared how she has found success with specifications grading to help instill a growth mindset. With specifications grading, students have multiple chances to succeed and are given lots of feedback to help them reach their goals. The faculty member also pointed out that using specifications grading is another example of a non-competitive grading strategy as students are only graded on the work they choose to complete.
  • An engineering faculty member has made an effort to proactively host events that feature speakers of varied races, cultures, and identities in order to show students who make up this particular field of study.
  • Another faculty member stressed the importance of using live captions and how beneficial they are to students and how much students appreciate them.

Towards the end, there were a few questions from the audience:

Q:  Regarding growth mindset, what exactly do you say to students?

A: Fleming responded that she tells her students everyone can be successful with whatever task they are working on, that practice is important, and failure is ok. Some students feel that if they don’t succeed quickly, they are a failure and may lose motivation to persist on difficult topics. She described how she explains the process to students like a journey – you will get to a better place than you are now and you will become more confident with time and practice. Fleming gives her students lots of encouragement throughout the semester.

Reese added that he consistently provides feedback to students throughout the semester and continually shows them examples of their success.

Q: What about students’ own biases? This comes up in teaching evaluations.

A: Fleming explained how she includes a discussion about implicit bias with her students at the beginning of the semester. She tries to make her class a positive, inclusive environment and asks that students do the same by honoring and respecting others’ opinions. She also discusses stereotypes of scientists and asks students not to evaluate her in that way.

Q: I find that most of the time, female students do not speak up. What can we do about this?

A: Reese responded that if working in groups,  a best practice is to ensure no group contains a minority of underrepresented minorities. For example, with groups of 3 there should be 0,2, or 3 woman in each group. He also suggested giving students multiple ways to participate, such as sharing questions through different modalities (email, chat, raising their hand to comment).

Q: Can we expand the time on assessments to accommodate everyone?

A: Reese replied yes, giving everyone more time will lower the pressure for everyone on that assessment. However, there are rules that still need to be followed. Reese suggested working with Student Disability Services if there are specific questions about accommodating students. Another option would be to allow students an alternative to a timed assessment.

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Lunch and Learn Logo, Pixabay

 

Quick Tips: Alternative Assessments

Posted on by
Reply

Throughout the past year and a half, instructors have made significant changes to the way they design and deliver their courses. The sudden shift to being fully remote, then hybrid, and now back to face-to-face for some courses has required instructors to rethink not only the way they teach, but also the way they assess their students. Many who have previously found success with traditional tests and exams are now seeking alternative forms of assessment, some of which are described below:

Homework assignments: Adding more weight to homework assignments is one way to take the pressure off of high stakes exams while keeping students engaged with course material. Homework assignments will vary according to the subject, but they may include answering questions from a chapter in a textbook, writing a summary of a reading or topic discussed in class, participating in an online discussion board, writing a letter, solving a problem set, etc.

Research paper:  Students can apply their knowledge by writing a research paper. To help ensure a successful outcome, a research paper can be set up as a scaffolded assignment, where students turn in different elements of the paper, such as a proposal, an outline, first and second drafts, bibliography, etc. throughout the semester, and then the cumulative work at the end.

Individual or group presentations: Student presentations can be done live for the class or prerecorded ahead of time using multimedia software (e.g., Panopto, VoiceThread) that can be viewed asynchronously. Depending on the subject matter, presentations may consist of a summary of content, a persuasive argument, a demonstration, a case study, an oral report, etc. Students can present individually or in groups.

Reflective paper or journal: Reflective exercises allow students to analyze what they have learned and experienced and how these experiences relate to their learning goals. Students develop an awareness of how they best acquire knowledge and can apply these metacognitive skills to both academic and non-academic settings. Reflective exercises can be guided or unguided and may include journaling, self-assessment, creating a concept map, writing a reflective essay, etc.

Individual or group projects: Student projects may be short-term, designed in a few weeks, or long-term, designed over an entire semester or more. If the project is longer term, it may be a good idea to provide checkpoints for students to check in about their progress and make sure they are meeting deadlines. Ideas for student projects include: creating a podcast, blog, interactive website, interactive map, short film, digital simulation, how-to guide, poster, interview, infographic, etc. Depending on the circumstances, it may be possible for students to partner with a community-based organization as part of their project. Another idea is to consider allowing students to propose their own project ideas.

Online Tests and Exams: For instructors who have moved their tests online, it may be worth considering lowering the stakes of these assessments.  Instead of high-stakes midterms and finals, replace them with weekly quizzes that are weighted lower than a traditional midterm or final. Giving more frequent assessments allows for additional opportunities to provide feedback to students and help them reach their goals successfully. To reduce the potential for cheating, include questions that are unique and require higher-level critical thinking. Another consideration is to allow at least some of the quizzes to be open-book.

It’s worth noting that offering students a variety of ways to demonstrate their knowledge aligns with the principles of universal design for learning (UDL). Going beyond traditional tests and exams helps to ensure that all learners have an opportunity to show what they have learned in a way that works best for them. If you’re looking for more ideas, here are a few sites containing additional alternative assessment strategies:

https://www.scholarlyteacher.com/post/alternatives-to-the-traditional-exam-as-measures-of-student-learning-outcomes

https://teaching.berkeley.edu/resources/course-design-guide/design-effective-assessments/alternatives-traditional-testing

https://cei.umn.edu/alternative-assessment-strategies

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay

Strategies for an Inclusive Classroom

Posted on by
2

This summer, the Center for Educational Resources offered a multi-day Best Practices in University Teaching workshop for JHU faculty to learn about evidence-based teaching practices. Participants explored topics such as best practices in course design, active learning strategies, and various assessment techniques. One of the many sessions that generated a great deal of discussion was the Inclusive Pedagogy session, which addressed the importance of accommodating the needs of diverse learners in a supportive environment.  The session was led by Dr. Karen Fleming, a professor in the Biophysics department who is also nationally recognized for her efforts in raising awareness on overcoming biases and barriers to women in STEM.  I played a small role in the presentation by providing a brief introduction and overview of Universal Design for Learning (UDL), a research-based educational framework that helps remove unnecessary barriers from the learning process.

During the session, participants were encouraged to examine their own biases by reflecting on an unconscious bias test they took just before the session. Many were clearly dismayed by their own results; Fleming reassured them that we all have biases and that accepting this fact is the first step in addressing them.  She then shared a real-world example of unconscious bias toward women in STEM that is published in the Proceedings of the National Academy of Sciences. The shocking results of this study, which show that even women faculty in STEM display a preferential bias toward males over females, resulted in an engaging discussion. The dialogue continued as participants then debriefed about a video they watched, also before the session, which featured a teaching assistant (TA) stereotyping various students as he welcomed them to class.  The video was intentionally exaggerated at times, and participants were eager to point out the “over the top” behavior exhibited by the TA. Participants were inspired to share personal experiences of bias, prejudice, and stereotyping that they’ve encountered in the classroom either as students or instructors.

Toward the end of the session, the focus shifted to thinking about strategies that would mitigate instances of biased behavior and instead encourage a more inclusive classroom environment. hands reaching toward each otherAs a culminating exercise, we asked participants to consider the principles of UDL as well as ideas and discussions from earlier in the session to complete an “Inclusive Strategies Worksheet;” the worksheet would contain concrete strategies that would make a measurable difference in terms of inclusivity in their classrooms. The participants were very thoughtful in their responses and several of their ideas are worth sharing:

  • Administer a pre- or early-semester survey to get to know the students and build community.
  • Include a “campus climate” section in the syllabus with language expressing a commitment to respecting diverse opinions and being inclusive.
  • On the first day of class, have students create a “Community Agreement” to establish ground rules for class discussions, online discussions, and group activities. This can be revisited throughout the semester to adjust what is working/not working.
  • Acknowledge that there may be uncomfortable moments as we face mistakes and hold each other and ourselves accountable. Encourage students to “call in” when mistakes (intentional or not) occur, rather than “call out” or “cancel” so that we may learn from each other.
  • Work collaboratively with students to develop rubrics for assignments.
  • Include authors and guest speakers with varied cultures, backgrounds, and identities. Include images, readings, examples, and other course materials that are diversified. If opportunities are limited, have students do a reflective exercise on who/what is missing from the research.
  • Share content with students in multiple ways: research papers, videos, images, graphs, blog entries, etc.
  • Increase the number of active learning activities to enrich the learning experience.
  • Offer options to students: vary the types of assignments given and allow for a choice of ways to demonstrate knowledge among students when possible.
  • Follow accessibility guidelines: ensure video/audio recordings have closed captioning and/or a transcript, for example.
  • Create opportunities for students to discuss their lived experiences in the classroom and/or on assignments.
  • Provide opportunities for students to participate anonymously without fear of judgement (i.e. using iClickers or Jamboard).
  • Conduct activities that engage students in small groups so they get to know one another. Encourage students to use these connections to identify study partners. Consider switching groups throughout the semester so students meet additional partners.

Do you have additional strategies to share? Please feel free to add them in the comments.

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Best Practices in University Teaching Logo, Pixabay

The Hazards of Teaching for the First Time

Posted on by
Reply

This post was submitted by Atousa Saberi, a graduate student in the Johns Hopkins Teaching Academy who reflected on her first-time teaching experience.

I would like to share my learning experience as a PhD student teaching my first undergraduate course during fall 2020: Natural Hazards.

Teaching this course, I wrestled with several questions: How can I engage students in a virtual setting? How can I make them think? What is the purpose of education after all and what do I want them to take away from the course?

About the course setting

Fall semester 2020 was a unique time to teach a course on natural hazards in the sense that all students were directly impacted by at least one type of disaster – the global pandemic. In addition, the semester coincided with a record-breaking Atlantic hurricane season on the East Coast and fires on the West Coast.  I used these events as an opportunity to spark students’ curiosity and motivate them to learn about the science of natural hazards.

As a student, my best learning experiences happened through dialogues and exchange of ideas between classmates and instructors that continued back and forth during class time. This experience inspired me to hold more than half of the class sessions synchronously.

To focus students’ attention, I motivated every class session by posing questions. For example, which hazards are the most destructive, frequent, or deadly? What is the effect of climate change on these hazards? What can we do about them?  Some of these questions are open ended and may sound overwhelming at first, but to me, the essential step in learning is to become curious enough to engage with questions and take steps to answer them. Isn’t the purpose of education to train future thinkers?

The course included clear learning objectives following Bloom’s Taxonomy to target both lower- and higher-level thinking skills. I designed multiple forms of assignments such as conducting readings, listening to podcasts, watching documentaries, completing analytical exercises, and participating in group discussions. To motivate the sense of exploration in students, instead of exams, I assigned a final term paper in which students investigated a natural disaster case study of their own interest.

The assessment was structured using specifications grading. The method directly links course grades to achievements of learning objectives and motivates students to focus on learning instead of earning points (Kelly, 2018). Grading rubrics were provided for each individual assignment.

Lab demonstrations

Just as a picture is worth a thousand words, lab demonstrations go a long way to supplement lectures and to improve conceptual understanding of learning materials. But is it possible to perform them in a remote setting?

Simple demonstrations were still possible. I just needed to get creative in implementing them! For example, I used a rubber band and a biscuit to demonstrate the strength of brittle versus elastic materials under various modes of deformation to explain how the choice of materials can make a drastic difference in what modes of deformation a building tolerates during an earthquake, which impacts the survival rate during an earthquake.

I also used a musical instrument, my Setar, as an analogy for seismic waves. Just seeing the instrument immediately captured the students’ attention. I played the same note at different octaves and reminded them how that results in a different pitch due to the string being confined to two different lengths. This is analogous to having a short versus long earthquake fault and therefore higher or lower frequency in seismic waves (Figure 1). Students were also given an exercise to listen to the sound of earthquakes from an archive to infer the fault length.

Figure 1. Comparison of seismic waves to the sound waves generated by a string instrument. (a) length of two Earthquake faults (USGS). (b) music instrument producing analogous sound waves. The red and green arrows show the note, D, played on the same string in different octaves.

Freedom to learn

Noam Chomsky often says in his interviews about education that students are taught to be passive and obedient rather than independent and creative (Robichaud, 2014). He believes education is a matter of laying out a string along which students will develop, but in their own way (Chomsky & Barsamian, 1996). Chomsky quotes his colleague’s response to students asking about course content, saying “it is not important what we cover in the class but rather what we discover” (Chomsky & Barsamian, 1996). I was inspired by this perspective and decided to encourage the enlightenment style of learning in my students by giving them freedom in their final term paper writing style. I encouraged the students to pick a case study based on what they loved to learn about natural hazards and gave them freedom in how to structure their writing or what to expand on (the science of the disaster, the losses, the social impacts, the aftermath, etc.). I was surprised to see so many of the students asked for strict guidelines, templates and sample term papers from previous semesters, as if the meaning of freedom and creativity in learning was unfamiliar to them!

Student perceptions of the class

I administered two anonymous feedback surveys, one in the middle of the semester and the other at the end. The mid-semester survey was focused on understanding what is working (not working) for students that I should keep (stop) doing, and what additional activities we could start doing to better adapt to the unexpected transition to online learning. I learned that students had a lot to say, some of which I incorporated in the second half of the semester, such as taking a class session to practice writing the term paper and hold a Q&A session.

The end-of-semester survey was more focused on their takeaways from the class, and what assignments/activities were most helpful in their learning experience. I specifically asked them questions such as, “What do you think you will remember from this course?  What did you discover?”

The final survey revealed that by the end of the semester students, regardless of their background, comprehended the major earth processes and reflected on the relation between humans and natural disasters. They grasped the interdisciplinary nature of the course and how one can learn about intersection of physics, humanities, and international relations through studying natural hazards and disasters. They also developed a sense of appreciation for the role of science in predicting and dealing with natural hazards.

What I learned

Even though universities like Hopkins often train Ph.D. students to focus on producing publications rather than doing curiosity-driven research, I found that teaching a course like this led me to ask the kind of fundamental questions that could stimulate future research. This experience helped me develop as a teacher, as well as a true scientist, while raising awareness and sharing important knowledge about natural hazards in a changing climate in which the frequency of hazardous events will likely increase. I captured students’ attention by making the learning relevant to their lives, which inspired their curiosity. Feedback surveys revealed and reinforced my idea that synchronous class discussions, constant questioning, and interesting lab demos would hook the students and motivate them to engage in dialogue.

I am grateful to the KSAS Dean’s Office for making teaching as a graduate student possible, to the Center for Educational Resources for providing great teaching resources, and to Dr. Rebecca Kelly for her continuous support and valuable insights during the period I was teaching, to Dr. Sabine Stanley and Thomas Haine for their encouragement and feedback on this essay.

Atousa Saberi

References:

Kelly, R. (2018). Meaningful grades with specification grading. https://cer.jhu.edu/files/InnovInstruct-Ped-18 specifications-grading.pdf

Robichaud, A. (2014). Interview with Noam Chomsky on education. Radical Pedagogy, 11 (1), 4.

Chomsky, N., & Barsamian, D. (1996). Class warfare: interviews with David Barsamian. Monroe, Maine: Common Courage Press. 5

USGS (2020), Listening to earthquake: https://earthquake.usgs.gov/education/listen/index.php.

Image Source: Pixabay, Atousa Saberi

Expanding Students’ Research Skills with a Virtual Museum Exhibit

Posted on by
Reply

Morgan Shahan received her PhD in History from Johns Hopkins University in 2020. While at Hopkins, she received Dean’s Teaching and Prize Fellowships. In 2019, her department recognized her work with the inaugural Toby Ditz Prize for Excellence in Graduate Student Teaching. Allon Brann from the Center for Educational Resources spoke to Morgan about an interesting project she designed for her fall 2019 course,“Caged America: Policing, Confinement, and Criminality in the ‘Land of the Free.’”

I’d like to start by asking you to give us a brief description of the final project.  What did your students do?

Students created virtual museum exhibits on topics of their choice related to the themes of our course, including the rise of mass incarceration, the repeated failure of corrections reform, changing conceptions of criminality, and the militarization of policing. Each exhibit included a written introduction and interpretive labels for 7-10 artifacts, which students assembled using the image annotation program Reveal.  On the last day of class, students presented these projects to their classmates. Examples of projects included: “Birthed Behind Bars: Policing Pregnancy and Motherhood in the 19th and 20th Centuries,” “Baseball in American Prisons,” and “Intentional Designs: The Evolution of Prison Architecture in America in the 19th and 20th Centuries.”

Can you describe how you used scaffolding to help students prepare for the final project?

I think you need to scaffold any semester-long project. My students completed several component tasks before turning in their final digital exhibits. Several weeks into the semester, they submitted a short statement outlining the “big idea” behind their exhibitions. The “big idea statement,” a concept I borrowed from museum consultant Beverly Serrell, explained the theme, story, or argument that defined the exhibition’s tone and dictated its content. I asked students to think of the “big idea statement” as the thesis for their exhibition.

Students then used the big idea to guide them as they chose one artifact and drafted a 200-word label for it. I looked for artifact labels that were clearly connected to the student’s big idea statement, included the context visitors would need to know to understand the artifact, and presented the student’s original interpretation of the artifact. The brevity of the assignment gave me time to provide each student with extensive written comments. In these comments and in conversations during office hours, I helped students narrow their topics, posed questions to help guide analysis and interpretation of artifacts, and suggested additional revisions focused on writing mechanics and tone.

Later in the semester, students expanded their big idea statements into rough drafts of the introductions for their digital exhibit. I asked that each introduction orient viewers to the exhibition, outline necessary historical context, and set the tone for the online visit. I also set aside part of a class period for a peer review exercise involving these drafts. I hoped that their classmates’ comments, along with my own, would help students revise their introductions before they submitted their final exhibit.

If I assigned this project again, I would probably ask students to turn in another label for a second artifact. This additional assignment would allow me to give each student more individualized feedback and would help to further clarify my grading criteria before the final project due date.

When you first taught this course a few years ago, you assigned students a more traditional task—a research paper. Can you explain why you decided to change the final assignment this time around?

I wanted to try a more flexible and creative assignment that would push students to develop research and analytical skills in a different format. The exhibit project allows students to showcase their own interpretation of a theme, put together a compelling historical narrative, and advance an argument. The project remains analytically rigorous, pushing students to think about how history is constructed. Each exhibit makes a claim—there is reasoning behind each choice the student makes when building the exhibit and each question he or she asks of the artifacts included. The format encourages students to focus on their visual analysis skills, which tend to get sidelined in favor of textual interpretation in most of the student research papers I have read. Additionally, the exhibit assignment asks students to write for a broader audience, emphasizing clarity and brevity in their written work.

What challenges did you encounter while designing this assignment from scratch?  

In the past I have faced certain risks whenever I have designed a new assignment. First, I have found it difficult to strike a balance between clearly stating expectations for student work while also leaving room for students to be creative. Finding that balance was even harder with a non-traditional assignment. I knew that many of my students would not have encountered an exhibit project before my course, so I needed to clarify the utility of the project and my expectations for their submissions.

Second, I never expected to go down such a long research rabbit hole when creating the assignment directions. I naively assumed that it would be fairly simple to put together an assignment sheet outlining the requirements for the virtual museum project.  I quickly learned, however, that it was difficult to describe exactly what I expected from students without diving into museum studies literature and scholarship on teaching and learning.

I also needed to find a digital platform for student projects. Did I want student projects to be accessible to the public? How much time was I willing to invest in teaching students how to navigate a program or platform? After discussing my options with Reid Sczerba in the Center for Educational Resources (CER), I eventually settled on Reveal, a Hopkins-exclusive image-annotation program. The program would keep student projects private, foreground written work, and allow for creative organization of artifacts within the digital exhibits. Additionally, I needed to determine the criteria for the written component of the assignment. I gave myself a crash course in museum writing, scouring teaching blogs, museum websites, journals on exhibition theory and practice, and books on curation for the right language for the assignment sheet. I spoke with Chesney Medical Archives Curator Natalie Elder about exhibit design and conceptualization. My research helped me understand the kind of writing I was looking for, identify models for students, and ultimately create my own exhibit to share with them.

Given all the work that this design process entailed, do you have any advice for other teachers who are thinking about trying something similar?

This experience pushed me to think about structuring assignments beyond the research paper for future courses. Instructors need to make sure that students understand the requirements for the project, develop clear standards for grading, and prepare themselves mentally for the possibility that the assignment could crash and burn. Personally, I like taking risks when I teach—coming up with new activities for each class session and adjusting in the moment should these activities fall flat—but developing a semester-long project from scratch was a big gamble.

How would you describe the students’ responses to the project? How did they react to the requirements and how do you think the final projects turned out?

I think that many students ended up enjoying the project, but responses varied at first. Students expressed frustration with the technology, saying they were not computer-savvy and were worried about having to learn a new program. I tried to reassure these students by outing myself as a millennial, promising half-jokingly that if I could learn to use it, they would find it a cinch. Unfortunately, I noticed that many students found the technology somewhat confusing despite the tutorial I delivered in class. After reading through student evaluations, I also realized that I should have weighted the final digital exhibit and presentation less heavily and included additional scaffolded assignments to minimize the end-of-semester crunch.

Despite these challenges, I was really impressed with the outcome. While clicking through the online exhibits, I could often imagine the artifacts and text set up in a physical museum space. Many students composed engaging label text, keeping their writing accessible to their imaginary museum visitors while still delivering a sophisticated interpretation of each artifact. In some cases, I found myself wishing students had prioritized deeper analysis over background information in their labels; if I assigned this project again, I would emphasize that aspect.

I learned a lot about what it means to support students through an unfamiliar semester-long project, and I’m glad they were willing to take on the challenge. I found that students appreciated the flexibility of the guidelines and the room this left for creativity. One student wrote that the project was “unique and fun, but still challenging, and let me pursue something I couldn’t have if we were just assigned a normal paper.”

If you’re interested in pursuing a project like this one and have more questions for Morgan, you can contact her at: morganjshahan@gmail.com. 

For other questions or help developing new assessments to use in your courses, contact the Center for Educational Resources (cerweb@jhu.edu).

Allon Brann, Teacher Support Specialist
Center for Educational Resources

Image Source: Morgan Shahan

Lunch and Learn: Working with Teaching Assistants

Posted on by
Reply

Lunch and Learn LogoOn December 16, 2020, the Center for Educational Resources (CER) hosted a Lunch and Learn: Working with Teaching Assistants (TAs). Rebecca Pearlman, Senior Lecturer in Biology, and Reid Mumford, Instructional Resource Advisor in Physics and Astronomy, shared strategies for how to best work with TAs to support student learning. Mike Reese from the CER moderated the discussion.

Pearlman manages a mix of graduate and undergraduate level TAs in the Biology department each semester and has worked with hundreds of TAs during her career at Hopkins. Mumford manages approximately 30 graduate level TAs each semester as well as a group of undergraduate learning assistants who help with classroom tasks but do not take part in grading. The following is a combined list of strategies that the presenters shared during the presentation:

  • Set clear expectations – This could include a contract, job overview, checklist of duties, etc.
  • Provide tips for TAs so they are prepared for the semester – This may include training documents, resources, and tools they will need.
  • Take advantage of technology – Google Forms for identifying availability, Doodle polls for arranging meetings, Blackboard site to store answer keys, Slack/MS Teams to communicate among the instructional team.
  • Build community – Take an interest in the TAs and get to know them. This helps to establish positive relationships between the instructor and TAs and among the TAs themselves.
  • Meet weekly – Review upcoming course content, monitor progress of each section, ensure TAs understand their upcoming tasks. Mumford also uses his weekly meetings to provide feedback and encouragement to the TAs.
  • Designate a head TA, if possible – If you have a large number of TAs, it may be beneficial to designate a head TA to help you manage the rest of the group. With his large number of TAs each semester, Mumford relies heavily on his head TA to make sure weekly instructions and tasks are assigned appropriately.
  • Consider feedback from students – TA evaluations can offer helpful feedback to both TAs and instructors. Pearlman noted that student feedback is especially helpful if she needs to make decisions about rehiring a TA. She can pull quotes directly from the evaluations. Mumford noted that he always meets individually with each of his TAs to review their evaluations.group of people having a discussion in front of bulletin board

There were some questions from other faculty members after the presentation:

Q: To what extent do you use undergraduate TAs?

A: Mumford responded that by policy, all of the TAs in his department are graduate students. He went on to say that he finds that experienced TAs are valuable, but it is harder to change their behavior. If they are first year TAs, he has more of an opportunity to shape them.  He does hire undergraduate learning assistants who assist with day to day tasks in the classroom but do not take part in any grading.

Pearlman stated that it seems to vary by department, but in biology, they have a mix of graduate and undgraduate TAs, and all of them participate in grading. She enjoys working with both populations, noting that the undergraduates tend to be self-starters, while the graduates bring a wealth of knowledge from the lab.

Q: To what extent is it useful for TAs to TA twice?

A: Pearlman responded that the undergraduate TAs often stay with her for years. They help each other and learn a lot by continuing in the role. They enjoy teaching the material more than once.

Q: How do you select your TAs?

A: Pearlman replied that the graduate level TAs are assigned to her department, but the undergraduates apply for the position. In the Fall 2020 semester she had 50 students apply for 18 positions. She uses a Google Form to ask them questions such as “why are you excited to be a TA? – or “what can you bring to the position?” Pearlman says she does review their grades, but they are not necessarily a priority; it often comes down to who is available at the right time.

Mumford responded that graduate TAs are assigned, but for the undergraduate learning assistants, he relies on referrals from the graduate TAs. He specifically asks them to recommend  great students. He then follows up with an interview process. Mumford is able to choose his head TA and strongly considers diversity when choosing this person.

Other faculty shared various characteristics that they use to select TAs: enthusiasm for the subject matter, respect for others, patience with students, familiarity with course material, interest in teaching, and above average grades.

Q: What can I do about TAs who do not prioritize their TA duties, such as grading?

A: Reese suggested making expectations very clear but acknowledged that it is a struggle when the TAs have obligations to research faculty as well as their TA duties.

Mumford responded that he checks in with his TAs every week to try and keep them on task. If they are non-responsive, he escalates the issue to the graduate committee to handle. If it continues, he will also reach out to the student’s research advisor and discuss the situation with that person as well.

Pearlman suggested contacting the people who run the graduate program or the department chair for assistance. She also suggested bringing the issue up at a faculty meeting.

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Lunch and Learn Logo, Pixabay

 

 

 

 

 

 

 

Surviving to Thriving: Reflections from Teaching Online

Posted on by
Reply

On Friday, December 11, 2020, the Office of the Provost, in conjunction with teaching and learning centers across Johns Hopkins University, sponsored a half-day virtual conference titled “Surviving to Thriving: Reflections from Teaching Online.” Faculty, graduate students, and staff came together to share ideas, challenges faced, and best practices when teaching in a virtual environment. Highlights from a few of the sessions are below:

Engaging Students in the Virtual Environment: A panel of faculty representing the School of Education, the Bloomberg School of Public Health, and the Whiting School of Engineering shared strategies for how building community, synchronous sessions, and using specific tools can help to engage students online.

Building community in an online course helps students feel more connected with each other and can lead to more productive learning. Strategies for community building shared by faculty include:

  • Using ice breaker questions at the beginning of every class
  • Learning student names
  • Setting up sessions to get to know one another (in breakout rooms, online discussion boards, Google Sheets)
  • Offering frequent feedback in multiple formats (email, audio recordings)
  • ‘Humanizing’ situations by admitting mistakes and struggles with technology

Synchronous sessions allow students to experience learning with their peers in a real-time, interactive environment. For students nervous about speaking up during live sessions, faculty members suggested giving them a choice to either use the chat feature or the microphone. One faculty member required his students, in a seminar style class, to ask at least one question during the semester, which helped to build confidence. Another faculty member described posting a ‘speaker list’ ahead of each class so students knew in what order they would be speaking. Not only were students more prepared, but the sessions ran more efficiently. Faculty discussed the challenges of holding synchronous sessions with students in multiple time zones. While most faculty recorded their lectures and made them available online, some offered to give their lecture twice, and allowed students to choose which session to attend.  Technology can be another challenge when holding synchronous sessions. Faculty suggested offering material in multiple formats in order to meet the needs of students who may be having technological difficulties. For example, post slides in addition to video.

There are a variety of online tools that can be used to engage students online. Faculty in this session discussed the following:

  • Padlet – tool that allows students to collaborate synchronously or asynchronously
  • Loom – video recording application that allows students to create and send recordings
  • Flipgrid – video discussion board tool
  • Slack – communication platform used for information sharing, individual and group communication, synchronous and asynchronous collaboration (similar to Teams)

(Note: Instructors are encouraged to contact their school’s teaching and learning center before deciding to use third party tools that may or may not be supported by their institution.)

Jazzing Up Online Presentations: A panel of faculty representing the School of Education, the School of Medicine, and the Krieger School of Arts and Sciences shared strategies for how to strengthen online presentations and keep students engaged. One idea is to maintain a balance between synchronous and asynchronous sessions to help avoid Zoom fatigue. Another idea is to keep sessions interactive by using breakout rooms, videos, knowledge checks, and other active learning techniques. Modeling online navigation for students is another way to help make sure they are staying engaged. For example, if referring to a particular discussion board post, share your screen with students and navigate to the post, read it with students, and discuss together. Consider using a different tool, other than PowerPoint, for your presentation, such as Genially or Sway. Lastly, don’t be afraid to put your personality into your presentation – pets and silly bow ties can make a difference to students!

Student Perspectives: A moderated panel of four students from across the institution shared their experiences with virtual learning this past semester. When asked what has been the most challenging aspect, several students mentioned Zoom fatigue. With the many hours of online lectures they were expected to attend, students reported that it was often difficult to stay engaged. Zoom fatigue also made it a challenge to participate in outside events or clubs since they are virtual as well. Other challenges: difficulty connecting and networking with people online and students living in different time zones.

When asked what techniques they wished more faculty were using, one student mentioned following best practices of online learning to ensure consistency across courses. Another student appreciated how one of her professors asked how students were doing at the beginning of each class. This was a small class, and the student acknowledged that it probably wouldn’t be possible in a larger setting, but that it helped to build community among class members. Another consideration mentioned is to build in breaks during the lecture. Other techniques suggested were the use of collaborative assignments, to help students keep each other accountable, and breakout rooms (in Zoom) with a structured task or purpose in mind.

Students were asked about the positive aspects of virtual learning. One student from the School of Advanced International Studies (SAIS) explained how students from all three SAIS campuses were able to participate in all classes together, and how beneficial it was for students to experience the others’ perspectives. Another student found it extremely helpful that faculty would record their lectures and post them to Blackboard for unlimited viewing.  Students also greatly appreciated the creativity and support of their instructors and teaching assistants.

Other topics presented at the conference include: student wellness, assessment, accessibility, and more. The Provost’s office has made the full day of recorded sessions available here with JHED authentication.

Amy Brusini, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay