Creating Rubrics

Red sharpie-type marker reading "Rubrics Guiding Graders: Good Point" with an A+ marked below

Red Rubric Marker

Instructors have many tasks to perform during the semester. Among those is grading, which can be subjective and unstructured. Time spent constructing grading rubrics while developing assignments benefits all parties involved with the course: students, teaching assistants and instructors alike. Sometimes referred to as a grading schema or matrix, a rubric is a tool for assessing student knowledge and providing constructive feedback. Rubrics are comprised of a list of skills or qualities students must demonstrate in completing an assignment, each with a rating criterion for evaluating the student’s performance. Rubrics bring clarity and consistency to the grading process and make grading more efficient.

Rubrics can be established for a variety of assignments such as essays, papers, lab observations, science posters, presentations, etc. Regardless of the discipline, every assignment contains elements that address an important skill or quality. The rubric helps bring focus to those elements and serves as a guide for consistent grading that can be used from year to year.

Whether used in a large survey course or a small upper-level seminar, rubrics benefit both students and instructors. The most obvious benefit is the production of a structured, consistent guideline for assigning grades. With clearly established criteria, there is less concern about subjective evaluation. Once created, a rubric can be used every time to normalize grading across sections or semesters. When the rubric for an assignment is shared with teaching assistants, it provides guidance on how to translate the instructor’s expectations for evaluating student submissions consistently. The rubric makes it easier for teaching assistants to give constructive feedback to students. In addition, the instructor can supply pre-constructed comments for uniformity in grading.

Some instructors supply copies of the grading rubric to their students so they can use it as a guide for completing their assignments. This can also reduce grade disputes. When discussing grades with students, a rubric acts as a reminder of important aspects of the assignment and how each are evaluated.

Below are basic elements of rubrics, with two types to consider.

I. Anatomy of a rubric

All rubrics have three elements: the objective, its criteria, and the evaluation scores.

Learning Objective
Before creating a rubric, it is important to determine learning objectives for the assignment. What you expect your students to learn will be the foundation for the criteria you establish for assessing their performance. As you are considering the criteria or writing the assignment, you may revise the learning objectives or adjust the significance of the objective within the assignment. This iteration can help you hone in on what is the most important aspect of the assignment, choose the appropriate criteria, and determine how to weigh the scoring.

Criteria
When writing the criteria (i.e., evaluation descriptors), start by describing the highest exemplary result for the objective, the lowest that is still acceptable for credit, and what would be considered unacceptable. You can express variations between the highest and the lowest if desired. Be concise by using explicit verbs that relate directly to the quality or skill that demonstrates student competency. There are lists of verbs associated with cognitive categories found in Bloom’s taxonomy (Knowledge, Comprehension, Application, Evaluation, Analysis, and Synthesis). These lists express the qualities and skills required to achieve knowledge, comprehension or critical thinking (Google “verbs for Bloom’s Taxonomy”).

Evaluation Score
The evaluation score for the criterion can use any schema as long as it is clear how it equates to a total grade. Keep in mind that the scores for objectives can be weighted differently so that you can emphasize the skills and qualities that have the most significance to the learning objectives.

II. Types of rubrics

There are two main types of rubrics: holistic (simplistic) and analytical (detailed).

Selecting your rubric type depends on how multi-faceted the tasks are and whether or not the skill requires a high degree of proficiency on the part of the student.

Holistic rubric
A holistic rubric contains broad objectives and lists evaluation scores, each with an overall criterion summary that encompasses multiple skills or qualities of the objective. This approach is more simplistic and relies on generalizations when writing the criteria.

The criterion descriptions can list the skills or qualities as separate bullets to make it easier for a grader to see what makes up an evaluation score. Below is an example of a holistic rubric for a simple writing assignment.

Table showing an example of a holistic rubric

Analytical rubric
An analytical rubric provides a list of detailed learning objectives, each with its own rating scheme that corresponds to a specific skill or quality to be evaluated using the criterion. Analytical rubrics provide scoring for individual aspects of a learning objective, but they usually require more time to create. When using analytical rubrics, it may be necessary to consider weighing the score using a different scoring scale or score multipliers for the learning objectives. Below is an example of an analytical rubric for a chemistry lab that uses multipliers.

Table showing an example of an analytical rubric

It is beneficial to view rubrics for similar courses to get an idea how others evaluate their course work. A keyword search for “grading rubrics” in a web search engine like Google will return many useful examples. Both Blackboard and Turnitin have tools for creating grading rubrics for a variety of course assignments.

Louise Pasternack
Teaching Professor, Chemistry, JHU

Louise Pasternack earned a Ph.D. in chemistry from Johns Hopkins. Prior to returning to JHU as a senior lecturer, Louise Pasternack was a research scientist at the Naval Research Laboratory. She has been teaching introductory chemistry laboratory at JHU since 2001 and has taught more than 7000 students with the help of more than 250 teaching assistants. She became a teaching professor at Hopkins in 2013.

Image sources: © 2014 Reid Sczerba

Good Reads (and Views)

I’ve been collecting articles that might be of interest to readers of The Innovative Instructor. Here are several to add to your weekend reading list.

Stack of books in a library.Too late for this semester, but Syllabus Design for Dummies, by Josh Bolt, Contributing Editor, for the Chronicle of Higher Education’s Vitae career hub (a good service to be aware of), will give you a head start on preparing syllabi for your spring courses. The introductory guide covers writing expectations and objectives, assignments and grading, which policies and procedures to include, and how best to present your course schedule.  Vitae has also announced that it is building a syllabi database.

Another post from Vitae, The Best Teaching Resources on the Web by David Gooblar, PedagogyUnbound.com (another good resource), annotates a number of great sites for instructors, including blogs, non-profit sites, teaching and learning centers, and a list of top pedagogy journals courtesy of the ACRL (Association of College and Research Libraries).

And take a look at this piece from Inside Higher Ed on The Future of MOOCs by Steven Mintz, the Executive Director of the University of Texas System’s Institute for Transformational Learning and a Professor of History at the University of Texas at Austin.  Mintz describes ten challenges facing the next generation of MOOCs and offers possible solutions: “For the most part, however, MOOCs today have not evolved significantly in approach beyond those available in 2012. If next generation MOOCs are to appear, they will need to draw upon the experience of online retailers, journalism, online dating services, and social networking sites.”

And, speaking of MOOCS, it’s not too late to sign on to the CIRTL MOOC An Introduction to Evidence-Based Undergraduate STEM Teaching as long as you are in it for the information rather than a certification. Week 5 starts on Monday, November 3, but participants have access to the materials for the entire course. There have been some great videos on topics such as learning objectives, assessment, peer instruction, inquiry based labs, learning through writing, and problem based learning.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Microsoft Clip Art

Preparing Future Faculty: Writing a Philosophy of Teaching Statement

Painting of hand on green background. Hand has words painted in black on it: share, create, explore, assist...If you are a graduate student intending to enter the professoriate, it is quite likely that you will be asked to submit a Philosophy of Teaching Statement as part of your application materials for any academic position that includes instruction. In the current arid environment of available jobs in the higher education academic market, the teaching statement has taken on increased scrutiny, as hundreds of applicants vie for each offered position. Although some may decry the increasing number of application requirements, you should be prepared to produce a statement that will make you a competitive candidate. Fortunately, there are a number of resources and examples to help you with this task.

First, what exactly is a Philosophy of Teaching Statement? The University Center for the Advancement of Teaching at Ohio State University describes the teaching statement as “a narrative that includes your conception of teaching and learning, description of how you teach, and justification for why you teach that way. This comprehensive how-to guide suggests a length of 1-2 pages written in the present tense that avoids technical terms and expresses your own philosophy. Examples from a range of disciplines are included, as well as an the in-depth Guidance on Writing a Philosophy of Teaching Statement. There are links to other Teaching and Learning Center sites with their recommendations, and a list of useful references.

One of the OSU UCAT links goes to the Iowa State University Center for Excellence in Teaching and Learning. This site offers a video interview with Susan Yager, Associate Professor in English and Faculty Director of the Iowa State University Honors Program and frequent lecturer in the Preparing Future Faculty program.  She discusses why the teaching philosophy statement is important, what the important components are, and offers strategies for getting started. Elsewhere on the ISU CELT site, a guide covers four primary questions to be answered: To what end? By what means? To what degree? And, Why?

Another perspective on the exercise comes from Philosophy of Teaching Statements: Examples and Tips on How to Write a Teaching Philosophy Statement, a Faculty Focus Special Report, Magna Publications, May, 2009. This publication “is designed to take the mystery out of writing teaching philosophy statements, and includes both examples and how-to articles written by educators from various disciplines and at various stages of their professional careers. Some of the articles you will find in the report include: • How to Write a Philosophy of Teaching and Learning Statement • A Teaching Philosophy Built on Knowledge, Critical Thinking and Curiosity • My Teaching Philosophy: A Dynamic Interaction Between Pedagogy and Personality • Writing the “Syllabus Version” of Your Philosophy of Teaching • My Philosophy of Teaching: Make Learning Fun.”

Writing a Philosophy of Teaching Statement might not be high on your list of exciting activities, but with these resources you’ll be able to meet the challenge well armed.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Share and Explore by Denise Carbonell https://www.flickr.com/photos/denisecarbonell/4464982807/in/set-72157623709556546

Preparing Future Faculty: TA Training

Our last post announced a Coursera MOOC starting on October 6th: An Introduction to Evidence-Based Undergraduate STEM Teaching, offered by the CIRTL Network. This post will look at an earlier moment in graduate student preparation for the professoriate – teaching assistantships.

Here at Johns Hopkins, the Center for Educational Resources offers a number of opportunities for graduate students to get the basics for fulfilling their teaching roles under a TA training program called the Teaching Assistant Training Institute.  “The Teaching Assistant Training Institute provides formal training for graduate students to assist them in preparing for their teaching assignments both here at Johns Hopkins and for their future academic careers. The program consists of a half-day orientation session for new TAs as well as workshops throughout the year for all graduate students. There is also a formal course to prepare graduate students for academic teaching.”

Although the face-to-face training is open only to our JHU graduate students, several of the resources are available to the public, including our Teaching Assistant Training Manual. While some of the content is Hopkins specific, there is quite a bit of material that will be useful to anyone in a TA role. There are also videos (scroll to the bottom of the page) that deal with topics such as preparing for the first day, leading labs and evaluating writing assignments. Other videos look at TA – student interactions and suggest ways of dealing with common issues such as grade complaints.

If you are a graduate student or faculty member with graduate students at another institution, there is a good chance that there is some preparation for TAs or future faculty available. A quick way to find out is to Google “teaching assistant @your institution’s abbreviation.edu” (e.g., @jhu.edu). If your teaching assistants go by another term, substitute that term in the search.

Book Jacket First Day to Final Grade: A Graduate Student’s Guide to TeachingFor all graduate student teaching assistants and teachers, there is a terrific resource I want to recommend. Anne Curzan and Lisa Damour, who were, once upon a time, graduate students at the University of Michigan, have written a comprehensive guide for graduate student teachers – First Day to Final Grade: A Graduate Student’s Guide to Teaching [University of Michigan Press, 2009]. From the book jacket: “First Day to Final Grade: A Graduate Student’s Guide to Teaching is designed to help new graduate student teaching assistants navigate the challenges of teaching undergraduates. Both a quick reference tool and a fluid read, the book focuses on the “how tos,” such as setting up a lesson plan, running a discussion, and grading, as well as issues specific to the teaching assistant’s unique role as both student and teacher.”  Although there are many excellent guides to teaching at the university level, a number of which are cited in this book’s comprehensive bibliographies found at the end of each chapter, the focus on the role of the graduate student teacher is what makes this unique.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Book Jacket First Day to Final Grade: A Graduate Student’s Guide to Teaching
http://ecx.images-amazon.com/images/I/41JdGDjDuEL._SY344_BO1,204,203,200_.jpg

 

 

 

Preparing Future Faculty: An Introduction to Evidence-Based Undergraduate STEM Teaching

Our next couple of posts will address the preparation of graduate students who plan to enter the professoriate. Many universities offer training and other resources to prepare future faculty, and we’ll cover some publicly available options for those who are looking for additional opportunities for themselves for their students.

Screenshot of Coursera course description page for An Introduction to Evidence-Based Undergraduate STEM Teaching.First up: a seven-week long MOOC, starting on October 6th: An Introduction to Evidence-Based Undergraduate STEM Teaching. This course is offered by the CIRTL Network. Funded by the National Foundation for Science, the Center for the Integration of Research, Teaching and Learning is a consortium of 22 research universities whose mission “is to enhance excellence in undergraduate education through the development of a national faculty committed to implementing and advancing effective teaching practices for diverse learners as part of successful and varied professional careers.”

CIRTL embraces three core concepts, which it calls Pillars: Teaching-as-research, Learning Communities, and Learning-through-Diversity. Johns Hopkins is a CIRTL member, but even if your institution is not part of the consortium, there are resources on the CIRTL website that are available to all. The MOOC is open to everyone. Further, although CIRTL is specifically “committed to advancing the teaching of STEM disciplines in higher education,” much of the information it makes available is applicable to teaching in any field. Likewise, the MOOC, offered through Coursera, will “start by exploring a few key learning principles that apply in all teaching contexts.”  The syllabus notes topics such as Principles of Learning, Learning Objectives, Assessment of Learning, Lesson Planning, Inclusive Teaching, and Writing to Learn that provide foundations to good teaching for any subject.

The course description provides more detail:

This course will provide graduate students and post-doctoral fellows in the STEM disciplines (science, technology, engineering, and mathematics) who are planning college and university faculty careers with an introduction to evidence-based teaching practices. Participants will learn about effective teaching strategies and the research that supports them, and they will apply what they learn to the design of lessons and assignments they can use in future teaching opportunities. Those who complete the course will be more informed and confident teachers, equipped for greater success in the undergraduate classroom.

You can watch the intro video as well.  Then, sign up and start preparing yourself for your first teaching assignment.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Screen shot https://www.coursera.org/course/stemteaching

 

 

 

Creative Student Assignments: Fast-Paced In-Class Presentations

Students given presentation to a class.

CC Photo by Creative Services: http://spirit.gmu.edu/wp-content/uploads/2013/05/student-presentation-ncc.jpg

In our teaching and learning center we talk to a lot of faculty who are seeking to give students assignments that provide authentic learning experiences as well as offer variety over the course of the semester. Instructors like the idea of having students do projects and present the results during class, but often find that the end results are uninspired PowerPoint presentations full of text-heavy slides. One solution is to have student give presentations using one of the popular fast-paced styles such as Pecha Kucha 20×20, Lightning Talks, Ignite Events, or 24×7.

Pecha Kucha is a Japanese word meaning chit chat (listen to various pronunciations by native Japanese speakers).  PechaKucha 20×20 is a presentation format developed by Tokyo-based architects Astrid Klein and Mark Dytham in 2003. The concept is to show 20 images, each for 20 seconds, thereby delivering a talk in 6 minutes and 40 seconds. The images advance automatically as the presenter talks along to the images. Klein and Dytham sponsored PechaKucha Nights, informal gatherings where creative people get together and share their ideas, work, and thoughts in the PechaKucha 20×20 format. These events are now held world-wide.

Lightning Talks use a similar format, and evolved in the tech world at Python and Perl conference in the late 1990s and early 2000s. The format varies but typically is limited to 5 minutes, and slides may or may not advance automatically. Barrie Byron, a self-described communications professional and experienced presenter, offers a description of lightning talks and some tips for execution on her blog. She describes a format where slides advance automatically every 15 seconds. Byron notes that the format tests resilience and oratory skills. “A good lightning talk is insightful, inspiring, thought-provoking, useful, humorous, controversial, or enlightening. Lightning talks are almost always fun, for both the speaker and the audience.”

According to Wikipedia, Ignite Events are typically organized by volunteers and have been held around the world. Participants speak about their ideas and personal or professional passions according to a specific format. The event has the motto, “Enlighten us, but make it quick!” The presentations are meant to “ignite” the audience on a subject – awareness, thought, and action are generated on the subjects presented. At an Ignite event each speakers gets 5 minutes, and must use 20 slides with each slide advancing automatically after 15 seconds, forcing speakers to get to the point, fast.

24×7 presentations, another variation on the theme, allows 24 slides in 7 minutes. Variations allow for slides to advance automatically or manually.

The advantage that these short, structured formats offer is that they help students focus on their key points and important content. Their presentation style matters. The fact that the slides are only visible for a short period of time means that any text used must be short and to the point. Organizing an end of the semester presentation event using one of these methods will challenge your students to get to the point, practice their delivery style, and provide an informative and entertaining performance for you and your class.

Here are a few resources on presentations to help you and your students:

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: CC Photo by Creative Services: http://spirit.gmu.edu/wp-content/uploads/2013/05/student-presentation-ncc.jpg

Post-Semester Reflection

Woman in business suit with fountain pen looking thoughtful.

Now that your last class has been taught, exams given and grades turned in, it’s time to kick back and enjoy some rest and relaxation, right? Not to say that you haven’t earned it, but first it might be a good idea to add a third “R” to the mix. That would be reflection.

While the first thing the word reflection might bring to mind is the scientific definition, the Oxford Online Dictionary gives the second meaning as “Serious thought or consideration.”

The Center for Teaching and Learning at the University of Washington (Seattle) lists among its resources a section on Self Reflection on Teaching.

“It is key to engage systematic reflection on your own teaching. Some easy yet consistent strategies for keeping track of your teaching are to annotate assignments, tests and class plans on an ongoing basis. This will help you keep track of things to keep and/or eliminate when you teach the class again. End-of-term summaries also help you reflect on your teaching and provide excellent fodder for the development of new classes and or improved versions of the same class.”

In Wilbert J. McKeachie’s Teaching Tips: Strategies, Research, and Theory for College and University Teachers the author notes, “One key to improvement is reflection – thinking about what you want to accomplish, and what you and the students  need to achieve these goals.” [p. 6-7 in 11th edition, Houghton-Mifflin, 2002]

While the semester is still fresh in your memory, ask yourself some questions. What was successful? What wasn’t? Were your goals and objectives for student learning met? Do your assessments accurately capture student learning? What do you want to do differently the next time you teach this course?

If your classes went smoothly and students seemed engaged, there may be few changes to implement with the next iteration.  If you are feeling that the entire course was a disaster, Using Failure to Reflect on our Teaching, a post in the Chronicle of Higher Education ProfHacker blog written by Janine Utell, Associate Professor of English at Widener University in Pennsylvania, will help you to take something positive from the situation.

Utell offers strategies for assessing specific failings and finding remedies –looking at past successes can help you to solve current problems.  She writes: “If I can pinpoint a specific strategy that failed, I stop thinking of myself as a failure and can find something concrete to fix. I can use past problem-solving to remind myself of my strengths: I’ve fixed that before, I can fix it again. I can see, too, if perhaps a class going badly came from something that was out of my control. Every class has a life of its own. That means every class that fails, fails in a particular way. It also means that every class that succeeds does so at least in part because of a particular and providential confluence of our strengths and those of the students.”

Taking time for reflection now will prove beneficial at the end of the summer when the next semester starts.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Microsoft Clip Art

Summer Reading: Three Articles for Your Consideration

Celebrating the end of the academic year and looking forward to some time for summer reading? It’s always good to have solid research to back up our teaching practices. Three recent articles highlight scholarship behind the claimed benefits of collaborative learning, improved student performance with the use of active learning, and taking notes by hand provides better cognitive retention than using a laptop.

Woman lying on grass reading a book.A tip from the Tomorrow’s Professor mailing list sent The Innovative Instructor to IDEA (Individual Development and Educational Assessment) and POD (Professional and Organizational Development Network in Higher Education). “IDEA is a nonprofit organization whose mission is to provide assessment and feedback systems to improve learning in higher education.” [http://ideaedu.org/about] As part of IDEA, POD produces “succinct papers” to address specific ways for instructors to employ innovative teaching methods. The POD Center Notes on Instruction is definitely worth a look.

POD Item #5 Formed “Teams” or “Discussion Groups” To Facilitate Learning Overall, reviews the research supporting the benefits of collaborative learning. “Learning is enhanced when the material to be learned is thought about deeply and also when related material is retrieved from memory and associated with the new material. When students have an opportunity to work together to learn course content, particularly when applying that material to a new challenge, both deep thinking and retrieval of associated materials are realized.” Specific tips are presented for implementing group work in a course, including setting clear expectations and monitoring group progress. Applications of group work for online settings are examined, and assessment issues are addressed.

Next, a study on lecturing versus active learning was recently highlighted in both Inside Higher Education and The Chronicle of Higher Education. The results of the research, Active Learning Increases Student Performance in Science, Engineering, and Mathematics, were published in the Proceedings of the National Academy of Sciences by Scott Freeman, Mary Wenderoth, Sarah Eddy, Miles McDonough, Nnadozie Okoroafor, Hannah Jordt, and Michelle Smith. The lead researchers are in the Department of Biology at the University of Washington, Seattle.

From the abstract: “This is the largest and most comprehensive meta-analysis of undergraduate STEM education published to date.” “These results indicate that average examination scores improved by about 6% in active learning sections, and that students in classes with traditional lecturing were 1.5 times more likely to fail than were students in classes with active learning.” As for the significance of the report, “[t]he analysis supports theory claiming that calls to increase the number of students receiving STEM degrees could be answered, at least in part, by abandoning traditional lecturing in favor of active learning.”

From the April 2014 Psychological Science, The Pen is Mightier Than the Keyboard Advantages of Longhand Over Laptop Note Taking by Pam A. Mueller and Daniel M. Oppenheimer, reports on the benefits students gain by taking lecture notes longhand rather than on a laptop. Although using laptops in class is common (and instructors complain about the distractions laptops present), this study “…suggests that even when laptops are used solely to take notes, they may still be impairing learning because their use results in shallower processing.” “In three studies, [the researchers] found that students who took notes on laptops performed worse on conceptual questions than students who took notes longhand.” The authors conclude “…that whereas taking more notes can be beneficial, laptop note takers’ tendency to transcribe lectures verbatim rather than processing information and reframing it in their own words is detrimental to learning.”

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Image Source: CC Spirit Fire on Flickr: https://www.flickr.com/photos/spirit-fire/5733726521/

From MOOCs to MOCs?

In January 2013, The Innovative Instructor wrote a post titled The ABCs of MOOCs, which attempted to provide an overview to the emerging and rapidly evolving phenomenon of Massive Open Online Courses familiarly known as MOOCs. We have come a long way in a short time in regards to MOOCs. This post examines the evolution of the MOOC trend.

In an article by Laura Pappano dated November 2, 2012, the New York Times declared that 2012 was The Year of the MOOC. Within a few months during that year several companies had been formed by university partnerships (Coursera, edX, Udacity); University of Virginia president Teresa Sullivan had been fired (and reinstated) in part due to her reluctance to rush onto the MOOC train (see: the New York Times, Anatomy of a Campus Coup by Andrew Rice); and Thomas Friedman, among others, had written about MOOCs “disrupting” the future of university education. Some pundits declared that brick and mortar universities were seeing their end of days.

But a year later, Clayton M. Christensen, a professor of business administration at Harvard, and coiner of the phrase “disruptive innovation”, presented a more nuanced view in an article co-written with Michael Horn – Innovation Imperative: Change Everything Online Education as an Agent of Transformation (New York Times, November 1, 2013).  “But for MOOCs to really fulfill their disruptive potential, they must be built into low-cost programs with certification of skills of value to employers. So far, only a few traditional universities have incorporated MOOCs into their curriculum, and only to supplement what they are already doing — like ‘flipping the classroom,’ with lectures watched from home.” And “As concepts and skills are taught more effectively online, it’s unlikely that face-to-face interaction will cease to matter.”

Certainly the promise of MOOCs – free education for the masses – seemed to herald an exciting new wave. Yet many of us in support roles in higher education questioned whether the reality would live up to the hype. Articles lauding the new revolution were short on economic analysis. MOOCs are being offered without cost to students, but are not without cost to develop. Getting a handle on the financial side can be difficult as production costs are often hidden. These include: faculty time for course preparation and delivery, videotaping and editing costs, time spent to “scrub” content for copyright issues, and faculty and/or staff monitoring time when the course is running. How many institutions can support large scale production of free courses with no monetary return on investment? For that matter, if Harvard or Stanford is already offering an introduction to computer science MOOC, does it make sense for Anystate University to do the same?

Moreover, the MOOC environment does not necessarily bring out the best in pedagogical practices. A lecture watched online may loosely equate with a face-to-face lecture in a large course, but neither experience is likely to top a small, active-learning-centered classroom experience.

It is not surprising that two recent articles took on a different tone. In the Chronicle of Higher Education, Steve Kolowich wrote (April 14, 2014) an article titled 2014: The Year the Media Stopped Caring About MOOCs?. Kolowich identifies 2013 as the year of the MOOC backlash, and noted that “Coursera’s new chief executive, the former Yale University president Richard C. Levin, last month reiterated that the company’s MOOCs should be thought of as ‘additive to what universities are doing, not disruptive.’”

Meanwhile, Inside Higher Ed reported on April 17, 2014 that Udacity plans to begin charging students for MOOC course completion certificates, cutting MOOCs to MOCs (Massive Online Courses).

Diagram showing Gartner Hype Cycles

Gartner Hype Cycles. Jeremy Kemp: http://en.wikipedia.org/wiki/File:Gartner_Hype_Cycle.svg

Gartner, Inc., a leading information technology research and advisory company uses a method called Hype Cycles to analyze emerging technologies. [See illustration above] Five phases in a technology life cycle are identified: 1) the technology trigger 2) the peak of inflated expectations 3) the trough of disillusionment 4) the slope of enlightenment 5) the plateau of productivity. It would appear from the recent press that MOOCs are experiencing the crash into the trough of disillusionment. It will be interesting to see a year from now if there is an upward trend towards enlightenment.

Macie Hall, Senior Instructional Designer
Center for Educational Resources


Image Source: Jeremykemp at en.wikipedia
http://en.wikipedia.org/wiki/File:Gartner_Hype_Cycle.svg

Resources for Peer Learning and Peer Assessment

Students doing group workSeveral weeks ago our colleagues in the Center for Teaching and Learning at the Johns Hopkins School of Public Health presented the very informative half-day symposium Peer to Peer: Engaging Students in Learning and Assessment. Speakers presented on their real-life experiences implementing peer learning strategies in the classroom. There were hands-on activities demonstrating the efficacy of peer-to-peer learning. Two presentations focused on peer assessment highlighting the data on how peer assessment measures up to instructor assessment and giving examples of use of peer assessment.  If you missed it, the presentations were recorded and are now available.

A previous post highlighted Howard Rheingold’s presentation From Pedagogy to Peeragogy: Social Media as Scaffold for Co-learning. You will need to bring up the slides separately – there is a link for them on the CTL page.

For additional material on peer learning and assessment the JHSPH CTL resources page is loaded with information on the subject, outlining best practices and highlighting references and examples.

Macie Hall, Senior Instructional Designer
Center for Educational Resources


Image Source: Microsoft Clip Art