Midterm Course Evaluations

Many of us are reaching the mid-semester mark and students are anticipating or completing midterm exams. Perhaps you are in the throes of grading.  Now is a good time to think about letting your students grade you, in the sense of evaluating your teaching. Think of this as a type of formative assessment, an opportunity for you to make corrections to your teaching strategies and clarify student misconceptions.

There are several ways to obtain feedback and these evaluations do not needTwo buttons, green with a thumbs up and red with a thumbs down. to be lengthy. Examples and resources are explored below. Popular among instructors I’ve talked to are short, anonymous surveys, offered either online or on paper. Blackboard and other course management systems allow you to create surveys where student responses are anonymous but you can see who has responded and who has not, making it easy to track. You want to keep these evaluations focused with three or four questions, which might include: What is working in the class/what is not working? What change(s) would you suggest to improve [class discussions/lectures/lab sessions]? What is something you are confused about? Have you found [specific course assignment] to be a useful learning activity?

As the Yale Center for Teaching and Learning states on their website page Midterm Student Course Evaluations: “Midterm course evaluations (MCE) are a powerful tool for improving instructors’ teaching and students’ learning.  … MCE provide two critical benefits for teaching and learning: the temporal advantage of improving the course immediately, and the qualitative benefit of making teaching adjustments specific to the particular needs and desires of current students. In addition, MCE generally produce better quality feedback than end-of-term evaluations since students have a shared stake in the results and instructors can seek clarification on any contradicting or confusing responses.” The Yale site offers useful examples, strategies, and resources.

Michigan State University Academic Advancement Network offers a comprehensive guide with Mid-term Student Feedback, which includes research citations as well as examples. Here, too, you will find a list of resources from other universities on the topic, as well as more in-depth methods to gain student feedback. There is also a section with tips on effective use of information gained from student feedback.

A sampling survey-type midterm evaluations can be found in PDF format at the UC Berkeley Center for Teaching and Learning: Teaching Resources: Sample Midterm Evaluations. This document will get you off and running with little effort.

Ideally you will be using the results on the midterm exam or other learning assessment as a gauge along with the teaching evaluations. If the learning assessment is indicating gaps in content understanding, you can see how it aligns with feedback gained from the student evaluations. The value is that you can make timely course corrections. Another plus—students will see that you are genuinely interested in your teaching and their learning.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay.com

We Have a Solution for That: Student Presentations, Posters, and Websites

Some of our faculty are moving away from traditional end-of-semester assessments, such as term papers and high-stakes final exams, in favor of projects that can be scaffolded over a period of time. These may include having students share their research in an oral presentation, poster, or website. The question is, how do you support their research output? Fortunately, we have some solutions!

If your students are doing either oral presentations or electronic posters, check out Prezi Next, the new version of the online presentation application. [See our post on the original version, The Power of Prezi, from October 2014.] The new version, which runs on HTML5 rather than Adobe Flash, offers many more templates, a more intuitive interface, supports more file types, and is easier to navigate while presenting. While Prezi is great for a linear presentation, one advantage is that presentations can be designed to be non-linear, useful for facilitating a less formal discussion for example.

Looking for a presentation software that allows for easy collaboration among student team members? Check out Google Slides. Like Google Docs and Google Sheets, access to the slides can be shared and multiple users can work on the sides remotely and simultaneously—there’s even a chat feature to make group editing easy. There are some nicely designed templates, themes in Google-speak, and you can easily integrate content from Google spread sheets and documents. There is also a downloadable version of Google Slides for desktop use.

If you don’t like the templates in PowerPoint or Google Slides, check out Slides Carnival, which has many creative templates available for download, including fonts, icon sets, maps, and charts, graphs, and tables styled for each template. These work with both PowerPoint and Google Slides.

If you are looking to have your students create a website, Google Sites has recently come out with a new version of its website creation application. When you sign into Google Sites you can choose to use the classic version or the new one. The new version gives you fewer options (just six themes available currently), but is a snap to use, being essentially drag and drop. There no messing with HTML code, and it is easy to tie into the content from your other Google apps. There is an “add editors” feature that will facilitate group work. It’s a great option when you want your students to be focused on creating content, not on struggling with technology.

We also have some resources for students doing presentations and posters—online videos on creating and designing effective PowerPoint presentations and posters, as well as some handouts on these topics. See Presentation Strategies on the CER website. If your students (or you) are looking for freely-available and rights-free visual resources (images and multimedia) check out CER’s Visual Resources page.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: cc Wikimedia Commons

Quick Tips: Considerations for Flipping Your Course

Text reading flipping the classroom with the classroom upside downThe Innovative Instructor is offering a quick tip during this busy first week of classes. Have you been thinking about flipping your class? We’ve written a number of posts on the subject previously—see the list below—but we’ve just released a new guide: Considerations for Flipping Your Class [PDF]. The guide will help focus your thinking by asking questions about activities planned for class time, addressing recording issues and student access to recordings, and suggesting best practices. The primary audience is the Johns Hopkins faculty that our center serves, but the guide will be useful to anyone in the initial phase of thinking about hybrid teaching. We recommend consulting the teaching and learning staff at your institution for assistance. The following articles may also provide insight as you plan your strategy for flipping your course.

  1. Flipping a Statistical Analysis Course (January 31, 2017) by Avanti Arthreya and Dan Naiman
  2. Lunch and Learn: Flipped courses: What is the purpose? What are the strategies? (October 26, 2016)
  3. A Manual for Flipping Your Classroom (January 14, 2015)
  4. Flipping Your Class Humanities Style? (March 10, 2014)
  5. Quick Tips: Flipping Your Classroom (August 14, 2013)
  6. 2013 GSI Symposium Breakout Session 3: Flipping the Classroom (February 20, 2013)
  7. Flipping Your Class (January 23, 2013)

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: CC Macie Hall 2013

Facilitating and Evaluating Student Writing

Over the summer I worked on revising a manual for teaching assistants that we hand out each year at our annual TA Orientation. One of the sections deals with writing intensive courses across disciplines and how TAs can facilitate and evaluate writing assignments. The information, advice, and resources in the manual speak to an audience beyond graduate student teaching assistants. Even seasoned instructors may struggle with teaching writing skills and evaluating written assignments.

View from above and to the right of a woman's hands at a desk writing in a journal next to a lap top computer.Two mistakes that teachers may make are assuming that students in their courses know how to write a scholarly paper and not providing appropriate directions for assignments. These assumptions are likely to guarantee that the resulting student writing will disappoint.

As a quick aside, faculty often complain about the poor quality of student writing, claiming that students today don’t write as well as students in some vaguely imagined past, perhaps when the faculty member was a college freshman. However, the results of an interesting longitudinal study suggest otherwise. A report in JSTOR Daily, Student Writing in the Digital Age by Anne Trubek (October 19, 2016), summarizes the findings of the  2006 study by Andrea A. Lunsford and Karen J. Lunsford, Mistakes Are a Fact of Life: A National Comparative Study. “Lunsford and Lunsford, decided, in reaction to government studies worrying that students’ literacy levels were declining, to crunch the numbers and determine if students were making more errors in the digital age.” Their conclusion? “College students are making mistakes, of course, and they have much to learn about writing. But they are not making more mistakes than did their parents, grandparents, and great-grandparents.” Regardless of your take on the writing of current students, it is worth giving thoughtful consideration to your part in improving your students’ writing.

Good writing comes as a result of practice and it is the role of the instructor to facilitate that practice. Students may arrive at university knowing how to compose a decent five-paragraph essay, but no one has taught them how to write a scholarly paper. They must learn to read critically, summarize what they have read, identify an issue, problem, flaw, or new development that challenges what they have read. They must then construct an argument, back it with evidence (and understand what constitutes acceptable evidence), identify and address counter-arguments, and reach a conclusion. Along the way they should learn how to locate appropriate source materials, assemble a bibliography, and properly cite their sources. As an instructor, you must show them the way.

Students will benefit from having the task of writing a term paper broken into smaller components or assignments. Have students start with researching a topic and creating a bibliography. Librarians are often available to come to your class to instruct students in the art of finding sources and citing them correctly. Next, assign students to producing a summary of the materials they’ve read and identifying the issue they will tackle in their paper. Have them outline their argument. Ask for a draft. Considering using peer review for some of these steps to distribute the burden of commenting and grading. Evaluating other’s work will improve their own. [See the May 29, 2015 Innovative Instructor post Using the Critique Method for Peer Assessment.] And the opportunity exists to have students meet with you in office hours to discuss some of these assignments so that you may provide direct guidance and mentoring. Their writing skills will not develop in a vacuum.

Your guidance is critical to their success. This starts with clear directions for each assignment. For an essay you will be writing a prompt that should specify the topic choices, genre, length, formal requirements (whether outside sources should be used, your expectations on thesis and argument, etc.), and formatting, including margins, font size, spacing, titling, and student identification. Directions for research papers, fiction pieces, technical reports, and other writing assignments should include the elements that you expect to find in student submissions. Do not assume students know what to include or how to format their work.

As part of the direction you give, consider sharing with your students the rubric by which you will evaluate their work. See the June 26, 2014 Innovative Instructor post Sharing Assignment Rubrics with Your Students for more detail. Not sure how to create a rubric? See previous posts: from October 8, 2012 Using a Rubric for Grading Assignments, November 21, 2014 Creating Rubrics (by Louise Pasternak), and June 14, 2017 Quick Tips: Tools for Creating Rubrics. Rubrics will save you time grading, ensure that your grading is equitable, and provide you with a tangible defense against students complaining about their grades.

Giving feedback on writing assignments can be time consuming so focus on what is most important. This means, for example, noting spelling and grammar errors but not fixing them. That should be the student’s job. For a short assignment, writing a few comments in the margins and on the last page may be doable, but for a longer paper consider typing up your comments on a separate page. Remember to start with something positive, then offer a constructive critique.

As well, bring writing into your class in concrete ways. For example, at the beginning of class, have students write for three to five minutes on the topic to be discussed that day, drawing from the assigned readings. Discuss the assigned readings in terms of the authors’ writing skills. Make students’ writing the subject of class activities through peer review. Incorporate contributions to a class blog as part of the course work. Remember, good writing is a result of practice.

Finally, there are some great resources out there to help you help your students improve their writing. Purdue University’s Online Writing Lab—OWL—website is all encompassing with sections for instructors (K-12 and Higher Ed) and students. For a quick start go to the section Non-Purdue College Level Instructors and Students. The University of Michigan Center for Research on Learning and Teaching offers a page on Evaluating Student Writing that includes Designing Rubrics and Grading Standards, Rubric Examples, Written Comments on Student Writing, and tips on managing your time grading writing.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Photo by: Matthew Henry. CC License via Burst.com.

 

 

Back to School: From the Archives

Illustration of a blackboard with "Welcome to Class" written in white chalk.The Innovative Instructor blog is celebrating its five-year anniversary—we started posting in September 2012. To mark the beginning of the academic year, here are some tips and helpful hints in the form of posts from the archives to get instructors started on another successful semester. There are some new resources included as well.

Looking for advice on preparing for the first day of class and beyond? A post on from August 15, 2015, Back to School, offers some resources.  The Center for Teaching Excellence (CTE) at the University of Virginia has a great webpage on Teaching the First Day(s) of Class, with references to material on engaging students, creating an inclusive classroom, building rapport, learning names, and troubleshooting common teaching challenges.

What about using an icebreaker, an exercise or activity that provides an opportunity for students and the instructor to get to know one another? Take a look at the August 30, 2013 post Icebreakers for some ideas. Faculty Focus had a recent article, First Day of Class Activities that Create a Climate for Learning (July 19, 2017) that offers some other options.

Learning your students’ names is important to create a positive classroom climate. Even in a larger lecture course there are some ways to accomplish this task. See the post Learning Your Students’ Names from September 6, 2013 for tips and tricks. You can also download the guide Not Quite 101 Ways to Learn Students’ Names from the University of Virginia’s CTE website.

The use of mobile devices in the classroom, particularly smartphones, has become an issue faced by all faculty. It’s best to be clear about your policies on device use from day one. For strategies on dealing with this issue, see the October 12, 2012 post, Tips for Regulating the Use of Mobile Devices in the Classroom.

With these resources and strategies in hand, your semester should be off to a great start.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Pixabay.com

How Pretesting Can Help Your Students Fail Well

Our previous post When Failure is a Good Thing, looked at an initiative at Smith College called Failing Well, a set of programs that helps student understand that failing can lead to better learning. Today, The Innovative Instructor offers a concrete way in which you can introduce students to that concept.

Piece of lined, loose leaf notebook paper with six multiple choice questions. ABC or D is circled in red for each question.In Why Flunking Exams Is Actually a Good Thing (New York Times Magazine, September 4, 2104), Benedict Carey discusses the benefits of pretesting. He asks us to imagine that on the first day of a course we illicitly got a copy of the final exam. Would it help us to study more effectively and better attend to course readings, lecture materials, and class discussions? Undoubtedly it would. He then asks, “But what if, instead, you took a test on Day 1 that was just as comprehensive as the final but not a replica? You would bomb the thing, for sure. You might not understand a single question. And yet as disorienting as that experience might feel, it would alter how you subsequently tuned into the course itself — and could sharply improve your overall performance.” This is the concept of pretesting.

Carey calls it one of the most exciting developments in the science of learning field. “Across a variety of experiments, psychologists have found that, in some circumstances, wrong answers on a pretest aren’t merely useless guesses. Rather, the attempts themselves change how we think about and store the information contained in the questions. On some kinds of tests, particularly multiple-choice, we benefit from answering incorrectly by, in effect, priming our brain for what’s coming later.” The failure on the pretest is an example of failing well. It sets students up for better learning during the course. A study by U.C.L.A. psychologist Elizabeth Ligon Bjork found that “…pretesting raised performance on final-exam questions by an average of 10 percent compared with a control group.”

Carey cites additional studies of pretesting with the insight that “testing might be the key to studying” and a way of “enriching and altering memory.” More traditional ways of studying do not seem to produce the same depth of learning that frequent testing, including the kind of self-examination that includes recitation, appears to yield. Other studies have shown that immediacy of feedback—getting the correct answers soon after the pretest—led to the greatest learning gains.

Why does pretesting work? There are several theories. First it gives students a preview of the material and helps them “prime the brain” to absorb what is most important. A pretest sets up a hierarchy and adjusts student thinking. Secondly, it exposes false impressions, things students think they know but don’t, by conveying multiple possible answers that they may not have considered as possibilities. Biological factors may come into play as well. Guessing at an answer on a pretest works differently from the memory functions at play in remembering and studying. Guessing embeds an unfamiliar concept into the brain that will be recognized when come across again, particularly if that happens within a short timeframe.

There are limitations. For example, a pretest for an intro course in a foreign language using unfamiliar characters (Russian, Chinese, Arabic) wouldn’t work because students have no “scaffolding of familiar language to work with.” In fact, “[t]he research thus far suggests that prefinals will be much more useful in humanities courses and social-science disciplines in which unfamiliar concepts are at least embedded in language we can parse.”

What can we take away from Carey’s article? Because pretests don’t need to be graded, this can be an easy innovation to implement in your courses. A short multiple choice quiz given before your lecture or class discussion asking questions pertaining to the key points you will cover could make a big difference in your students’ learning of the material. To be sure that they leave with the right information, review the quiz and the correct answers at the end of class.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Pixabay.com

When Failure is a Good Thing

Smith College, and some other institutions of higher learning, are taking a new approach to failure and we should all be paying attention. At many colleges and universities, students strive for success at all costs; failure is not an option. There is a prevailing sense that peers are easily achieving great things with little effort, a B- is perceived as a bad grade, stress levels run high. At Smith, the time had come to call out both the ubiquity and the benefits of failure.

In On Campus, Failure is on the Syllabus (The New York Times, June 24, 2017), Jessica Bennett describes the initiative at Smith where students and faculty were videotaped describing their worst failure. These have been played at a campus hub during fall orientation and again during the final-exam period. In an atmosphere where everything seems pressured and competitive it was helpful to students to see that everyone struggles and that that is O.K.

The initiative, Failing Well, “…is a set of programs dedicated to the discussion of failure, risk taking and mistakes. …the mission is to increase student resilience by teaching, telling stories, and opening a campus conversation about failure.” The idea is to show students that their self-worth shouldn’t be tied solely to success, and that “failing well” can lead to unexpected bonuses. Given a set of skills and permission to “screw up” actually leads students to better learning and helps them to develop networks of resources.

Smith is not alone in this endeavor. Bennett lists other institutions engaged in similar “…remedial education that involves talking, a lot, about what it means to fail.” Today’s students have different needs in the real world and higher education should be preparing them appropriately.

As to the causes for the intense need to succeed, complicated forces and factors are at play, including child-rearing and cultural practices, “college admissions mania,” economic fears, social media, and a need to be busy, so called “competitive stress.”

Although an individual instructor may not be able to implement a campus-wide initiative, it is worth thinking about ways in which faculty can help students understand that failure is valuable to learning. In the next post, The Innovative Instructor will look at a specific practice of failure that enables better learning that anyone can use in teaching.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Pixabay.com

Considering the Use of Turnitin

Earlier this week an article from Inside Higher Ed (IHE) caught my eye. Sign with hand and text reading prevent plagiarism. In New Salvo Against Turnitin (June 19, 2017) Nick Roll summarizes an essay by Sean Michael Morris, Instructional Designer in the Office of Digital Learning at Middlebury College, and Jesse Stommel, Executive Director, Division of Teaching and Learning Technologies at the University of Mary Washington. The essay authors argue that faculty should rethink the use of Turnitin, questioning not only “…the control and use of people’s data by corporations…” but “…Turnitin’s entire business model, as well as the effects on academia brought on by its widespread popularity.” Morris and Stommel further contend that those using Turnitin “supplant good teaching with the use of inferior technology” reducing the student-instructor relationship to one where suspicion and mistrust are at the forefront. [Turnitin is a software application used to detect plagiarism, and Morris and Stommel are not the first to decry the company’s business model and practices.]

Although the IHE article provides a fair summary, as well as additional comments by Morris and Stommel, it is worth reading the 3,928 word essay—A Guide for Resisting Edtech: The Case Against Turnitin (Digital Pedagogy Lab, June 15, 2017)—to appreciate the complex argument. I agree with some of the concerns the authors address and feel we should be doing more individually and collectively to school ourselves and our students in the critical evaluation of digital tools, but disagree with what I feel are over-simplifications and unfair assumptions. Morris and Stommel cast faculty who use Turnitin as “surrendering efficiency over complication” by not taking the time and effort to use plagiarism as a teachable moment. Further, they state that Turnitin takes advantage of faculty who are characterized as being, at the core, mistrustful of students.

The assumption that faculty using Turnitin are not actively engaging in conversations around and instruction of ethical behavior, including plagiarism, and are not using other tools and resources in these activities is simply not correct. The assertion that faculty using Turnitin are suspicious teachers who are embracing an easy out via an efficient educational technology is also not accurate.

The reality is that some students will plagiarize, intentionally or not, and the Internet, social media practices, and cultural differences have rendered complicated students’ understanding of intellectual property. I believe that many of our institutions of higher learning, and faculty and library staff therein, make concerted efforts to teach students about academic integrity. This includes the meaning and value of intellectual property, as well as finer points of what constitutes plagiarism and strategies to avoid it.

I believe it is relevant to note that Middlebury College’s website boasts a mean class size of 16, while the University of Mary Washington lists an average class size of 19. Student-faculty ratios are 8 to1 and 14 to 1 respectively.  I cannot help but feel that Morris and Stommel are speaking from a point of privilege working in these two institutions. Instructors who teach at large, underfunded, state universities with classes of hundreds of students, relying on a corps of teaching assistants to grade their essays, are in a different boat.

The authors state: “So, if you’re not worried about paying Turnitin to traffic your students’ intellectual property, and you’re not worried about how the company has glossed a complicated pedagogical issue to offer a simple solution, you might worry about how Turnitin reinforces the divide between teachers and students, short-circuiting the human tools we have to cross that divide.” In fact, we may all be worried about Turnitin’s business model and be seeking a better solution. Yet in this essay nothing more concrete is given us on those human tools and how faculty in less privileged circumstances can realistically and effectively make use of them.

The Innovative Instructor has in the past posted on Teaching Your Students to Avoid Plagiarism (November 5, 2012, Macie Hall), and using Turnitin as a teaching tool: Plagiarism Detection: Moving from “Gotcha” to Teachable Moment (October 9, 2013, Brian Cole and Macie Hall). These articles may be helpful for faculty struggling with the issues at hand.

Yes, we should all be critical thinkers about the pedagogical tools we use; in the real world, sometimes we face hard choices and must fall back on less than ideal solutions.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source: Microsoft Clip Art edited by Macie Hall

Quick Tips: Tools for Creating Rubrics

The Innovative Instructor has previously shared posts on the value of using rubrics (Creating Rubrics, Louise Pasternak, November 21, 2014 and Sharing Assignment Rubrics with Your Students, Macie Hall June 26, 2014). Today’s Quick Tips post offers some tools and resources for creating rubrics.

Red sharpie-type marker reading "Rubrics Guiding Graders: Good Point" with an A+ marked below

Red Rubric Marker

If you are an instructor at Johns Hopkins or another institution that uses the Blackboard learning management system or Turnitin plagiarism detection, check out these platforms for their built-in rubric creation applications. Blackboard has an online tutorial here. Turnitin offers a user guide here.

If neither of these options are available to you, there is a free, online application called Rubistar that offers templates for rubric design based on various disciplines, projects, and assignments. If none of the templates fit your need, you can create a rubric from scratch. You must register to use Rubistar. A tutorial is available to get you started. And you can save a printable rubric at the end of the process.

Wondering how others in your field have designed rubrics for specific assignments or projects? Google for a model: e.g., “history paper rubric college,” “science poster rubric college,” “video project rubric college” will yield examples to get your started. Adding the word “college” to the search will ensure that you are seeing rubrics geared to an appropriate level.

With free, easy to use tools and plentiful examples to work from, there is no excuse for not using rubrics for your course assignments.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image source © 2014 Reid Sczerba

 

 

Faculty Office Hours: The Instructor is In

Peanuts comic showing Lucy in the psychiatrist's booth, re-labelled to say "Course Help Free; The Instructor is In."What if you hold office hours and nobody comes? That’s the issue that Dr. Richard Freishtat, Director of the Center for Teaching and Learning at UC Berkeley addresses in Don’t Be Alone During Office Hours (Tomorrow’s Professor, January 10, 2017). He describes a student panel at Berkeley on facilitating student success. When the student panelists were asked by a faculty member about attending office hours, there was silence. Why was this opportunity not being pursued? One student responded, “Reason #1: ‘I think office hours is for students who are struggling with the material and need extra help. I wouldn’t want my professor to know I’m struggling, even if I was.’ Reason #2: ‘I was fascinated by the Professor, the discipline, and research in the field beyond what we were focusing on in class. I would have loved to drop into office hours and just talk with my professor about her own research, but figured there’s no way she’d want to take the time to do that with me.’” Faculty in the audience expressed just how much they would appreciate students coming to see them for the latter reason.

Freishtat goes on to suggest some ways to increase student attendance at office hours including making it an assignment, telling students how to use/what the purpose is of office hours, explaining to students how to start an office hours conversations (bring a question, a quote of interest, a story), scheduling varying days and times to accommodate different schedules, and promoting office hours throughout the semester/quarter.

For more on practical measures to take to improve the participation and outcome of your office hours, see the Stanford Teaching Commons website on Office Hours That Work and the University of Washington Center for Teaching and Learning on Face to Face Office Hours.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: CC Image from Flickr [https://www.flickr.com/photos/frederickhomesforsale/16107671226] modified by Macie Hall