2013 GSI Symposium Breakout Session 2: Formative Assessment

A Report from the Trenches

We’re continuing with our reports from the JHU Gateway Sciences Initiative (GSI) 2nd Annual Symposium on Excellence in Teaching and Learning in the Sciences. Next up is “Assessing Student Learning during a Course: Tools and Strategies for Formative Assessment” presented by Toni Ungaretti, Ph.D., School of Education and Mike Reese, M.Ed., Center for Educational Resources.

Please note that links to examples and explanations in the text below were added by CER staff and were not included in the breakout session presentation.

The objectives for this breakout session were to differentiate summative and formative assessment, review and demonstrate approaches to formative assessment, and describe how faculty use assessment techniques to engage in scholarly teaching.

Summarizing Dr. Ungaretti’s key points:

Assessment is a culture of continuous improvement that parallels the University’s focus on scholarship and research. It ensures learners’ performance, program effectiveness, and unit efficiency. It is an essential feature in the teaching and learning process. Learners place high value on marks or grades: “Assessment defines what [learners] regard as important.” [Brown, G., Bull, J., & Pendlebury, M. 1997. Assessing Student Learning in Higher Education. Routledge.]  Assessment ensures that what is important is learned.

Summative Assessment is often referred to as assessment of learning. This is regarded as high stakes assessment – typically a test, exam, presentation, or paper at the midterm and end of a course.

Formative Assessment focuses on learning instead of assigning grades. “Creating a climate that maximizes student accomplishment in any discipline focuses on student learning instead of assigning grades. This requires students to be involved as partners in the assessment of learning and to use assessment results to change their own learning tactics.” [Fluckiger, J., Tixier y Virgil, Y., Pasco, R., and Danielson, K. (2010). Formative Feedback: Involving Students as Partners in Assessment to Enhance Learning. College Teaching, 58, 136-140.]

Effective formative assessment involves feedback. That feedback has the greatest benefit when it addresses multiple aspects of learning. It includes feedback on the product (the completed task), feedback on progress (the extent to which the learner is improving over time), and feedback on the process (If the learner is involved, feedback can be given more frequently.)

Diagram showing the Three Ps of Formative Assessment

 From this point on in the session, the participants engaged in active learning exercises that demonstrated various examples of formative assessment including utilizing graphic organizers (Venn Diagrams, Mind Maps, KWL Charts, and Kaizen/T-Charts – practices that focus upon continuous improvement), classroom discussion with higher order questioning (based on Bloom’s Taxonomy),  minute papers, and admit/exit slips.

Classroom discussions can tell the instructor much about student mastery of basic concepts. The teacher can initiate the discussion by presenting students with an open-ended question.

A minute paper is a quick in-class writing exercise where students answer a question focused on material recently presented, such as: What was the most important thing that you learned? What important question remains? This allows the instructor to gauge the understanding of concepts just taught.

Admit/exit slips are collected at the beginning or end of a class. Students provide short answers to questions such as: What questions do I have? What did I learn today? What did I find interesting?

There are many ways in which faculty can determine learner mastery. These may include the use of journaling or learning/response logs to gauge growth over time, constructive quizzes, using modifications of games such as Jeopardy, or structures such as a guided action or Jigsaw. There are also ways to quickly check student understanding such as using thumbs-up–thumbs-down, or i>Clickers.

Assessment may also be achieved by using “learner-involved” formative assessment.  Some ways to achieve this are through the use of three-color group quizzes, mid-term student conferencing, assignment blogs, think-pair-share, and practice presentations.

When incorporated into classroom practice, the formative assessment process provides information needed to adjust teaching and learning while they are still happening. Finally, faculty should look on formative assessment as an opportunity. No matter which methods are used it is important that they allow students to be creative, have fun, learn, and make a difference.

Faculty may also use assessment methods as research. This allows them the opportunity to advance hypotheses-based teaching, gather data on instructional changes and student outcomes, and to prepare scholarly submissions to advance the knowledge on teaching in their discipline. Teaching as research is the deliberate, systematic, and reflective use of research methods to develop and implement teaching practices that advance the learning experiences and outcomes of students and teachers.

Cheryl Wagner, Program/Administrative Manager
Center for Educational Resources

Macie Hall, Senior Instructional Designer
Center for Educational Resources


Image Source: Macie Hall

 

Teaching Tips: Classroom Assessment

Increasing emphasis is being placed on assessment, and many faculty are looking for evaluation practices that extend beyond giving a mid-term and final exam. In particular the concept of non-graded classroom assessment is gaining traction. In their book Classroom Assessment Techniques, Thomas Angelo and Patricia Cross (Jossey-Bass, 1993) stress the importance of student evaluation that is “learner-centered, teacher-directed, mutually beneficial, formative, context-specific, ongoing, and firmly rooted in good practice.”

Students in a classroom.

While the authors describe in detail numerous techniques for ascertaining in a timely manner whether or not students are learning what is being taught, here are several quick and easy to implement methods:

 

The Minute Paper: At an appropriate break, ask students to answer on paper a specific question pertaining to what has just been taught. After a minute or two, collect the papers for review after class, or, to promote class interaction, ask students to pair off and discuss their responses. After a few minutes, call on a few students to report their answers and results of discussion. If papers are turned in, there is value to both the anonymous and the signed approach. Grading, however, is not the point; this is a way to gather information about the effectiveness of teaching and learning.

In Class Survey: Think of this as a short, non-graded pop quiz. Pass out a prepared set of questions, or have students provide answers on their own paper to questions on a PowerPoint/Keynote slide. Focus on a few key concepts. Again, the idea is to assess whether students understand what is being taught.

Exit Ticket: Select one of the following items and near the end of class ask your students to write on a sheet of paper 1) a question they have that didn’t get answered, 2) a concept or problem that they didn’t understand, 3) a bullet list of the major points covered in class, or 4) a specific question to access their learning. Students must hand in the paper to exit class. Allow anonymous response so that students will answer honestly. If you do this regularly, you may want to put the exit ticket question on your final PowerPoint/Keynote slide.

Tools that can help with assessment

Classroom polling devices (a.k.a. clickers) offer an excellent means of obtaining evidence of student learning. See http://www.cer.jhu.edu/clickers.html for information about the in-class voting system used at JHU. Faculty who are interested in learning more should contact Brian Cole in the CER.

Faculty at the JHU School of Nursing have been piloting an online application called Course Canary to obtain student assessment data. Formative course evaluation surveys allow faculty to collect student feedback quickly and anonymously. A free account is available (offering two online surveys and two exit ticket surveys) at: https://coursecanary.com/.

Macie Hall, Senior Instructional Designer
Center for Educational Resources


Image source: Microsoft Clip Art