Faculty Sharing Session: Best Practices in Course Design

Four Johns Hopkins faculty recently attended the National Effective Teaching Institute workshop.  At a Center for Teaching Excellence and Innovation discussion this spring, each faculty member shared lessons learned as they presented a quick overview of a main topic in the workshop.

Student Motivation

Liz Walker, JHULiz Walker, a lecturer in the Center for Leadership Education, shared that the workshop began with discussion of student motivation as a spectrum based on the article, Investigating the motivational behavior of pupils during outdoor science teaching within self-determination theory, in Frontiers in Psychology.

The workshop discussion used Self-Determination Theory as a framework to understand motivation from several angles.

  • intrinsic motivation: learning for enjoyment and personal satisfaction
  • identified regulation: learning because it aligns with personal goals
  • introjected regulation: learning due to internal pressures, such as guilt or social approval
  • external regulation: learning controlled by external rewards or punishments

The discussion also described how motivation contains three elements: relatedness, autonomy, and competence.

Relatedness happens on multiple levels: making connections to others, learning from and teaching others, and knowing how the work affects others. Consider these questions as you motivate students through relatedness:

  • How do your students connect with each other?students working on an engineering problem on a whiteboard
  • How do you connect with your students?
  • How do you help your students make connections to engineering practice?
  • How do you connect what you are teaching to society?
  • How do some professors discourage relatedness?

Autonomy is both implicit and explicit. You can engender autonomy by helping students feel like they are allowed to do something or feeling like it is OK to make choices. Discussion questions on autonomy included

  • In what ways do you let your students make choices?
  • In what ways do you let your students control what happens in the classroom?
  • Are there ways that professors communicate that the students aren’t in control?

Competence is having the knowledge, skills, and abilities to succeed. Students must have the confidence that they are competent. As you plan your lessons,

  • How do you make sure students are able to do what you ask of them?
  • How do you develop their confidence?
  • Are there things you do that make students lose confidence?

The main takeaway of the NETI section on motivation is that motivation is important for learning. To increase student motivation, instructors should ask themselves

  • Are my students able to do what I’m asking them to do?
  • How can I give them choices?
  • How can I help them make connections to what I’m teaching?

Active Learning

Marina Choy, a lecturer in the Center for Leadership Education, discussed active learning, another theme explored in the workshop.  The workshop facilitators defined active learning as “students doing anything in class to learn material, other thanMarina Choy, JHU listening to the instructor and taking notes.” Research shows active learning is more effective than lecturing. It helps students learn better through activity and engagement. It falls on a continuum ranging from instructor-focused to student-focused learning.  Instructor-focused means high instructor control and low student autonomy. An example of that is an active lecture, where traditional lecturing is interspersed with engaging activities. Student-focused means high student autonomy and low instructor control. Examples include problem-based and project-based learning, which require critical thinking, collaboration, and problem-solving. Shared responsibility is in the middle of the continuum. Examples include structured discussions, guided problem-solving, etc.

Other examples of active-learning discussed include

  • One-minute paper
  • Think-Pair-Shares
  • Start of class recap
  • Polling or low-stake quizzes
  • Asking students to generate questions
  • Muddiest Point
  • Peer Reviews

The presenters also shared common mistakes in implementing active-learning along with how to avoid them.

  • Always calling on volunteers. This creates a participation gap; the same students will participate while others observe. As an alternative, use cold-calling, warm-calling, use think-pair-share, or use a randomized system.
  • Waiting for everyone to finish. Some students will finish quickly and lose engagement, others will feel pressure or rushed. As an alternative, use a reasonable time limit and let students know how much time they have, and/or consider pairing up students to work on the task together.
  • Using trivial activities. Activities that lack depth are often perceived as busywork and may reduce student motivation. Active learning is not about entertaining students but engaging them meaningfully. Ensure activities have a clear purpose and are aligned with your learning objectives. Ask: does this activity challenge students to think, analyze, or apply knowledge?

Learning Objectives

Ali Madooei, an associate teaching professor in computer science, discussed learning objectives. He developed an AI-based application (OPENAI API Key required to use) to help instructors write learning objectives that are S.M.A.R.T. and motivated by Bloom’s Taxonomy. Ali Madooei, JHUThe purpose of learning objectives is to

  • provide students with clear expectations about what they should learn and help them track their own academic progress.
  • guide instructors in aligning course design, assessments, and activities with learning objectives.
  • enable programs to map learning goals across courses and identify curriculum gaps or overlaps.
  • allow institutions to measure program effectiveness and make evidence-based improvements to student learning.
  • help accrediting bodies assess program quality and educational standards.

Assessment

Sara More, an associate teaching professor in computer science, talked aboutSara More, JHU assessment. Assessment is gathering data about the learning process. It is more than just evaluation, where instructors collect data for the purpose of making evaluative and pass/fail judgments. Assessment helps the faculty member facilitate the learning process for students which includes providing feedback to help them improve.

More discussed three categories used to classify course-based assessments.

  • Diagnostic – Diagnostic assessments help instructors determine what students already know, and what misconceptions they are starting with so instructional plans can be tailored to meet student needs. Methods to support diagnostic assessments include the following.
    • Consider giving an early quiz on prerequisite knowledge
    • Announce in advance that the quiz will be counted in the course grade so it is taken seriously
    • Provide a study guide with learning objectives and practice problems
    • Link to resources for students who feel underprepared
    • Hold office hours where students can come to discuss practice problems they are not able to solve
  • Formative – Formative assessments help instructors measure student progress during the learning process. Effective learning takes place when students engage in a cycle involving practice, feedback, more practice, and more feedback. Examples of formative assessment include the following.
    • In-class formative assessment (e.g., clicker questions – think/pair/share, minute papers, evaluate a sample solution using provided rubric, active learning involving discussion)
    • Out-of-class formative assessment (e.g., homework, draft outlines of solutions, online quizzes)
    • Formative assessment to improve instruction (e.g., mid-semester evaluation, classroom observation)
  • Summative – Summative assessments are used when instructors are evaluating (e.g., assigning grades) student work. A summative assessment can also be considered formative if it is low stakes and helps students prepare for more significant assessments. Examples of summative assessment include the following.
    • In-class exams
    • Take-home exams
    • Essays
    • Case studies
    • Projects

If you are interested in learning more about these topics, consider attending the Johns Hopkins Best Practices in University Teaching workshop or the NETI workshop.

Mike Reese
Associate Dean of the Center for Teaching Excellence and Innovation and Associate Teaching Professor in Sociology, Johns Hopkins University

Image source: JHU Whiting School of Engineering website, Pixabay

What is Specifications Grading and Why Should You Consider Using It?

During the fall semester I came across the concept of specifications grading. We had a faculty member interested in trying it out, and another professor who was already using a version of it in his courses. For today’s post, I’d like to give an overview of specifications grading with resources to turn to for more information.

Note paper check list with pencil.Specifications grading is not a brand new concept. In the spring of 2016, both Inside Higher Ed and The Chronicle of Higher Education ran articles on this grading method. The Inside Higher Ed piece, Yes, Virginia, There’s a Better Way to Grade (January 19, 2016) was written by Linda Nilson, who authored the seminal work on the concept: Specifications Grading: Restoring Rigor, Motivating Students, and Saving Faculty Time (Stylus Publishing, 2015).

Nilson starts her book, which is a relatively short read (131 pages of text), by giving an overview of the history of grading. While the origins of our university system goes back to the 6th century, grading students is a more recent idea, first appearing in the 1700s and becoming more formalized in the 19th century. There is little standardization across institutions and practices vary considerably. Nilson notes that grading on the curve, grade inflation, and interpretations attached to grades further complicate the practice, leading to a system that she characterizes as broken and damaging to both faculty and students. Moreover, it is not at all clear that grades are an accurate predictor of future success.

Nilson contends there is a better system (see summary pp. 129-131), i.e., specifications grading (also called specs grading), which will:

  1. Uphold high academic standards,
  2. Reflect student learning outcomes,
  3. Motivate students to learn,
  4. Motivate students to excel,
  5. Discourage cheating,
  6. Reduce student stress,
  7. Make students feel responsible for their grades,
  8. Minimize conflict between faculty and students,
  9. Save faculty time,
  10. Give students feedback they will use,
  11. Make expectations clear,
  12. Foster higher-order cognitive development and creativity,
  13. Assess authentically,
  14. Achieve high interrater agreement,
  15. Be simple.

Her grading construct, which can be adapted in part or fully (as she explains in detail in her book), relies on pass/fail grading of assignments and assessments, the structuring of course content into modules linked to learning outcomes, and the bundling of assignments and assessments within those modules. The completion of course modules and bundles is linked to traditional course grades. In the pure form of specs grading, students determine what grade they want and complete the modules and bundles that correspond to that grade.

Nilson provides a summary of the features of specifications grading (p. 128):

  • Students are graded pass/fail on individual assignments and tests or on bundles or modules of assignments and tests.
  • Instructors provide very clear, detailed specifications (specs)—even models if necessary— for what constitutes a passing (acceptable/ satisfactory) piece of work. Specs reflect the standards of B-level or better work.
  • Students are allowed at least one opportunity to revise an unacceptable piece of work, or start the course with a limited number of tokens that they can exchange to revise or drop unacceptable work or to submit work late.
  • Bundles and modules that earn higher course grades require students to demonstrate mastery of more skills and content, more advanced/ complex skills and content, or both.
  • Bundles and modules are tied to the learning outcomes of the course or the program. Students will not necessarily achieve all the possible outcomes, but their course grade will indicate which ones they have and have not achieved.

Nilson’s article in Inside Higher Ed referenced above, gives a quick overview to specifications grading basics. It’s a good starting place to determine if the concept holds appeal for you. While any new system of teaching, including grading, will have a learning curve, specs grading offers a great deal of flexibility. In her book, Nilson gives examples of ways to partially integrate the concept into your course planning. It is also clear that once implemented, the system saves faculty time in making “hairsplitting decisions” about how many points to award on an assignment or test. Rubrics are required, but they are based on a satisfactory/unsatisfactory set of criteria, rather than spelling out what is expected for a full range of grades. Yes, faculty must be transparent and up front about this system with the students, but the anecdotal experiences that Nilson shares in her book indicate that students find specs grading to be less stressful and more motivating than traditional methods.

I recommend reading Nilson’s full book to understand the nuances and to determine which aspects of the system you will want to employ. To give you a sense of the scope of the book, following is an outline of the chapters and material covered.

Chapter 1: Introduction to and history of grading, and rationale for a new grading system.
Chapter 2: Discussion of learning outcomes and course design.
Chapter 3: Linking grades to outcomes—covers Bloom’s Taxonomy and how specs grading works in this regard.
Chapter 4: The efficacy of pass/fail grading.
Chapter 5: Details of specifications grading with detailed examples, including the role of rubrics, and adding flexibility through the use of tokens and second chances.
Chapter 6: How to convert specs graded student work to final letter grades. This chapter explains the concept of modules and bundling as related to levels of learning and grades that will be earned as modules/bundles are completed.
Chapter 7: Examples of specifications-graded course design. Nilson presents nine case studies from a variety of disciplines that include the types of activities and assessments that can be used.
Chapter 8: How and why specs grading motivates students—this chapter examines theories and research on student motivation to build a case for specs grading.
Chapter 9: Detailed instructions for developing a course with specs grading. This chapter includes tips for a hybrid course model that combines elements of specs grading with traditional grading constructs, and ideas for introducing students to specs grading.
Chapter 10: Conclusion and evaluation of specifications grading.

I also want to mention the article in The Chronicle of Higher Education, Prof Hacker Blog, Experimenting with Specifications Grading, Jason B. Jones, March 23, 2016, which reports on an instructor’s experience with specifications grading. It links to this blog post Rethinking Grading: An In-Progress Experiment, February 16, 2016, by Jason Mittell, who teaches at Middlebury College. The first-hand experience will be enlightening to those considering specs grading. Mittell includes the statement on his syllabus explaining specs grading to students, which will help you formulate your own explanation for this important part of a successful implementation of specs grading. You should also be sure to read the comments on the Prof Hacker piece for some additional ideas and resources.

As always, I am interested in comments from those who have tried or are considering this idea. Please share your thoughts.

Macie Hall, Senior Instructional Designer
Center for Educational Resources

Image Source: Pixabay.com