Category Archives: Assessment

Assessment, Teaching and Learning, Teaching Literature, Teaching Writing

Free Rhetorical Analysis Unit

4 Comments

I recently found myself in the position of having to teach AP English Language for about five weeks. I won’t get into why that happened. I have never taught AP Lang. I think I’ve taught just about everything else! I decided it would be a good opportunity to do a quick unit on rhetorical analysis, which I have at least taught in the past.

For context, my classes are 70 minutes long, and typically meet three times per week. What follows below is a day-by-day plan for my unit. Feel free to use any of this. I borrowed very heavily from others and acknowledge or link to their work where I was able to do so.

Day 1

I used a lesson from Jennifer Fletcher’s book Teaching Arguments: Rhetorical Comprehension, Critique, and Response. For reference, it’s the Parlor Conversation Metaphor/Learning to Pay Attention lesson in which students examine a painting for ten minutes. I used the same painting as Jennifer and followed her lesson instructions exactly. Because her text is copyrighted, I cannot share the materials here, but I urge you to purchase her book.

Day 2

I introduced students to rhetoric. First, we journaled on this topic: Think of a time someone talked you into doing something or believing something. How did they do it? What tactics did they use? Students may share out journals. I gave students a graphic organizer with a PAPA analysis (purpose, audience, persona, argument) and picked a speech. Frankly, the speech I picked, which was Samwise Gamgee’s speech to Frodo Baggins in The Two Towers, failed spectacularly since students had no frame of reference. Note: that movie is old now. I know. It makes me sad, too. So go cautiously if you use this, but maybe pick something else. You can find a massive list here.

To be honest, I didn’t have time to make my own, so I bought a bunch of graphic organizers from Teachers Pay Teachers. Students worked with a partner to fill out the PAPA graphic organizer. Then we shared out to the class.

For homework, I assigned students an article from Kelly Gallagher’s Article of the Week website. Pick one you like! I picked this one about food deserts because our school is located in one. I asked students to prepare to have a fishbowl-style discussion on the article using the questions on the article (see the end). Before we ended class, I set discussion norms with the students.

Day 3

Students engaged in a fishbowl discussion of the article they read for homework. If you are new to fishbowl discussion, essentially, you divide the class into two groups. The first group is the “inner circle,” whose job is to begin the discussion. It should be student-centered, and the teacher should listen and take notes. I track discussions like this using an iPad app called Equity Maps. The second group is the “outer circle,” whose job is to listen to the first group and take notes. I set a timer for 15 minutes for the first group. Then the groups swap positions and the second group has a discussion while the first group listens and takes notes. After both groups discussed the text, we debriefed the discussion experience:

  • What did you observe during the discussion of the text?
  • What is one thing you heard that you agree with?
  • What is one thing you heard that you disagree with?
  • How did you feel while on the outside of the fishbowl?
  • How did you feel while on the inside of the fishbowl?

For homework, I assigned students to write a reflection on their learning. I have used the same template for seminar reflections for years. I stole it from Greece New York Public Schools well over 15 years ago. Unfortunately, it’s no longer available on their site, so I’m going to try to link it below.

Socratic Seminar Reflection

Day 4

I introduced students to ethos, pathos, and logos. Because students had read Bryan Stevenson’s book Just Mercy over the summer, I returned to his work and shared his TED Talk with them.

As students watched, they took notes on a graphic organizer:

  • Speaker: Who is the speaker?
  • Audience: Who is the intended audience for this speech?
  • Subject: What is the speech mostly about?
  • Context: What was happening in history at the time this speech was given (Stevenson discusses some of this in the speech)?
  • Why do you think the speaker gave this speech?

I drew a triangle on the board and asked students to tell me which of the questions above related to who the speaker was and how he established his credibility. I wrote “ethos” next to the top corner of the triangle and defined it as an author or speaker’s credibility on the topic. Is the speaker or author reliable or credible? Is the speaker or author knowledgeable? Does Bryan Stevenson establish himself as credible? Why or how?

Next, I asked which of the questions above were related to how the audience feels when listening to the speech. I added “pathos” to the triangle on the board and defined it as an appeal to emotions. How does the text make the audience feel? What emotional appeals does Stevenson make? How does the speech make you feel?

Finally, I asked which of the questions above has to do with research, evidence, or facts (this might be a good time to point out that some areas overlap; context, purpose, and subject might appeal to both pathos and logos). I added “logos” to the triangle and defined it as an appeal to logic and reason. How do the facts and evidence support the claim? What appeals to facts, logic, and reason did Stevenson make?

Following this introduction, we discussed the speech using these questions as a guide:

  • What do you think would happen if these three different kinds of appeals were unbalanced? For example, what if the speech had no appeals to emotions? No facts, research, or evidence?
  • What if it were someone else besides Bryan Stevenson (feel free to play with different celebrities here; could Taylor Swift deliver this speech believably? Kanye West?
  • How well do you think this speech balances the three types of appeals?

For homework, students read Martin Luther King, Jr.’s Letter from a Birmingham Jail.

Day 5

I shared the background context (but not the Call for Unity letter… yet) as seen in slide 1 below. Then I posted the questions on slide 2 and asked students to get in small groups to discuss.

We reconvened as a class, and groups shared out the highlights of their discussion. Then I shared the Call to Unity letter so students could check their speculation about question 3 on the slide deck.

I introduced a one-pager assignment on Letter from a Birmingham Jail.

Day 6

I gave students this class period to work on their one-pagers. I supplied paper and colored pencils for students who wanted them.

Day 7

For this lesson, I owe everything to the #TeachLivingPoets crowd. They created the whole lesson and shared it at NCTE in 2018. We read Clint Smith’s poem “Playground Elegy” from the collection Counting Descent. We discussed the following questions:

  • What do you notice?
  • What words and phrases stand out?
  • What patterns do you notice?
  • What is the argument?

Next, I asked students to work with a partner or group of 3 to create a rhetorical triangle analysis of the poem. It’s fun to use big sticky poster paper and markers, which I provided for students. You might want to display a rhetorical triangle for students as a reminder. Students should include the following:

  • Speaker/author
  • Subject
  • Audience
  • Thesis/purpose

Students put their large sticky posters up and did a gallery walk. I made them spend two minutes on each poster so they would really read it. I set a timer and everything! Then I asked them to share something interesting they noticed on another group’s poster.

The one-pagers were due for the next class, so I reminded students to finish them for homework.

Day 8

This lesson was also stolen from the #TeachLivingPoets presentation from 2018. I displayed the slide deck below.

I went through slides 1 (with Fatimah Asghar’s biography) to 5. Then I posted slide 6 and handed out copies of Asghar’s poems “Microaggression Bingo” and “Partition” from their collection If They Come for Us: Poems. Students discussed these questions in relation to the two poems in groups. Then the groups shared with the class.

I wrote SOAPSTone on the board and gave students a SOAPSTone graphic organizer with a chart on both sides of the paper. They analyzed each of the poems using the graphic organizer as a class, but you could easily have them do it in small groups.

Day 9

I introduced an out-of-class rhetorical analysis essay and gave students a list of speeches from which to choose. I said they might also pick another speech, and one student did. I also brought in some essay and poetry collections, but all my students opted for a speech. I asked them to fill out a SOAPSTone graphic organizer on their selected speech. Then, I suggested they examine appeals to ethos, logos, and pathos with examples of each, identify style choices and details and build an analysis:

  • What is the writer’s intention?
  • Who is the intended audience?
  • What is the argument?
  • What is the writer’s strategy to make that argument? Why?
  • What appeals does the writer use to persuade the reader? Why
  • What kind of style does the writer use?
  • What effect does this work have on the audience?

Students had time in class to begin all this planning work.

Day 10

I decided to introduce rhetorical analysis of a film by screening Ava Du Vernay’s 13th, which is available on Netflix or free on YouTube.

As students watched the film, I instructed them to take notes on the following aspects:

  • Appeals to ethos
  • Appeals to logos
  • Appeals to pathos
  • SOAPSTone

This film is over 1:40, so we didn’t finish in one period and carried the film over to the next class.

Students continued working on drafts of their rhetorical analysis for homework.

Day 11

We finished the film and discussed it using the Thoughts, Questions, and Epiphanies method I described in this blog post. Credit for this strategy goes to Marisa Thompson. Here is what I posted for students to guide their discussion:

Students were in groups of 3 or 4, and I gave them 15-20 minutes to talk. Then they shared their top 2 thoughts, questions, or epiphanies on the board, and their ideas guided the rest of our class discussion of the film.

For homework, students finished a first draft of the rhetorical analysis.

Day 12

Writing workshop. Conference with students on their drafts, give them time to read and edit each other’s work, or work on their drafts.

Day 13

Ugh. The test. Most of our students take AP Lang exams, so I gave them the 2021 AP Lang rhetorical analysis (Sonia Sotomayor’s speech) as a timed writing practice. We debriefed the prompt after the timed writing. I gave them a copy of the AP rhetorical analysis rubric and went over it. Then I asked them to score themselves on the rubric and add a sentence to the end of the timed writing explaining how they scored themselves and why.

Day 14

We examined the College Board’s sample essays on the rhetorical analysis for the 2021 prompt on Sonia Sotomayor’s speech and scored them. Then I revealed the scores the essays earned and explained the rationale for the score. My students nailed it. They scored each essay exactly as the College Board did! We also discussed how they feel about their timed writing from the previous class now that they’ve seen models, and most students indicated they feel pretty good. At this point, I was preparing to hand the class over to their new full-time teacher, so she took some time to get to know the students with some games.

Day 15

We played rhetorical analysis Jenga. I decided to have them examine a short piece by Temple Grandin from This I Believe. I introduced students to Temple Grandin by showing this short video.

I owe Melissa Smith and Joel Garza for the idea for the Jenga game, which I adapted from literary analysis. Here is a list of questions I used.

You will need enough Jenga games for students in groups of 3-4. Number the blocks from 1-22. You will repeat numbers, and that is okay.

I also collected final drafts of the rhetorical analysis essay.

The graded assessments in this unit were the fishbowl reflection, the one-pager, and the rhetorical analysis essay. I do not believe in grading timed writing or participation. I think it puts too much pressure on students to grade timed writing when it is practice and should be a formative assessment. I have moved away from grading participation because it is difficult to assess what students are learning. Students may dominate discussion without really learning much to rack up participation grades, or they may be introverted and struggle to speak but still learn a lot, so I just don’t do it. I grade reflections on discussions instead.

That’s it! I hope it’s useful.

Assessment, Teaching Literature

Teaching Tommy Orange’s There There: Part Four

2 Comments
Images used in accordance with Creative Commons Larry D. Moore CC BY-SA 4.0 and Fair Use for Educational Purposes

In my last three posts, I have described how my teaching partner James and I approach teaching Tommy Orange’s novel There There. In this final post, I will explain how we wrap up the study of the novel, suggest additional resources to use in teaching Native Voices, and share a summative assessment we use with our students.

James and I decided we wanted students to finish the entire Powwow section before we discussed it since that part of the book moves quickly among the different characters, but at about 60 pages makes up 3 reading assignments. Rather than plunge into discussion of this fast-paced part of the book, we paused to show students this video from Vox about the Native boarding schools, including the Carlisle Indian Industrial School. This video also touches in the Indian Child Welfare Act (ICWA), which will be challenged in the Supreme Court case Brackeen v. Haaland this year. Our students found this video very interesting. It covers a great deal of important ground that is not covered in great detail in the novel. ICWA connects to the character Blue , who is adopted by White parents and must reclaim her Cheyenne culture as an adult. I understand that Tommy Orange’s sequel to There There will explore the Native boarding schools.

We also showed students the following video that asks Native people to reflect on several statements and explain whether they agree or disagree and why. It helps students to understand that indigenous people are not a monolith—their backgrounds and opinions on issues that impact Native people vary. Fair warning: the video includes the F-word and one reference to the N-word, so students should be warned.

Once students finish the Powwow section, we will use a class discussion strategy called “Conversation Stations” or “Converstations” to unpack quotes we identified as important in this section. We use big poster-sized sticky paper with a printout of each quote taped next to the paper. Students will travel in groups, discussing the quotes, and capturing their ideas on the paper. Then they will rotate to the next station and add their thoughts to the ideas already written and connect to their peers’ ideas.

James and I assess our students’ learning at the end of this unit through a writing assignment we call “I Used to Think… Now I Think.” This assignment allows students to discuss what they previously believed to be true about Native people and reflect on their learning. What stereotypes did they believe? How have their perceptions changed? Students might consider the following issues from the novel:

  • Addiction
  • Trauma
  • Identity
  • Belonging
  • Nation
  • Family
  • Connectedness

Students can weave discussion of symbols and motifs from the novel as well. Some examples might be the spider and its web or reflection and mirrors. We ask students to write one body paragraph explaining what they used to think and then, in two additional body paragraphs, explain what they have learned in the unit, focusing on two different things (one per paragraph). It’s not a five-paragraph essay in that we don’t expect students to write an introduction and conclusion, though sometimes they do. We encourage first-person voice, which is a natural choices for a personal reflection. An optional challenge for students is to include a third learning takeaway. We use a graphic organizer that looks like the following to help students plan.

TopicDelete this text and type your topic, the focus, theme, or thread you plan to discuss.
I used to thinkDelete this text and discuss the beliefs you previously held about the topic. Discuss 2-3 things you used to think about Native people prior to this unit.
Now I think 1Delete this text and discuss one aspect of your thread or focus that you have learned more about. Think about what has changed. How have stereotypes been altered or eliminated? How did that happen?

Identify two pieces of evidence for your learning in the text of There There or other resources.
Now I think 2Delete this text and discuss one aspect of your thread or focus that you have learned more about. Think about what has changed. How have stereotypes been altered or eliminated? How did that happen?

Identify two pieces of evidence for your learning in the text of There There or other resources.

We use the rubric below to assess the writing. It’s a variation on a rubric I have used for years, originally developed and published on Greece, NY’s Schools’ ELA resources site (which is, sadly, no longer accessible).

Native Voices RubricDownload

I hope the resources shared will help you in teaching Tommy Orange’s brilliant novel There There. If you have additional ideas, please feel free to share them in the comments.

Assessment

I’m Writing a Book

Photo by Nick Morrison on Unsplash

I made an announcement on Twitter the other day that I believe I have figured out how to translate the work I did on grading and assessment for my dissertation into a book. I will definitely be doing more research because I want this book to be practical. I want it to be the book I wish I’d had when I started teaching and knew nothing about grading and assessment aside from my own experiences of it. I perpetuated a lot of the bad grading and assessment practices I experienced as a student until I knew better. I know I still have room to learn and grow, but I’m really excited to start this journey, and I hope it helps teachers.

My approach will not be how to eliminate grading. We already know grading is problematic. It’s an extrinsic motivator at best, and it’s soul-crushing at worst. I also think a lot of teachers do not have the option to just eliminate grades. While many schools have established better systems for evaluating student work, most teachers have to work within the system. I am hoping my book will offer advice for how to do that.

I’m still taking notes at this stage, and if you have any thoughts about topics you’d like to see addressed in the book, feel free to chime in with a comment.

Let’s get started.

Assessment, Reflection

What to Assess? Ask.

Photo by Brett Jordan on Unsplash

I had a great discussion with my students today. A couple of them asked me why I don’t grade participation in Socratic seminars. I used to. I stopped because I find that grading participation is slippery. If you quantify it, you run the risk of encouraging shallow participation for points. In their reflections, students share what they have learned as a result of the seminar. I think part of the concern the students shared is that their reflection must include a summary of ideas discussed in the seminar, and the students who raised the concern did not earn full points for their summaries. They argued that if they are trying to capture the discussion in their notes, they will not be as present in the discussion.

What I told the students is that grading is a means of communicating their learning, and if they would prefer to be assessed on participation because it helps them learn, then I will do what helps them learn. I asked that we have a discussion about it as a class. We had that discussion this morning, and I was really impressed with how the students were able to articulate what works for them in assessing seminars and why. They have a strong sense of what kind of assessment feels equitable and what does not. They were able to articulate why setting goals and assessing progress toward the goals was helpful, and why grading participation didn’t work for most of them.

I pointed out that the skills of note-taking and listening are important for success. Students need to listen to their teachers and peers—now and later in college—and be able to take notes on what they hear, so my rationale for assessing these skills is that they are skills that are important to practice. Yet, I understand their arguments as well. We cannot have a good seminar if students do not participate. On the other hand, their classmates insisted that participation was not a problem in our first seminar. At one point, they asked me to display our discussion map from last time (thanks, Equity Maps!). Did we actually have a problem that needed solving, or was our discussion working without grading participation?

The class consensus was to leave the assessment as is, particularly as they have only experienced one seminar so far and judgment based on one experience would not tell the whole story. I don’t think everyone was happy, and frankly, the discussion did become a bit heated. I don’t think that made the students feel comfortable. I asked them if they felt heard—not agreed with, because that’s not the same thing—but heard. I think the net result is that students appreciated the opportunity to share their ideas. I was super impressed with them, and I shared that feedback with them.

We have our second seminar tomorrow, and it will be interesting to see how this debate informs the discussion. In the end, the compromise/consensus seemed to be that students want to be assessed on making progress on their goals. Part of their reflection is to identify their goals for the next seminar. This means I need to go back into their last reflections and refresh my memory about what their individual goals are and ensure I give them feedback on their progress toward meeting their goals. They also asked for feedback on their contributions, though they recognized that one person’s idea of an insightful comment may differ from another’s.

The bottom line is that it’s important to engage students in the assessment of their learning. Some of the best discussions I have had with my students have centered on grading and assessment. They have a lot to say about assessment, but they are not always a part of the conversation about how they’ll be assessed. It was a good exercise for my students today to hear others’ perspectives on this topic and take those perspectives into consideration.

Assessment, Issues

5 Myths About Grading

6 Comments
Photo by CDC on Unsplash

In June I successfully defended my dissertation at Northeastern University. My research focused on grading and assessment, which will likely not surprise anyone who has been reading this blog for a while, as I have written about grading and assessment frequently.

My dissertation was qualitative action research, a dissertation in practice grounded in the Carnegie Project on the Education Doctorate. Grading and assessment are ripe for qualitative action research because we have over a century of quantitative research in grading and assessment, and not as much positive change, at least with grading, as we might like to see. I might argue we are seeing more authentic assessment in schools, but grading remains, well, stuck. One of the reasons I think we’re stuck is that we believe persistent myths about grading.

Grades Communicate Students’ Proficiency

One of the most persistent myths about grading is that we agree on what grades mean. As long ago as 1888, researchers were raising questions about inter-rater reliability (Edgeworth, 1888). Study after study indicates that grades are highly inconsistent measures of students’ learning. Starch & Elliott (1912) conducted a study that examined consistency among graders and found that scores on student writing varied by 30-40 points out of 100, or a probable error of 4.5. You might be thinking, “yes, but isn’t writing a little subjective anyway? I’m sure that doesn’t happen in, say, math.” Well, the following year, Starch & Elliott (1913) found that scores on a geometry exam varied even more widely—as much as a probable error of 7.5. They ascribed the difference to several factors: the possibility that graders differently evaluate the students’ methods for reaching the solution, that they assess quality of the students’ drawings, and that they assign different values to problems.

Naturally, things have changed in a hundred years. What do more recent studies say? Brimi (2011) sought to answer that very question. Brimi (2011) engaged 73 participants working for the same school district trained to use the 6+1 Traits of Writing Rubric developed by Education Northwest to score the same argumentative essay using the rubric. The participants’ grades ranged from an A to an F on the traditional grading scale; furthermore, the range of scores assigned to the essay spanned 46 points (Brimi, 2011).

Grading is inconsistent for many reasons, but one of the chief reasons is that teachers evaluate different things when they grade. Some teachers offer extra credit or give students points for bringing supplies (Townsley & Varga, 2018). Teachers can be highly individualistic in selecting criteria for students’ performance (Bloxham et al., 2016). Other factors also impact how teachers evaluate students’ performance. For example, Brackett, et al. (2013) found that a teacher’s mood while grading can impact students’ scores—teachers in a bad mood tend to rate students’ performance lower. This holds true even when grading more objective criteria such as correct spelling (Brackett, et al. 2013). Think what this means as we are teaching in the midst of a pandemic and during a time when it feels as though teachers are being attacked from all sides.

One of the reasons traditional letter or number grades emerged is due to perceived inconsistency, inefficiency, and complication involved in narrative grade reports (Feldman, 2019). It was thought that letter grades could communicate learning both efficiently and plainly (Schneider & Hutt, 2014). By the 1940s, the A-F letter grade system had become the most popular grading system (Schneider & Hutt, 2014).

Traditional grades tend to be derived by averaging the performance on all assessments during a grading period; this average may not capture students’ eventual proficiency in learning and can place undue emphasis on performance anomalies rather than tendencies (Feldman, 2019). In addition, traditional grading sometimes incorporates assessment of student behaviors, such as participation, engagement, and effort (Feldman, 2019).

We might think that grades communicate students’ proficiency in learning, but there are simply too many variables to say this definitively.

Grades Motivate Students

One fear many educators express is that if students are not graded, they will not be motivated to do the work. At best, grades serve as extrinsic motivation for learning. When students care more about the grades than the learning, they are more likely to resort to academic dishonesty. In fact, pressure to earn high grades contributes to academic dishonesty and mental health problems (Rinn et al., 2014; Villeneuve et al., 2019). Grades affect students’ achievement, self-concept, and motivation (Casillas et al., 2012; Pulfrey et al., 2011). Students who earn low grades tend to achieve less and feel lower self-esteem over time (Klapp, 2018).

Fear of earning low grades or focus on earning high grades both serve as extrinsic motivators for learning rather than intrinsic motivators, which demonstrate more effectiveness in supporting learning (Froiland & Worrell, 2016; Hattie & Timperley, 2007). Intrinsic motivation is positively associated with both engagement and achievement (Froiland & Worrell, 2016; Hattie & Timperley, 2007). Helping students develop their intrinsic motivation to learn may increase students’ achievement (Froiland & Worrell, 2016). Extrinsic motivation to earn good grades or avoid the negative consequences of poor grades drives many students rather than the desire to learn, and over time, extrinsic motivation decreases students’ achievement (Hattie & Timperley, 2007). In addition, the reward of good grades tends to decrease motivation for otherwise engaging learning (Hattie & Timperley, 2007).

It’s worth noting that motivation appears to change depending on the grading system used. When students are graded using a 100-point system in which the sum of all student work is worth a total of 100 points, students tend to view each point deducted as a loss (Smith & Smith, 2009). Bies-Hernandez (2012) describes such grading systems as “loss-framed grading” (p. 179). However, when students are graded using a total points system tallying all points earned, they tend to view grades as opportunities to improve and build toward a desired grade (Smith & Smith, 2009). Students who are graded with a system weighting assignment categories by percentage fell in between students in the other grading groups (Smith & Smith, 2009). Even if controls ensure that the resulting grade is the same regardless of the calculation system, students’ responses on a Likert scale questionnaire indicate they still perceive greater risk in 100-point systems and were less motivated and self-assured (Smith & Smith, 2009). Bies- Hernandez (2012) replicated these findings and further found that students’ performances in courses with a loss-framed grading system also decreased. Thus, the framing of the grading system not only has an impact on students’ perceptions of their performance but also on their actual performance (Bies- Hernandez, 2012). The implication is that teachers’ approaches to grading may affect students’ academic achievement (Brookhart et al., 2016).

However, proficiency-based grading (sometimes known as competency-based grading, standards-based grading, or mastery-based grading) has the potential to make grades more meaningful and purposeful (Buckmiller et al., 2017; Guskey, 2007). Proficiency-based grading practices may also lead to greater academic achievement, particularly if the grades are paired with formative feedback (Hattie & Timperley, 2007). Proficiency-based grading practices may also foster more cooperation and less competition (Burleigh & Meegan, 2018). Taking academic risks, weighing differing conclusions, and considering varied points of view are all necessary for developing critical thinking skills, but if students must risk failing grades in order to do so, they are much more likely to take the safer route to earning a higher grade (Hayek et al., 2014; McMorran et al., 2017). Knowing that they could continue to learn, revise, and reflect on their work may increase students’ motivation to learn (Hattie & Timperley, 2007; McMorran et al., 2017).

100-point Grading Scales are More Precise than A-F or 4-Point Grading Scales

Do you know why we use the 100-point scale? It’s not because it’s more precise. It’s because it’s the scale in the gradebook software (Guskey, 2013; Guskey & Jung, 2016). The 100-point scale is terrible, and that’s a hill I’m willing to die on. The 100-point grading scale has become one of the most common scales for reporting students’ grades, but it is one of the most unreliable scales in use (Guskey, 2013).

The 100-point scale is inaccurate and inequitable because the scale is skewed toward failing grades (Feldman, 2019). Passing grades comprise only 40 points of the grading scale, spanning typically from 60 points to 100 points (or from 70-100 points in some systems!), while failing grades comprise the remaining points possible spanning from 0 to 59 (or even 0-69). Serious mathematical errors arise when teachers input zeros in the gradebook when students are missing work (Feldman, 2019). While this practice ostensibly holds students accountable for handing in work, it can make it impossible for students to recover academically (Feldman, 2019). The literature suggests that teachers may compensate for the 100-point scale’s mathematical errors by artificially raising grades in a number of ways (Schneider & Hutt, 2014), including grading formative assessments and executive function skills (Bowers, 2011; Brookhart et al., 2016; Townsley & Varga, 2018).

Unfortunately, a lot of educators perceive the 100-point grading scale to be more accurate (Brookhart & Guskey, 2019; Feldman, 2019). While using 100 points as opposed to four or five points may seem more accurate, it results in a probable error of five or six points; teachers find it difficult to distinguish levels of performance on a 100-point scale (Brookhart & Guskey, 2019). Some grading reformers advocate for the use of minimum grading, or inputting a minimum grade such as 50 percent, rather than inputting zeros for missing work; this practice reduces mathematical error (Carifio & Carey, 2013; Carifio & Carey, 2015; Feldman, 2019). Essentially what educators are doing when they use minimum grading, however, is compensating for the deficiencies of the 100-point scale by converting it to a rough approximation of the 4-point scale. In a four-point scale, failing grades span from 0-0.99 of a point, while passing grades span from 1-4 points (or 2-4 points in a system without a “D”).

Grades Reduce Bias

Variable and unreliable grading practices also introduce equity problems. Black students have less access to AP courses all over the United States (Francis & Darity, 2021). Schools that use gatekeeping methods (Francis & Darity, 2021), such as teacher recommendations and prerequisite grades, may be basing their decisions about students’ fitness for advanced coursework on subjective measures common in traditional grading (Feldman, 2019). Students of color are most impacted by teachers’ implicit bias (Feldman, 2019), especially if subjective, non-academic factors are included in assessment (Cvencek et al., 2018). Implicit bias may especially play a role in lower grades assigned to students of color when the criteria for proficiency are unclear or undefined (Quinn, 2020). Traditional grading’s subjectivity can harm all students, but students of color may be most impacted due to implicit bias (Feldman, 2019; Quinn, 2020).

However, proficiency-based grading can make grades more equitable and more reflective of students’ actual learning (Buckmiller et al., 2017). Proficiency-based grading may include using practices such as rubrics for evaluating student work and student-generated portfolios; however, it may also include traditional assessments such as tests (Baete & Hochbein, 2014; Buckmiller et al., 2017; Iamarino, 2014; Miller, 2013). Students’ grades are tied to their mastery of content, such as standards, knowledge, and skills, as opposed to an average of all the grades earned during a grading period or course (Iamarino, 2014; Miller, 2013). Teachers using proficiency-based grading typically provide students with feedback on formative assessments (Buckmiller et al., 2017). Students may revise and resubmit work in order to demonstrate their proficiency in learning (Buckmiller et al., 2017). Through revision, students demonstrate their learning of the content and skills. As a result, proficiency-based grades may more accurately reflect what students have learned rather than a snapshot of their performance on a single assessment.

We Have to Use Grades

Grades have actually not existed, at least not in the form we’re familiar with, for a very long period of time (Schneider & Hutt, 2014). One of the worst reasons to perpetuate any system is the notion that we’ve always done it that way, especially when it’s not even true that we have always done it this way. The A-F grading system gained popularity as late as the 1940s—as I mentioned before—as educators saw a need to establish more uniform methods for determining students’ proficiency (Schneider & Hutt, 2014). For many years preceding the establishment of “traditional grading,” we used all sorts of other systems (good and bad) for measuring learning. This system is entrenched, but it’s not as old as people might think, and if we decided, collectively, that it no longer worked for us, we could find a better system. The problem is, well, that it’s a system, and systems are notoriously hard to change.

I have heard many educators express anxiety that students will either not be prepared for college or will not get into college unless they are graded. Many schools, however, have successfully eliminated traditional grades. Colleges understand the transcripts these students send them, and these students are able to go to college. For example, the Watershed School, a member of the Mastery Transcript Consortium, does not issue traditional letter grades or test students through final exams and has a 100% college acceptance rate (Plaskov, 2019). A college counselor I worked with told me anecdotally that “colleges are fine with grading that’s ‘non-traditional.’ Parents usually get very concerned about going off the A-F standard, but college admissions folks are experts on grading scales, and what I’ve consistently heard from them is that the most-accurate/least-translated reporting is what they like.”

My own personal experience is that some schools’ grading practices are more entrenched, and while another system of evaluation would work, it wouldn’t be politically feasible. Proficiency-based grading shows additional promise here. Attaching grades to standards or competencies can make grades more accurate reflections of students’ proficiency in learning. Proficiency-based report cards have the potential to be more useful in understanding students’ learning than traditional report cards including only a letter grade (Blauth & Hajdian, 2016; Swan et al., 2014). Swan et al. (2014) found that parents and teachers generally find proficiency-based reports more helpful and easier to understand, in addition to having more and better information about students’ progress.

It’s worth noting that one study I examined indicated parents reported feeling less confidence in the standards-based grade reports because they were unfamiliar and felt the school had not taken their feelings as stakeholders into account before implementing standards-based grade reports (Franklin et al., 2016). These parents also reported finding the grade reports unclear (Franklin et al., 2016). Importantly, Franklin et al. (2016) indicate the parents in their study were all dissatisfied with standards-based report cards; these parents also described themselves as strong students who enjoyed school. Their study did not include parents who expressed satisfaction with the reports. (Franklin et al., 2016).

The Bottom Line?

I think it’s important for teachers to open dialogue with students and parents, read the research on grading and assessment, and work within the system they’re in to make grades more accurate and meaningful. I highly recommend the works referenced in this post, which is derived largely from my dissertation. For a good deep dive, Joe Feldman’s book Grading for Equity is excellent.

References

Baete, G. S. & Hochbein, C. (2014). Project proficiency: Assessing the independent effects of high school reform in an urban district. The Journal of Educational Research, 107(6), 493-511. https://doi.org/10.1080/00220671.2013.823371

Bies-Hernandez, N. J. (2012). The effects of framing grades on student learning and preferences. Teaching of Psychology, 39(3), 176-180. https://doi.org/10.1177/0098628312450429

Blauth, E. & Hadjian, S. (2016). How selective colleges and universities evaluate proficiency-based high school transcripts: Insights for students and schools. New England Board of Higher Education. https://www.nebhe.org/info/pdf/policy/Policy_Spotlight_How_Colleges_Evaluate_PB_HS_Trans cripts_April_2016.pdf

Bloxham, S., den-Outer, B., Hudson, J., & Price, M. (2016). Let’s stop the pretence of consistent marking: Exploring the multiple limitations of assessment criteria. Assessment & Evaluation in Higher Education, 41(3), 466-481. https://doi.org/10.1080/020602938.2015.1024607

Bowers, A. J. (2011). What’s in a grade? The multidimensional nature of what teacher-assigned grades assess in high school. Educational Research and Evaluation, 17(3), 151-159. https://doi.org/10.1080/13803611.2011.597112

Brackett, M. A., Floman, J. L., Ashton-James, C., Cherkasskiy, L., & Salovey, P. (2013). The influence of teacher emotion on grading practices: A preliminary look at the evaluation of student writing. Teachers and Teaching, 19(6), 634-646. https://doi.org/10.1080/13540602.2013.827453

Brimi, H. M. (2011). Reliability of grading high school work in English. Practical Assessment, Research & Evaluation, 16(7). http://pareonline.net/getvnasp?=16&n=17

Brookhart, S. M., & Guskey, T. R. (2019). Reliability in grading and grading scales. In T. R. Guskey & S. M. Brookhart (Eds.), What we know about grading: What works, what doesn’t, and what’s next (pp. 13-31). ASCD.

Brookhart, S., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., Stevens, M. T., Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803-848. https://doi.org/10.3102/0034654316672069

Buckmiller, T., Peters, R., & Kruse, J. (2017). Questioning points and percentages: Standards-based grading (SBG) in higher education. College Teaching, 65(4), 151-157. https://doi.org/10.1080.87567555.2017.1302919

Burleigh, T. J. & Meegan, D. V. (2018). Risky prospects and risk aversion tendencies: does competition in the classroom depend on grading practices and knowledge of peer-status? Social Psychology of Education, 21(2), 323-335. https://doi.org/ 10.1007/s11218-017-9414-x

Carifio, J. & Carey, T. (2013). The arguments and data in favor of minimum grading. Mid-Western Educational Researcher, 25(4), 19-30.

Carifio, J. & Carey, T. (2015). Further findings on the positive effects of minimum grading. Journal of Education and Social Policy, 2(4), 130-136.

Casillas, A., Robbins, S., Allen, J., Kuo, Y. L., Hanson, M. A., & Shmeiser, C. (2012). Predicting early academy failure in high school from prior academic achievement, psychosocial characteristics, and behavior. Journal of Educational Psychology, 104(2), 407-420. https://doi.org/10.1037/a0027180

Cvencek, D., Fryberg, S. A., Covarrubias, R., & Meltzoff, A. N. (2018). Self-concepts, self-esteem, and academic achievement of minority and majority North American elementary school children. Child Development, 89(4), 1099-1109. https://doi.org/10.1111/cdev.12802

Edgeworth, F. Y. (1888). The statistics of examinations. Journal of the Royal Statistical Society, 51(3), 599-635.

Feldman, J. (2019). Grading for equity: What it is, why it matters, and how it can transform schools and classrooms. Corwin.

Francis, D. V. & Darity, W. A., Jr. (2021). Separate and unequal under one roof: The legacy of racialized tracking perpetuates within-school segregation. RSF: The Russell Sage Foundation Journal of the Social Sciences, 7(1), 187-202. https://doi.org/10.7758/RSF.2021.7.1.11

Franklin, A., Buckmiller, T., & Kruse, J. (2016). Vocal and vehement: Understanding parents’ aversion to standards-based grading. International Journal of Social Science Studies, 4(11), 19-29.

Froiland, J. M. & Worrell, F. C. (2016). Intrinsic motivation, learning goals, engagement, and achievement in a diverse high school. Psychology in the Schools, 53(3), 321-336. https://doi.org/10.1002/pits.21901

Guskey, T. R. (2007). Multiple sources of evidence: An analysis of stakeholders’ perceptions of various indicators of student learning. Educational Measurement: Issues and Practice, 26(1), 19-27.
https://doi.org/10.1111/j.1745-3992.2007.00085.x

Guskey, T. R. (2013). The case against percentage grades. Educational Leadership, 71(1), 68-72.

Guskey, T. R. & Jung, L. A. (2016): Grading: Why you should trust your judgment. Educational Leadership,
73(7), 50-54.

Hattie, J. & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/003465430298487

Hayek, A., Toma, C., Oberlé, D., & Butera, F. (2014). The effect of grades on the preference effect: Grading reduces consideration of disconfirming evidence. Basic and Applied Social Psychology, 36(6), 544-552. https://doi.org/10.1080/01973533.2014.969840

Iamarino, D. L. (2014). The benefits of standards-based grading: A critical evaluation of modern grading practices. Current Issues in Education, 17(2), 1-11.

Klapp, A., (2018). Does academic and social self-concept and motivation explain the effect of grading on students’ achievement? European Journal of Psychology of Education, 33(2), 355-376. https://doi.org/10.1007/s10212-017-0331-3

McMorran, C., Ragupathi, K., & Luo, S. (2017). Assessment and learning without grades? Motivations and concerns with implementing gradeless learning in higher education. Assessment & Evaluation in Higher Education, 42(3), 361-377. https://doi.org/10.1080/02602938.2015.1114584

Miller, J. J. (2013). A better grading system: Standards-based, student-centered assessment. English Journal, 103(1), 111-118.

Plaskov, J. C. (2019, October 23). Reimagining college admissions season. The Mastery Transcript Consortium. https://mastery.org/reimagining-college-admissions-season/

Pulfrey, C., Buchs, C., & Butera, F. (2011). Why grades engender performance-avoidance goals: The mediating role of autonomous motivation. Journal of Educational Psychology, 103(3), 683-700. https://doi.org/10.1037/a0023911

Quinn, D. M. (2020). Experimental evidence on teachers’ racial bias in student evaluation: The role of grading scales. Educational Evaluation and Policy Analysis, 42(3), 375-392. https://doi.org/10.3102/0162373720932188

Rinn, A. N., Boazman, J., Jackson, A., Barrio, B. (2014). Locus of control, academic self-concept, and academic dishonesty among high ability college students. Journal of the Scholarship of Teaching and Learning. 14(4), 88-114. https://doi.org/10.14434/josotl.v14i4.12770

Schneider, J. & Hutt, E. (2014). Making the grade: A history of the A-F marking scheme. Journal of Curriculum Studies, 46(2), 201-224. https://doi.org/10.1080/00220272.2013.790480

Smith, J. K. & Smith, L. F. (2009). The impact of framing effect on student preferences for university grading systems. Studies in Educational Evaluation, 35, 160-167.

Starch, D. & Elliott, E. C. (1912). Reliability of the grading of high-school work in English. The School Review, 20(7), 442-457.

Starch, D. & Elliott, E. C. (1913). Reliability of grading work in mathematics. The School Review, 21(4), 254-259.

Swan, G., Guskey, T., & Jung, L. (2014). Parents’ and teachers’ perceptions of standards-based and traditional report cards. Educational Assessment, Evaluation, and Accountability, 26(3), 289-299. https://doi.org/10.1007/s11092-01409191-4

Townsley, M. & Varga, M. (2018). Getting high school students ready for college: A quantitative study of standards-based grading practices. Journal of Research in Education, 28(1), 92-112.

Villeneuve, J. C., Conner, J. O., Selby, S., & Pope, D. C. (2019). Easing the stress at pressure-cooker schools. Phi Delta Kappan, 101(3), 15–19. https://doi.org/10.1177/ 0031721719885910

Assessment, Teaching Writing

Rumination Essays

6 Comments

A few years ago, I had the great fortune to be able to attend Kenyon College’s Writing Workshop for Teachers. My instructor was Dr. Emily Moore, who teaches at Stuyvesant High School in New York. She shared a writing assignment with us that Stuyvesant English teachers use. It’s a form of writing that marries the literary analysis with the personal narrative, and she referred to it as a “Rumination Essay.”

Photo by Windows on Unsplash

The instructions are as follows (very much adapted from those shared by Dr. Emily Moore):

  1. Choose a single quotation from the text—about 1-3 consecutive lines [note: this is negotiable, but the point is to choose a short passage rather than a really long passage]. You might choose a passage that captured your attention, moved you, or felt connected to an experience or emotion in your own life. You might reflect on a key message or theme, conflict, or character from the play as a starting point, and look for a quote based on that.
  2. Begin your rumination by discussing the context of the quote clearly, but avoid unnecessary plot summary. Instead, simply give the reader enough information so the quote will make sense. What situation has led up to the quote? Who is speaking?
  3. Introduce the quote smoothly with a strong transition, so that it is incorporated into your own writing. Make sure you format the quote correctly and cite it properly. Don’t forget a Works Cited page.
  4. Analyze the quote. What is its significance in the play up until this point? How does it help us understand a message or theme emerging in the play? What does it suggest about the character’s experience, or the conflicts and characters that drive this story?
  5. Next, transition into personal writing. In this section, you will write in the first person about an experience of your own that relates to the quote you’ve chosen. The experience doesn’t have to be exactly the same—these characters have their lives; you’ve had yours—but there should be a connection. Your personal experience will reflect something about the quote you’ve chosen, and it will echo an idea that stayed with you from your reading.

Note: In this section, you’ll write in the first person. Work like a storyteller, and think about the techniques storytellers use. In particular, you’ll want to do more than just tell us what happened.Use details (concrete imagery, dialogue, character, etc.) to show us something about your experience, and reflect on it as well.

  1. Now that you’ve considered how the message or themes suggested by your chosen quote connect to your own life, reconnect to the literary work in your last paragraph. How does the experience you had help you understand the work? Your understanding of the quote and key message or theme you’re discussing will be deeper now, because you’ve enriched it with a story from your own experience. Use that to conclude your rumination.

This assignment can be used with a variety of texts. I have previously used it with teaching King Lear and A Midsummer Night’s Dream, but I have also allowed students to select a work of their choosing.

Students generally enjoy this assignment and find it engaging because it asks them to make a direct connection to a work of literature. However, they also find it challenging to use first person, mainly because somewhere along the line, someone told them never to do that. The structure is a bit different from what they’re accustomed to.

I usually save the exemplars from each year and share them with students so they can get the idea. I am embedding an example of the instructions I share with students. You can use the instructions and modify them for your own texts and needs.

King Lear Rumination InstructionsDownload
Assessment, Teaching Literature

One-Pagers

2 Comments

I shared some student work on Twitter, and it seemed as though some folks were interested in learning more about the concept. First of all, I didn’t come up with this concept at all. I’d seen one-pagers floating around for a while. Some time back, I tweeted asking for help with instructions, and Dianna Minor and Glenda Funk graciously shared their instructions with me. I also found Betsy Potash’s instructions via Cult of Pedagogy and these instructions at Ms. D’s English Fury helpful. I adapted my instructions from these sources. All credit goes to the fine educators who generously shared their ideas and their students’ work. I am indebted to them, and I’m sharing what I did only as a means of paying it forward in case it helps other people. 

You can use one-pagers to assess lots of things. I am an English teacher, but I imagine they could be used in just about any subject and at pretty much every grade level, with some adaptations.

What is a one-pager?

A one-pager is a kind of project in which you share your most important takeaways from a text on a single page using text and artwork. You take what you have learned from a text and put the highlights on the page accompanied by art that represents, sometimes symbolically, these highlights and themes.

Why create a one-pager?

One-pagers allow you to mix media, text, and images, which helps you remember details better. It’s brain science. According to Allan Paivio’s dual coding theory, the brain has two ways of processing: the visual and the verbal. The combination of the two leads to the most powerful results. You will remember more when you’ve mixed language and imagery. One-pagers also offer variety—another way to share your interpretation and analysis of a text. You might be surprised what you will come up with! Plus, they’re fun. [All credit to this rationale goes to Betsy Potash.]

But I am not good at art/don’t like art…

I will share some templates with you that may help, but the important thing to remember here is that you ARE good at art. You might want to draft your one-pager in light pencil before coloring it in, but you will create something pretty amazing. I feel it in my bones. Also, do not use clip art or computer art. Trust me. One-pagers look so much better when they’re your own art.

Okay, so what are the parameters?

  • A single piece of letter-size paper (or A4 if you can’t get letter where you currently are located). You may use colored paper if you have access to it and want to, but it is NOT required.
  • Work only on one side of the page in portrait or landscape mode. 
  • Include color and patterns*. Think symbolically here. Texture is fine, too.
  • Fill the entire page with your work. If you have blank space, repeat an element or fill it with one of the optional elements (see below).
  • Put your first and last name on the back.
  • Try to be neat with lettering. It helps to draft first. Definitely make sure handwriting is legible.

*I had markers and colored pencils to lend students who needed them.

What kinds of elements should I include?

The following elements are REQUIRED:

  • The title and author of the book.
  • Illustrations or symbols that represent the reading. This could be a character, a scene from the text, symbols that convey ideas expressed in the work.
  • Choose two or three notable quotes that stand out to you from the text. It could be quotes that make you think or wonder or remind you of something important from the text.  Write the quotes on your paper using different colors and/or writing styles. Include the page number and a short analysis of the quote.
  • Make a personal connection to what you read. What did it mean to you personally? (Examples: “I feel…I think…I know…I wonder…”).

The following elements are options, but pick at least 2:

  • Create a border that reflects a theme. This can include words, pictures, symbols, or even quotes.
  • Draw a word cluster around your image. Use these words you highlight the importance of your chosen image. The word cluster may also artistically symbolize the subject matter.
  • Write a poem about the book, a character, or the theme. If this is particularly challenging, you may choose to compose an acrostic poem using a one-word theme.
  • Create a hashtag that relates to the text.
  • Explain how the setting shapes a character in the text.
 

Rubric

Skill

Exemplary

Proficient

Developing

Emerging

The extent to which the one-pager demonstrates textual analysis.

Art and text demonstrate textual analysis that offers insightful interpretations and understanding of the text with analysis that goes well beyond a literal level.

Art and text demonstrate textual analysis that offers clear and explicit interpretations and understanding of the text with analysis that goes beyond a literal level.

Art and text demonstrate textual analysis that offers partially explained and/or somewhat literal interpretations and understanding of the text with some analysis.

Art and text demonstrate textual analysis that offers few or superficial interpretations and understanding of the text with little analysis.

 

The extent to which the one-pager follows the “rules.”

All the “rules” are followed: the work is on a single side of letter or A4 paper, the page is filled, color is used, first and last name are on the back, and the lettering is neat and legible.

Most of the “rules” are followed: one or two minor omissions (see exemplary column).

Some of the “rules” are followed. There are two or more omissions (see exemplary column).

Few or none of the rules are followed. There are more than three omissions (see exemplary column).

The extent to which all required elements are included.

All required elements are included and addressed in a thoughtful way that demonstrates symbolic thinking, analysis and/or synthesis of ideas, and thoughtful interpretation of the text. Two or more optional elements add depth to the piece.

All of the required elements are included. Elements demonstrate symbolic thinking, analysis and/or synthesis of ideas, and interpretation of the text. Two optional elements add depth to the piece.

Most of the required elements are included. Elements demonstrate developing symbolic thinking, analysis and/or synthesis of ideas, and interpretation of the text. Two optional elements are included.

Some of the required elements are included. Elements demonstrate emerging symbolic thinking, analysis and/or synthesis of ideas, and interpretation of the text. Optional elements may be missing or incomplete.

Assessment, Issues, Reflection

Grading for Equity: A Brief History of Grading

Steamer Glass [i.e. class]” in Hancock School, Boston. Immigrant children.
Abstract: Photographs from the records of the National Child Labor Committee (U.S.)
I have a copy of my great-great-grandmother Stella Bowling Cunningham’s diary from 1893-1894, which I transcribed. It’s a fascinating window into history for many reasons, one of which is that while Stella was writing the diary, she was a teacher. She married in May 1894, after which she had to quit teaching and keep house.

Her primary concerns as a teacher seem to center around keeping order in her classroom. She remarks very little on what she actually taught her students, but she mentions whether or not class was unruly a few times. I also have a copy of a letter she wrote my great-uncle Alvin, who must have been assigned to write to grandparents and ask what school was like when they were little. Stella’s letter is wonderful (I reproduced it on this blog about 14 years ago).

I think I have always found the history of education, particularly schools, fascinating. I really enjoyed reading Joe Feldman’s chapter on the history of grading in  Grading for Equity. Much of it was material I already knew, as one of his sources, Schneider & Hutt’s (2014) article “Making the Grade: A History of the A-F Marking Scheme” was one my own sources as well. If you can get your hands on this article, I highly recommend you read it (the full citation, including DOI, is at the end of this post). I learned some really interesting things from it, particularly the fact that the A-F grading system is not really that old. It quickly became entrenched in schools, and it seems nearly impossible now to imagine schools with A-F grades, but they actually didn’t become entrenched until about the 1940s. My grandparents were still in school in the 1940s, though my grandfather would have graduated in the very early 1940s. The history of letter grades as a method for communicating learning isn’t that old.

First, yesterday I promised to continue reflecting on Feldman’s “Questions to Consider” for chapter 1 today; however, on reading them more closely, I’m not sure you care over much why I am reading this book or who I’m reading it with, so I’ll skip those, except to say that  I’ll reconsider anything I’m doing if it means my grading practices will be more equitable. Chapter 2 dives into the history of schools and grades a bit more.

How do schools in the first half of the twenty-first century—their design, their purpose, their student—compare with schools in the first half of the twentieth century?

I have actually sat in desks that were bolted to the floor. Have you? I find that the design of classrooms, at least in schools where I have taught, is much more fluid. Desks are mobile, sometimes even on wheels. Students sit in a large circle or square in my classrooms. My classroom looks different from the classrooms I sat in and from the images of vintage classrooms (like the one at the beginning of this post). We also have projectors and computers. My students learn from viewing images and watching videos in addition to reading. Most stakeholders would probably agree that my school’s purpose is to prepare students for college. I don’t think that was the goal of most schools in the early 20th century.

Did you know that Thomas Jefferson was one of the first people to propose schools as we might describe them today? In his Notes on the State of Virginia (which isn’t read enough and is why people don’t realize how complicated and problematic Jefferson’s ideas could sometimes be), he wrote (emphasis my own, spelling his):

This bill proposes to lay off every county into small districts of five or six miles square, called hundreds, and in each of them to establish a school for teaching reading, writing, and arithmetic. The tutor to be supported by the hundred, and every person in it entitled to send their children three years gratis, and as much longer as they please, paying for it. These schools to be under a visitor, who is annually to chuse the boy, of best genius in the school, of those whose parents are too poor to give them further education, and to send him forward to one of the grammar schools, of which twenty are proposed to be erected in different parts of the country, for teaching Greek, Latin, geography, and the higher branches of numerical arithmetic. Of the boys thus sent in any one year, trial is to be made at the grammar schools one or two years, and the best genius of the whole selected, and continued six years, and the residue dismissed. By this means twenty of the best geniusses will be raked from the rubbish annually, and be instructed, at the public expence, so far as the grammar schools go. At the end of six years instruction, one half are to be discontinued (from among whom the grammar schools will probably be supplied with future masters); and the other half, who are to be chosen for the superiority of their parts and disposition, are to be sent and continued three years in the study of such sciences as they shall chuse, at William and Mary college, the plan of which is proposed to be enlarged, as will be hereafter explained, and extended to all the useful sciences. The ultimate result of the whole scheme of education would be the teaching all the children of the state reading, writing and common arithmetic: turning out ten annually of superior genius, well taught in Greek, Latin, geography, and the higher branches of arithmetic: turning out ten others annually, of still superior parts, who, to those branches of learning, shall have added such of the sciences as their genius shall have led them to: the furnishing to the wealthier part of the people convenient schools, at which their children may be educated at their own expence.

Pardon the long quote, but I find it worth quoting at length because it several ideas come into focus if you read the whole thing:

  1. School was never envisioned to be equitable, not even the mind of the guy who wrote that “all men are created equal.” It was made to sort people, which is why tracking is still so common.
  2. The language Jefferson uses is telling: he describes students as “rubbish.” He didn’t include girls or BIPOC in the calculation at all. It’s a pretty classist idea even if you remove the sexism and racism. You know the boy children of poor farmers weren’t going to college.
  3. If you’re struggling to parse the language, the proposal is as follows:
    • Send one boy per “hundred” to a grammar school. The remaining students would end their schooling after three years in the “hundred” school.
    • Of those boys sent to grammar school, competition for continued education would be fierce: Jefferson suggests one or two years of grammar school to separate the wheat from the chaff, after which one of those grammar school students could continue his education for six more years.
    • Half of those boys lucky enough to continue their education past grammar school would then be able to go to college after that six years of education.

The competition among students was baked into American education early on. My great-great-grandmother Stella describes such competition when she describes spelling class: “We sat on long benches and a class would go up to the teacher to recite and sit on a long bench, only the spelling classes would stand in a row and “turn down”, when one missed a word.”

I would argue school has changed a great deal since the early 1900s but some aspects of school haven’t changed much. I have cited studies ranging from 1888-2019 in my research that document traditional letter grades’ issues with reliability, consistency, motivation, and self-concept. Grades seem to be the one aspect of school we are resistant to changing, in spite of a large body of evidence supporting change.

Once again, I’ve gone on too long and you’re probably not reading anymore. More tomorrow on how I see ideas and beliefs of the early 20th century at work in schools where I have taught.

Citations for further reading:

Feldman, J. (2019). Grading for equity: What it is, why it matters, and how it can transform schools and classrooms. Corwin.

Jefferson, T. (1787). Notes on the state of Virginia. Prichard and Hall. https://docsouth.unc.edu/southlit/jefferson/jefferson.html

Schneider, J. & Hutt, E. (2014). Making the grade: A history of the A-F marking scheme. Journal of Curriculum Studies, 46(2), 201-224. https://doi.org/10.1080/00220272.2013.790480

Assessment, Blogging, Reflection, Social Justice

Towards More Equitable Grading

grade photo
Photo by mikefisher821

I’m not sure how many folks know this, but I’m currently entering the dissertation phase in my doctoral program at Northeastern. in fact, I’m hoping to defend my dissertation proposal before the month’s end. One reason this blog has been quiet for so long (until recently) is that I just haven’t made time to write here. I was doing so much writing for graduate school, and coupled with my teaching responsibilities, it was hard to find the time. I should have made the time because documenting my thoughts as I participated in the 21-Day Racial Equity Challenge © (created by Dr. Eddie Moore) reminded me of the critical importance of regular reflection, here, for me as a teacher. I attribute most of my growth as a teacher since 2005, when I started this blog, to regular blogging here.

Back in the day, I sometimes reflected on professional reading on this blog, and sometimes, book clubs resulted. Blogging has fallen by the wayside in favor of Twitter, which makes me sad because sometimes the long-form reflection is better than a tweet thread. The UbD Educators wiki grew out of the reflection I did, and until Wikispaces went defunct, it was a promising project, though I confided to Grant Wiggins that it was hard to find teachers to commit to adding to the wiki. He wasn’t surprised because lack of time makes it difficult. I always say that we make time for the things that are important to us, and this blog is pretty important to me, but I hadn’t made a lot of time for it for some years. I’m going to try to change that, and one thing I want to do is document my thinking as I read Joe Feldman’s Grading for Equity. I joked to a couple of colleagues that I am finally making time to actually read this book, which has been on my radar for a long time, and I realize I should have made the time to read it as soon as it was released because Feldman is citing much of the same research as I am citing in my dissertation. I could have saved myself a lot of searching through the library database!

First of all, I encourage educators to take the quiz How Equitable is Your Grading? on Feldman’s website. If, in the wake of George Floyd’s murder, you are examining your curriculum’s diversity, equity, and inclusion, I think that’s great. I think it’s great if you are engaged in movements to #DisruptTexts and #TeachLivingPoets. You also need to take a hard look at your grading practices, too. If, as Feldman says, you are implementing some equitable practices, such as “responsive classrooms, alternative disciplinary measures, diverse curriculum—but meanwhile preserve inequitable grading,” you are perpetuating inequity in schools.

I’m going to start by using Feldman’s “Questions to Consider” at the end of chapter 1. I’ll just answer the first two and update tomorrow with responses to the remaining three questions. Otherwise, this post will be way too long. Maybe it already is!

What are some deep beliefs you have about teenagers? What motivates and demotivates them? Are they more concerned with learning or their grade?

After over 20 years of teaching mostly teenagers, I have concluded that a lot of adults expect them to be more “adult” because they tend to look more adult. What I mean is they expect teenagers have developed an internal locus of control. Not even all adults have an internal locus of control. Teenagers tend to still mostly have an external locus of control, which means they are more likely to attribute a poor grade to a teacher’s lack of regard for them instead of a lack of proficiency on their part. I think we need to remember that when we are grading. As such, they might be motivated to earn good grades (carrot) or avoid bad ones (stick), but grades in an of themselves don’t motivate them to learn. I think they do help give students some kind of yardstick they can use to judge their performance, but I didn’t think grades had even this utility until I started doing research. Grades might not communicate what we think or wish they would, but they communicate something. I think students are much more concerned with grades rather than learning when they are in classes in which all high-stakes assessments result in grades that cannot be improved through revision and in which all earned grades are averaged together. If, however, they are in a classroom that encourages revision and focuses on proficiency, they focus a lot more on learning. Teenagers actually love to learn things, but the trick is that teachers need to communicate the relevance, and the wrong answer is “I’m the adult, so I say it’s relevant.” And if what you are teaching isn’t relevant, you need to figure out how to Marie Kondo the curriculum.

What is your vision for grading? What do you wish grading could be for students, particularly the most vulnerable populations? What do you wish grading could be for you? In which ways do current grading practices meet those expectations, and in which ways do they not?

Before I started my research, I wanted to eliminate grades a measure of student learning. There is a movement to do just that, and many schools successfully use other methods for reporting learning, and yes, their students still get into college. I no longer think grades are entirely useless. I think we have just perpetuated inequitable grading for so long that I couldn’t figure out another way aside from burning the whole system down. Now I advocate for proficiency-based grading, and that means that students might revise their work, sometimes several times, in order to reach a level of proficiency in learning content and skills. In almost any aspect of life, we have chances to practice a skill until we master it, and no one says it is unfair. There was a time when every musician we know didn’t know how to play their instrument, when every athlete didn’t know how to play their sport. But we don’t judge their current competence by where they started. I think grading based on reaching proficiency, whenever it happens or however it happens, is much more equitable.

My dissertation is a dissertation in practice, meaning I need to take an action step and evaluate its success. My action step is to create a proficiency-based grading and authentic assessment guide for a pilot group of faculty, to implement the practices therein (along with a focus group), to evaluate the guide’s success and revise it accordingly, and to present the findings to my colleagues. Feldman’s ideas will be invaluable in framing the guide, grounded also in my own research. I am hoping implementing this action step will make grading less of a chore for me, too—I related so much to Feldman’s argument that teachers don’t like grading (p. 5).

What I need to do is figure out a system that is more mathematically sound and use it. I am doing fairly well on most equitable grading practices according to Feldman’s quiz, with the exception of that one. For example, I already:

  • Don’t weigh homework much. Homework is preparation for class, such as reading and writing. I don’t even really use the homework category in my online grade book for graded work.
  • Don’t calculate behavior and executive function skills in my grade.
  • Allow students to revise their work and replace the grade entirely with the new grade.
  • Don’t subscribe to the idea that grades need to fall on a bell curve or that I need a certain distribution of grades.
  • Don’t count participation as a grade category. It is part of the rubric in a Socratic seminar.

I do not have students asking me to create homework assignments, and they mostly do the preparation I ask them to do. Students sometimes turn work in late for me, but it doesn’t bother me. Other than that, I don’t feel I miss anything by excluding executive function skills. Students actually work harder knowing the grade can entirely be replaced if the work improves. I don’t subscribe to fears about grade inflation or worries that students have too many high grades, and I find conversations with others who are still hung up here to be maddeningly frustrating. I have long felt participation was too slippery to calculate, and sometimes students are super engaged but don’t say as much. I still get excellent participation from students without grading it.

More tomorrow on the first chapter reflection questions. Let me know if you want to “book group” this book.

Assessment

Some Reflections on Being a Student Again

7 Comments

Photo by Chris Wormhoudt on Unsplash

One of the many reasons I haven’t had much time to blog lately is the fact that I went back to grad school in September. I’m working on my doctorate at Northeastern University. Working full time and going to school has meant all the writing I’ve had time to do has mostly been for school, but it’s been a fantastic learning experience so far. I have learned so much from the reading and writing I have done. I can’t even compare my experience with earning my master’s degree to my experience working on my doctorate, and I’m only sorry I wasted so much tuition money and time on the master’s. Here I’m showing my ignorance, but I didn’t realize one could go right into a doctoral degree program with a bachelor’s degree.

My dissertation in practice is an action research investigation on grading and assessment practices. If you’ve been reading this blog for a while, it’s perhaps not a surprise, as assessment has been an interest of mine for a long time. I have come to the conclusion that grading impedes not only motivation but also learning, as students tend to focus on the grade at the expense of the learning. It’s true that some students don’t find grades to be a motivator, and those students tend to view them more as a stick than a carrot. Whether grades motivate students or not, however, they do encourage students to focus on the wrong thing, and even students who truly want to learn find grades demotivating. Students have told me they are afraid to take risks. They select “easier” options. They try to figure out what the teacher wants to hear and parrot it back rather than think for themselves. All of this is anecdotal—I’ve seen it many times over the years; however, I see no reason why students would be dishonest about their feelings regarding grades.

Going back to school has put me in the same position as my students. The anxiety I have experienced over my grades has been difficult to manage at times. Of course I want to learn, and I’d be lying if I said I didn’t want to please my professors. Even though I’m actually studying the effects of grading and know exactly what is happening to me, I find myself unable to focus only on the learning. I want to earn good grades too badly. It’s utterly ironic on a few levels. I’m actually doing very well, for one thing, and for another, the research is quite clear that grades are subjective, demotivating, and even contribute to poor performance (Bloxham, et al., 2016; Brackett, et al., 2013; Cvencek, et al., 2018; Klapp, 2015). My hunch is it has to do with mindset. I noticed my students relaxed quite a bit once I instituted a liberal revision policy.

One of my classmates mentioned that a professor I will have for a summer course is a hard grader. So naturally, I’ve already started worrying about a class I won’t start for nearly a month. It made me reflect a little bit on reputation. I don’t think I have a reputation for being a hard grader. One person told me my reputation was my expectations are “reasonable,” and I’ll take it. My students this year seemed to be happy in my classes, and my course surveys revealed they felt cared a for and that the choice and agency they had was important for their growth. I relaxed a lot on my own grading practices as a result of the research I have done and because of my own experiences as a student. I truly do not understand the need for a graduate program to use grades.

We know what to do about grading and assessment. I think one reason I was not accepted to another graduate program to which I applied is that my research does not examine a gap in the research. On the contrary, there is plenty of research on grading and assessment, and going all the way back to the 1800s, the research has been fairly clear. And yet, we keep reporting learning by using grades. So even though there is no gap in the research, it’s clear to me that classroom practices haven’t changed as a result of the research, and that’s what I’m interested in: change. We need to do right by our students and fix this problem that has plagued education for far too long.

References

Bloxham, S., den-Outer, B., Hudson, J., & Price, M. (2016). Let’s stop the pretence of consistent marking: Exploring the multiple limitations of assessment criteria. Assessment & Evaluation in Higher Education, 41(3), 466-481. doi:10.1080/02602938.2015.1024607

Brackett, M. A., Floman, J. L., Ashton-James, C., Cherkasskiy, L., & Salovey, P. (2013). The influence of teacher emotion on grading practices: A preliminary look at the evaluation of student writing. Teachers and Teaching, 19(6), 634-646. doi:10.1080/13540602.2013.827453

Cvencek, D., Fryberg, S. A., Covarrubias, R., & Meltzoff, A. N. (2018). Self‐concepts, self‐esteem, and academic achievement of minority and majority North American elementary school children. Child Development, 89(4), 1099-1109. doi:10.1111/cdev.12802

Klapp, A. (2015). Does grading affect educational attainment? A longitudinal study. Assessment in Education: Principles, Policy & Practice, 22(3), 302-323. doi:10.1080/0969594X.2014.988121