Category Archives: Assessment

Understanding by Design: The Six Facets of Understanding

Understanding by DesignOf all the chapters of Understanding by Design I’ve read up to this point, I found this one to be the most engaging. If you are familiar with Bloom’s Taxonomy, much of what is presented in this chapter will not be new, but reading it made me realize that I have come further than I really thought I had in implementing solid, authentic assessments for my students.

Near the very beginning of the chapter, Wiggins and McTighe define the act of understanding as being able to “teach it, use it, prove it, connect it, explain it, defend it, [and] read between the lines” (82). How many times have we said as teachers that we didn’t really understand something until we had to teach it? I know I felt that way about grammar. And in fact, this understanding has helped me to improve my writing. Knowing how language works and how to arrange it effectively has enabled me to be a better communicator. The six facets of understanding instantly reminded me of higher order thinking skills on Bloom’s Taxonomy: Application, Analysis, Synthesis, and Evaluation. The six facets of understanding are the ability to explain, to interpret, to apply, to have perspective, to empathize, and to have self-knowledge. Wiggins and McTighe argue that “[i]n teaching for transfer, complete and mature understanding ideally involves the full development of all six kinds of understanding” (85).

One thing I like about this chapter is that the authors give two solid examples of each facet of understanding as well as a “misunderstanding” linked to each facet.

The first facet, the ability to explain, enables a student to understand “how things work, what they imply, where they connect, and why they happened” (86). In order to help students develop the ability to explain, they must “be given assignments and assessments that require them to explain what they know and give good reasons in support of it before we can conclude that they understand what was taught” (87). We should create assessments that ask for students “to reveal their understanding by using such verbs as support, justify, generalize, predict, verify, prove, and substantiate” (87). However, we must also be careful to “[u]se assessments (e.g. performance tasks, projects, prompts, and tests) that ask students to provide an explanation on their own, not simply recall; to link specific facts with larger ideas and justify the connections; to show their work, not just give an answer and to support their conclusions” (88).

In terms of my particular discipline, I think I found the ability to interpret to be the facet of understanding I currently incorporate most fully into my assessments. Wiggins and McTighe assert that “[a] good story both enlightens and engages; it helps us remember and connect” (89). They mention the use of parables in teaching, and of course, I thought immediately of Jesus as a teacher — his use of parables is, of course, well known, and widely considered to be a good way to impart complex messages in ways that his students understood. Literature teaches us much about the human condition, and through the study of our literature, we can learn more about ourselves.

Stories help us make sense of our lives and the lives around us, whether in history, literature, or art. The deepest, most transcendent meanings are found, of course, in the stories, parables, and myths that anchor all religions. A story is no a diversion; the best stories make our lives more understandable and focused. (89)

To illustrate the way in which interpretation can express complex ideas and lead to new understanding, the authors cite, for example, how Martin Luther King, Jr.’s “I Have a Dream” speech “crystallized the many complex ideas and feelings behind the civil rights movement” through the use of “words and imagery” (89). What we ask students to do when we ask them to interpret is to “make sense of, show the significance of, decode, and make a story meaningful” (90). Interpretation can be uncomfortable because it allows for various viewpoints. In order to help students interpret, we must craft assessments that “ask them to interpret inherently ambiguous matters — far different than typical ‘right answer’ testing” (92).

In asking students to apply, we are asking them to be able to “use knowledge” (93). Students demonstrate application knowledge by “using it, adapting it, and customizing it” (93). The authors quote Bloom:

Synthesis is what is frequently expected of the mature worker, and the sooner the students are given opportunities to make synthesis on their own, the sooner they will feel that the world of school has something to contribute to them and to the life they will live in the wider society. (93)

In reading this quote, I was reminded of the lyrics for Paul Simon’s “Kodachrome”:

When I think back on all the crap I learned in high school
It’s a wonder I can think at all
And though my lack of education hasn’t hurt me none
I can read the writing on the wall

I think too many of our students walk out of high school feeling as if they haven’t learned much they can really use. In teaching students to connect, synthesize, and apply, we need to create assessments that are “as close as possible to the situation in which a scholar, artist, engineer, or other professional attacks such problems” (94). One of the things I like about a number of webquests I’ve seen is that they do indeed ask students to apply what they learn by putting them in the seats of the experts solving certain problems. In fact, the nutrition unit referred to earlier in the book asks students to create a menu for camp and convince a camp director to adopt it. I think this is a great example of application and probably very much like the job of a real dietician.

When Jay McTighe came and spoke at our school, he underscored the use of rubrics and models. In fact, it was McTighe who introduced me to the excellent rubrics at Greece Central School District’s rubrics, which I admire very much. I do, however, think students have trouble interpreting these rubrics and applying them to their own work, which is why I will be giving copies of the rubrics at the beginning of the year, then writing comments directed at the student’s writing on each composition as opposed to stapling the rubric to the top.

I think perhaps educators incorporate the teaching of perspective least often. Can you ever remember being encouraged to think of a text’s or a teacher’s assertions as a matter of perspective? I know you didn’t dare try that with my Medieval Literature professor. He was right. Period. Do you give off that particular vibe? I would like to think I am careful not to do that. I do preface what I say about some topics with clear indicators that it is my opinion they’re about to hear, and not an unquestioned fact. Perspective, then, “involves weighing different plausible explanations and interpretations” (97). We need to ask our students to look at things from different points of view. I think one way in which my particular school does a great job teaching perspective is through our grade level trips and through our religious classes. Our religious classes teach various points of view. It is part of the rabbinic tradition to question, much more so than the Christian tradition, so in that way, our religion classes encourage debate and divergent thinking. In fact, our school is unique in that we accept Jews of all backgrounds: Orthodox, Conservative, Reform, and Reconstructionist.

Just as we should be asking students to think about ideas from other perspectives more often, one way I think our schools do encourage students to understand is through empathy. I think many disciplines encourage students to “walk in another’s shoes,” and to “try to understand another person, people, or culture” (98). Sometimes in order to do this, we have to question our own ideas. I noted in the margins of this section of the chapter that it seems to me that studying history, or for that matter, literature from other time periods, it is critical that we try to look at things from the perspective of people living in that time. Only through empathy can we understand why, for example, chivalry was so important, or why the Crusades were fought, or any number of other events and ideas that formed thinking in the past. I think a great many of the lesson ideas for teaching Shakespeare at the Folger Library are exceptional at helping students empathize with the characters through examination of the times in which they lived. It also occurred to me that the lesson involving the Thoreau panel that my students participated in last year was probably really good for helping them understand through empathy.

Finally, students should come to be able to understand themselves, to exhibit self-knowledge. I highlighted a passage that really spoke to me with regards to how we speak about educating students:

Is the brain really like a computer? Are children really like natural objects or phenomena to be treated as equal variables and “isolated,” so that a standardized test can be modeled on the procedures of scientific experiments? To talk of education as “delivery of instructional services” (an economic metaphor and a more modern variant of the older factory model) or as entailing “behavioral objectives” (language rooted in Skinnerian animal training) is to use metaphors, and not necessarily helpful ones. (101)

This passage sums up something I have felt but been unable to articulate about some of the metaphors we use to describe what we do and the purpose behind standardized testing. Wiggins and McTighe argue that we like to categorize, but in so doing, sometimes we “keep verifying our favored and unexamined models, theories, analogies, and viewpoints” (101). “Thinking in either-or terms is a common example of such a natural habit that we see rampant in education reform and one that Dewey viewed as the curse of immature thought” (101). I see this one a great deal in the debate between phonics and whole language — one can and should use phonics within the context of teaching whole language. Similarly, direct instruction and constructivism can both be implemented in classrooms to great effect. I have seen so much acrimony regarding constructivism in the edublogosphere that I was even somewhat nervous about putting that sentence out there. Wiggins and McTighe refer once again to the Expert Blind Spot. The implications of the facets of understanding “help us avoid the Expert Blind Spot at work when we fall victim to the thinking that says, ‘Because I understand it, I will tell you my understanding and render teaching and learning more efficient'” (103). Is it just easier, then, to lecture instead of allowing students to create meaning “via artful design and effective coaching by the teacher”? (103-104). I wonder if we sometimes just don’t trust our students to learn if we don’t “tell” them. In so doing, perhaps we are robbing them of truly understanding.

Work Cited: Wiggins, Grant, and Jay McTighe. Understanding by Design. Expanded 2nd Edition. Alexandria, VA: ASCD, 2005.

[tags]Grant Wiggins, Jay McTighe, UbD, Understanding by Design, assessment, education, curriculum, understanding, constructivism[/tags]

Understanding by Design: Gaining Clarity on Our Goals

Understanding by DesignI had a great deal of difficulty with this chapter. It probably didn’t help that my reading of it was rather disjointed — I have two small children here at home, and I probably needed to marshal all my concentration and read it in the library or somewhere quiet. The chapter describes and summarizes the terms “Established Goals, Understandings, Essential Questions, Knowledge, and Skills” (56).

The first passage that really spoke to me discussed “Established Goals”:

[T]he greatest defect in teacher lesson plans and syllabi, when looked at en masse, is that the key intellectual priorities — deep understandings of transferable big ideas, and competence at core performance tasks — are falling through the cracks of lessons, units, and courses devoted to developing thousands of discrete elements of knowledge and skill, unprioritized and unconnected. That is why content standards exist (regardless of the quality of specific standards): to prioritize our work, to keep our eyes on the prize, and to avoid the intellectual sterility and incoherence that comes from defining our aims as hundreds of apparently equal, discrete objectives to be “taught” and tested out of context. (58)

I made a major mistake in one of my early job interviews. I had not yet graduated (I needed to complete a cross-cultural class and a 20th century literature class during the summer to finish up, but I was done with English Education courses), and I was invited for an interview at a Middle Georgia school. The principal asked me how I planned to ensure that the QCC objectives (the old standards used to guide Georgia educators before standards were revised some years ago) were met. With all the arrogance of youth, I proceeded to explain that the objectives were broad — any number of tasks might suitably ensure objectives had been met; therefore, my approach would be to plan lessons and go through the QCC objectives to see which ones applied. True story. D’oh! I can’t believe how dumb that sounds now that I look back on it. I knew right after I said it that he was no longer interested in hiring me. Well, truth be told, I wasn’t too interested in the job either, but I went to the interview hoping for an offer in case I couldn’t get my first choice. I don’t think most educators would be so ballsy as to say outright that this is how they ensure they meet standards, but I wonder if it isn’t a common practice. What I basically communicated to that principal is that I didn’t think standards were as important as my pet lesson ideas, and that I could figure out how to twist and finagle the standards to fit my plans rather than use the standards to design my plans.

Wiggins and McTighe point out that when they were “writing the first edition of Understanding by Design, the standards movement was still so new [they] hardly mentioned it in the book” (60). The first edition was published in 1998. The standards movement is often traced to the 1983 report A Nation at Risk (Overview of the Standards Movement). The movement might be said to have reached a head with the passage of NCLB. It might be that the authors recognize the passage of NCLB as the moment when the standards movement became serious in terms of real repercussions for failing schools. I like the description of standards provided by Education Week (via Overview of the Standards Movement).

  • Academic standards describe what students should know and be able to do in the core academic subjects at each grade level.
  • Content standards describe basic agreement about the body of education knowledge that all students should know.
  • Performance standards describe what level of performance is good enough for students to be described as advanced, proficient, below basic, or by some other performance level.

Wiggins and McTighe discuss several problems with standards:

  • The “Overload Problem”: Simply too many content standards exist, and we do not have the time available to learn them.
  • The “Goldilocks Problem”: Standards are too big or too small.
  • The “Nebulous Problem”: Standards are so nebulous that “teachers will interpret [them] in different ways, thus defeating one of the intentions of the standards movement — clear, consistent, and coherent educational goals” (61-62).

As I am most familiar with Georgia’s standards, I feel most qualified to comment upon them. In my opinion, our state standards are fair. I think they are doable in terms of the time we have, and I think they are neither too broad nor too narrow. I do, however, think perhaps some of them are nebulous enough that teachers might interpret them as they please. If they weren’t, I wouldn’t have said what I said at that job interview ten years ago. True, our standards have been revised since then, but I still think they are somewhat nebulous. Of course, to be fair, this also presents the teacher with the freedom to approach the subject in a variety of ways and still meet state standards. As a teacher in a private school, I am not beholden to Georgia’s standards per se, but I do find them useful in planning my lessons and making sure I stay on track.

I liked the authors’ discussion of “big ideas”:

The big ideas connect the dots for the learner by establishing learning priorities. As a teacher friend of ours observed, they serve as “conceptual Velcro” — they help the facts and skills stick together and stick in our minds… A big idea may be thought of as a linchpin. (66)

The authors quote Bruner (1960):

For any subject taught in primary school, we might ask [is it] worth an adult’s knowing, and whether having known it as a child makes a person a better adult. A negative or ambiguous answer means the material is cluttering up the curriculum. (66)

This is a good point and can be hard with material we’re passionate about; therefore, I wonder what was meant by “primary school.” K-12? Or just what we usually think of as elementary school — K-5 or 6? Or even just early elementary — K-2 or 3? I think as we move up into secondary school, content becomes more specialized and is likely taught by a content specialist. Therefore, can all of it necessarily be “worth an adult’s knowing” and would “having known it as a child [make] a person a better adult”? One could argue that it depends on what that adult wants to do or be in life, I suppose. I know a lot of middle and high school teachers have been told at some point that something they thought was critical was somehow not going to be important in life.

Wiggins and McTighe go on to discuss the difference between “big ideas” and “basics.” “Big ideas are at the ‘core’ of the subject; they need to be uncovered; we have to dig deep until we get to the core,” while basic ideas are the framework or foundation (67). I like the authors’ statement that “we need a ‘preponderance of evidence’ in order to ‘convict’ a student of meeting stated goals” (69). In other words, we must make sure students have mastered content standards through a wide variety of measurements before we can say they are definitely guilty of “understanding” content.

In terms of “finding big ideas,” the authors suggested two tips in particular that I think will be useful: “look carefully at state standards” and “circle key recurring nouns in standards documents to highlight big ideas and the recurring verbs to identify core tasks” (73-74). The authors remind us again that we are experts as teachers, and the “Expert Blind Spot” can prevent us from making big ideas obvious to students. We need to think like students in order to help them grasp big ideas and truly understand the content.

On pp. 79-80, the authors share a rubric for self-assessment and peer review of “any assessments purporting to involve true application with authentic challenges.” I believe this rubric might be helpful to participants at the UbD Educators’ wiki, so I provided a rubric page. For example, I think the Pythagorean theorem problem described on p. 42 and in this post might be considered a 3 on the authors’ rubric. It looked unfamiliar to the students taking the test, but did give students “clues or cues” that “suggest[ed] the approach or content called for” (79). “The main challenge for the learner is to figure out what kind of problem this is, from the information given. Having realized what the task demands, the learner should be able to follow known procedures to solve it” (79).

Work Cited: Wiggins, Grant, and Jay McTighe. Understanding by Design. Expanded 2nd Edition. Alexandria, VA: ASCD, 2005.

[tags]Grant Wiggins, Jay McTighe, UbD, Understanding by Design, curriculum, assessment, education[/tags]

UbD Update

I have been quiet for a couple of days as I finished up the school year and did some planning for a summer course I will be teaching the end of July/beginning of August. In the meantime, Grant Wiggins commented on the UbD Wiki post and offered up a nice bit of encouragement for those of us who are reading Understanding by Design and collaborating at the wiki, which Wikispaces has generously agreed to host ad-free. We are just getting started, so it is not too late to join up!

More tomorrow after I have rested from education for a bit.

Update, 5/30/08: Thanks to Grant for allowing UbD Educators to access his online course this year.  The course is no longer available for free.

[tags]Grant Wiggins, UbD, Understanding by Design, Jay McTighe, wiki, assessment, education[/tags]

Understanding by Design: Understanding Understanding

Understanding by DesignAn alternative title for this chapter of Understanding by Design might be “Everything You Thought You Knew about Teaching and Assessment is Wrong.”  Perhaps that is somewhat hyperbolic, but not much.

I consider myself an autodidact — perhaps not in the sense of being largely self-taught, but in the sense that I have taught myself a lot.  I have taught myself a number of things, from CSS and HTML to Arthurian legend and how to cross-stitch.  I think that sometimes I am frustrated when I encounter students who cannot teach themselves.  I think I expect them to be able to transfer information more easily when I haven’t really given them the tools to do so.  A math problem mentioned in the book asks students to identify how many buses, each of which seats 36, would be needed to transport 1,128 people (2).  Of course, the route one should take to answer this question is to divide the number of people by 36.  According to Wiggins and McTighe, “Almost one-third of the the eighth-graders [taking the NAEP mathematics assessment] gave the following answer: ’31 remainder 12′” (2).  You and I can do our best face-palm imitations of Homer Simpson, but the fact remains that 1,128 divided by 36 does result in 31 remainder 12.  What the students didn’t understand is that those twelve leftover people would need a whole extra bus; therefore, they should have given the answer 32.  Just to show how stubborn I am, I had to work the math problem before I took the authors on faith.

Wiggins and McTighe discuss Benjamin Bloom’s influence on assessment through his Taxonomy.  As the authors point out, “As Bloom put it, understanding is the ability to marshal skills and facts wisely and appropriately, through effective application, analysis, synthesis, and evaluation” (39).  To elaborate, “[d]oing something correctly, therefore, is not, by itself, evidence of understanding.  It might have been an accident or done by rote” (39).

What the authors argue we must enable students to do is to “transfer” information:

Knowledge and skill, then, are necessary elements of understanding, but not sufficient in themselves.  Understanding requires more: the ability to thoughtfully and actively “do” the work with discernment, as well as the ability to self-assess, justify, and critique such “doings.”  Transfer involves figuring out which knowledge and skill matters here and often adapting what we know to address the challenge at hand. (41)

On pages 42-43, Wiggins and McTighe examine the failure of students to transfer mathematical knowledge to solve problems.  I learned something new about myself as I read these two pages.  I have told myself for years that I am not a good math student.  I had to work very hard to earn B’s when I had good teacher who could explain mathematical concepts.  On the other hand, if I had a teacher that just couldn’t explain it in a way that I could understand, I might earn C’s.  My A in College Algebra didn’t convince me otherwise.  I told myself that I earned a good grade because my high school Trig/Pre-Calculus teacher was so good.  When we ventured into Calculus at the end of the course, I failed the quiz that week.  However, in working the following problem, I discovered that I had actually done something that “two-thirds of the tested students” who took the New York State Regents Exam couldn’t do.  I could transfer my understanding of a mathematical formula to a new situation.  Try this problem:

To get from his high school to his home, Jamal travels 5.0 miles east and then 4.0 miles north.  When Sheila goes to her home from the same high school, she travels 8.0 miles east and 2.0 miles south.  What is the measure of the shortest distance, to the nearest tenth of a mile, between Jamal’s home and Sheila’s home?

Once you’ve worked it out or given up, join me and read on.

I was so excited because I immediately saw this problem in terms of triangles.  I am pretty good at reading maps, and I visualized the routes Jamal and Sheila took.  After that, I realized I could probably use the Pythagorean theorem to solve the problem because the triangles formed were right triangles.  As I read further, I discovered I was correct.  The students who missed this question were not able to transfer a²+b²=c² to a real-life application, though they probably memorized the formula and correctly answered questions just like this one, only formed in such as way that they could clearly see the Pythagorean theorem was necessary to solve the problem.  I guess I’m not such a bad math student after all.  And by the way, the answer is 6.7 miles.  Um… right?  Tranfer?  Yes.  Confidence?  Not yet.

Math Problem

And how many times have I complained that students are fixated on grades and don’t really care what they have learned?  I suppose I have trouble practicing what I preach.  I saw my math grades as an indicator that I didn’t understand.  The problem, then, was not that I didn’t understand, but that the assessments provided by my instructors didn’t always enable me to prove that I understood.  I really don’t want to do this to my own students.

Wiggins and McTighe define “an understanding,” the noun, as “the successful result of trying to understand — the resultant grasp of an unobvious idea, and inference that makes meaning of many discrete (and perhaps seemingly insignificant) elements of knowledge” (43).  As teachers we generally choose our subject matter, if we are subject specialists as is commonly the case with secondary teachers, based upon our expertise.  I consider myself a good reader and writer, and I liked my junior and senior English teacher a great deal.  She inspired me to further my English education in college.  It was touch and go, as I was actually a better student of French than English.  I considered teaching foreign language, but one reason I decided not to is that in order to be a more attractive candidate, I would probably have to be able to teach more than one foreign language, and I was only ever interested in French (at least when I was younger, that is).  As we learn, we forget that we didn’t always know this stuff, and we gradually become experts.  Wiggins and McTighe warn against this “expert blind spot” (44).  You might be suffering from this blind spot, as I do, if you’ve ever said something like this:

Teachers do not optimize performance, even on external tests, by covering everything superficially.  Students end up forgetting or misunderstanding far more than is necessary, so that reteaching is needed throughout the school experience.  (How often have you said to your students, “My goodness, didn’t they teach you that in grade X?”). (45)

What do we get as a result?  “Students in general can do low-level tasks but are universally weak in higher-order work that requires transfer” (45).  As the authors argue, “We [make] it far more difficult for students to learn the ‘same’ things in more sophisticated and fluent ways later.  They will be completely puzzled by and often resistant to the need to rethink earlier knowledge” (45).  I know I have noticed this phenomenon in my own students, especially with regards to grammar.  Our school has rigorous grammar instruction in the 9th grade. If students do not learn the basics of grammar before they enter the 9th grade, I have found they are often resistant to learning it.  They don’t feel comfortable with the material, and they feel frustrated about being behind.  They also don’t often make use of teacher office hours or our Learning Center in order to catch up, but those few students who do invariably “get it” at last.  I know that my writing has improved over the last few years as I have been teaching this grammar curriculum.  I really think about all of the parts of language and how to put them together to get my ideas across with clarity.  It isn’t that I didn’t think about it before, but I really feel more grounded and sure of myself as a writer.  But just like my students, I was resistant toward rethinking “earlier knowledge.”  I have had to question my own beliefs regarding grammar instruction (and, to be fair, those of my previous teachers, professors, and my supervising teacher from my student teaching days).

As Wiggins and McTighe further explore understanding, they note “Children cannot be said to understand their own answer, even though it is correct, if they can only answer a question phrased just so” (48).  In so doing, students show not that they understand a concept, but that they can regurgitate a fact, solution, answer, etc., for a test.  Inevitably, this lack of transfer will result in the students’ forgetting the concept.  It’s not that they forgot it, but that they never really understood it at all.  Determining whether a student understands demands “crafting assessments to evoke transferability: finding out if students can take their learning and use it wisely, flexibly, and creatively” (48).  In other words, we should be “assessing for students’ capacity to use their knowledge thoughtfully and to apply it effectively in diverse settings — that is, to do the subject” (48).  A common pitfall in education is that we “attribute understanding when we see correct and intelligent-sounding answers on our own tests” (49).  I had a student who could memorize like no one’s business.  She memorized vocabulary for quizzes and made excellent grades, but I can’t recall seeing her use those new words in her writing, and later she might even ask me what the term meant if I casually used it in class.  She hated it when I changed my vocabulary instruction this year and adopted vocabulary cards.  I noticed an uptick in transfer of new vocabulary this year.  If I used a term in class, students might even point out that it was a vocabulary term.  Some of them even made a concerted effort to incorporate their new vocabulary words into their writing.  But this student did neither — she still didn’t know the terms later, and she still didn’t use them in her writing.  In addition, she seems to have to have information presented in exactly the same way each time, or she doesn’t know what I’m talking about.  In other words, I think this student’s problem is an inability to transfer.  I don’t think it’s entirely up to her — I needed to figure out a way to facilitate that transfer.  However, I figured out ways to get other students to transfer, so it wasn’t entirely me.  She insists that she is just a poor test-taker.  After reading this chapter, I think I have a better idea of what’s wrong.  She never understood the material in the first place, but she compensates so well with her excellent memory that she still manages to earn good grades.  Placement or tracking can be difficult for students like this girl because as teachers, we know something is off.  We know these students don’t “get it” like they should, but at the same time, they can earn grades that would seem to justify a higher placement.  What we need to do as teachers, then, is create authentic assessments that enable us to justify the grades we give.  I cannot justify the high grades this student received in my class; I know she doesn’t have the understanding that some of her peers had who didn’t earn grades as high as hers.

Wiggins and McTighe conclude the chapter with a discussion of misunderstanding, which “is not ignorance,” but “the mapping of a working idea in a plausible but incorrect way in a new situation” (51).  The authors point out, “Paradoxically, you have to have knowledge and the ability to transfer in order to misunderstand things” (51).

Thus evidence of misunderstanding is incredibly valuable to teachers, not a mere mistake to be corrected.  It signifies an attempted and plausible but unsuccessful transfer.  The challenge is to reward the try without reinforcing the mistake or dampening future transfer attempts.  In fact, many teachers not only fail to see the value in the feedback of student misunderstanding, they are somewhat threatened or irritated by it.  A teacher who loses patience with students who don’t “get” the lesson is, ironically, failing to understand — the Expert Blind Spot again… Take time to ponder: Hmmm, what is not obvious to the novices here?  What am I taking for granted that is easily misunderstood?  Why did they draw the conclusion they did? (51)

Work Cited: Wiggins, Grant, and Jay McTighe. Understanding by Design. Expanded 2nd Edition.  Alexandria, VA: ASCD, 2005.

[tags]UbD, Understanding by Design, Grant Wiggins, Jay McTighe, understanding, curriculum, assessment, education[/tags]

UbD Educators

Understanding by DesignBased upon some discussion about my re-reading of Grant Wiggins and Jay McTighe’s Understanding by Design, I created a wiki for those of you who are interested in exploring this book together this summer and sharing our UbD lesson plans. As the authors say in chapter one, “Backward Design,” “In addition to using the UbD Design Standards for self-assessment, the quality of the curriculum product (unit plan, performance assessment, course design) is invariably enhanced when teachers participate in a structured peer review in which they examine one another’s unit designs and share feedback and suggestions for improvement” (27). I am really excited to try peer review, but I am not sure my colleagues at school would be on board. Let me rephrase. My department head would be interested, and one other member of our department might be, but the final member would consider it a personal affront.

I’m excited about this! Come join us if you are interested in this collaborative project.

Update, 5/30/08: Please read important new information in the comments.

[tags]UbD, Understanding by Design, Grant Wiggins, Jay McTighe, peer review, curriculum, assessment, education[/tags]

Understanding by Design: Backward Design

Understanding by DesignChapter One of Understanding by Design is an introduction to the concept of Backward Design, which I think is best summarized in Wiggins and McTighe’s statement that “We [teachers] cannot say how to teach for understanding or which material and activities to use until we are quite clear about which specific understandings we are after and what such understandings look like in practice” (14-15).  In other words, we need to know what we want the end result to be before we plan.  This might seem obvious, but we don’t do it as much as we should.  Most books discussing goal-setting advise readers to visualize the end and then determine how to get there.  What I know I have done at times is what the authors describe as “throw[ing] some content and activities against the wall and hop[ing] some of it sticks” (15).  Ouch.  In fact, their description of a unit on To Kill a Mockingbird could be an accurate description of some of my own planning:

Consider a typical episode of what might be called content-focused design instead of results-focused design.  The teacher might base a lesson on a particular topic (e.g. racial prejudice), select a resource (e.g. To Kill a Mockingbird), choose specific instructional methods based on the resource and topic (e.g. Socratic seminar to discuss the book and cooperative groups to analyze stereotypical images in films and television), and hope thereby to cause learning (and meet a few English/language arts standards).  Finally, the teacher might think up a few essay questions and quizzes for assessing student understanding of the book.  (15)

Like I said, ouch.  As a matter of fact, if I am being truthful and honestly reflective about my practices, I have to admit that this is my most frequent approach to teaching literature.  That isn’t to say that my students aren’t learning, but clearly, I need to figure out what it is exactly that I want them to learn.  If I have one quibble with the UbD approach as described in this chapter, it is that the authors ask, “Why are we asking students to read this particular novel?” and later state, “Unless we begin our design work with a clear insight into larger purposes — whereby the book is properly thought of as a means to an educational end, not an end until itself — it is unlikely that all students will understand the book (and their performance obligations)” (15).  Well, then, why do we select any text?  Why do we read any novel?  I don’t think my first reason for selecting To Kill a Mockingbird would be teaching students about prejudice, although one could certainly learn about prejudice from the novel.  I simply think it’s a great book.  So how do I articulate that into a justification for selecting that text?  If I am selecting texts only as a means of communicating some large idea, does it even matter what we read as long as we get there?  I don’t think the authors believe this, but I do think they would like teachers to question why they select texts that they do: “Many teachers begin with and remain focused on textbooks, favored lessons, and time-honored activities — the inputs — rather than deriving those means from what is implied in the desired results — the outputs” (15).

The authors proceed to explore in more depth what they referred to in their introduction as “the twin sins of design”: activities-based instruction and coverage-based instruction.  If you have ever asked yourself as an educator why those students just won’t learn what you’re teaching, you’ll want to examine this section.  The authors advise teachers to ask “‘What should [the students] walk out the door able to understand, regardless of what activities or texts we use?’ and ‘What is evidence of such ability?’ and therefore, ‘What texts, activities, and methods will best enable such a result?'” (17).  In the margin of the book, I wrote, “I tell (I meant stand in front of the room and yak at) students too much, and I do all the work.  Then I complain when they don’t learn.”

Backward design is comprised of three stages: 1) Identify desired results; 2) Determine acceptable evidence; and 3) Plan learning experiences and instruction (17-18).  “In stage 1 we consider our goals, examine established content standards (national, state, district), and review curriculum expectations” (18).  In stage 2 we determine what “collected evidence [is] needed to document and validate that the desired learning has been achieved” (18).  Finally, in stage 3 we determine “appropriate instructional activities” (18).

I think the central reason why educators are somewhat leery of UbD is clear in the following passage:

This [backward design] is all quite logical when you come to understand it, but “backward” from the perspective of much habit and tradition in our field.  A major change from common practice occurs as designers must begin to think about assessment before deciding what and how they will teach.  Rather than creating assessments near the conclusion of a unit of study (or relying on the tests provided by textbook publishers, which may not completely or appropriately assess our standards and goals), backward design calls for us to make our goals or standards specific and concrete, in terms of assessment evidence, as we begin to plan a unit or course. (19)

In other words, UbD is looking at curriculum like we tend to look at goal-setting.

Later in the chapter, the authors suggest peer review of units or curricula might be helpful.  I agree, and I think this can be totally non-threatening and extremely helpful, but I am not sure some of my colleagues would agree.  Teachers are prickly about review.  I know I didn’t like it in the past when I’ve had to hand in lesson plans.  However, I think on the occasions when I have received good feedback regarding my ideas, it’s been critical to my improvement as an educator.  As teachers, we understand that feedback and assessment doesn’t always equal criticism when we do it, but when we receive it, we tend to find ourselves right back in the student’s chair again.

The chapter ends with an examination of a health teacher’s unit on nutrition.  As this unit is used as an example throughout the book, the completed UbD template for the unit plan appears in this chapter.  I have to say it’s an excellent unit plan.  The students are authentically assessed over their understanding of good nutrition; furthermore, they are asked to apply what they learn.  In fact, I think if I were the health teacher’s student, I would have found the unit interesting, engaging, and enjoyable.

Work Cited: Wiggins, Grant, and Jay McTighe. Understanding by Design. Expanded 2nd Edition.  Alexandria, VA: ASCD, 2005.

[tags]UbD, Understanding by Design, Grant Wiggins, Jay McTighe, Backward Design, curriculum, assessment, education[/tags]

Understanding by Design: Introduction

Understanding by DesignAs I read Grant Wiggins’ and Jay McTighe’s Understanding by Design, I have decided to share my thoughts — my reading journal, if you will, as a few readers expressed an interest in hearing my thoughts about this book. I could be misrepresenting my readers, and please tell me if I am, but I sense a great deal of skepticism about UbD among educators. After Jay McTighe presented UbD to our faculty last year, I have to admit I became a fan of this approach, so caveat emptor.

First of all, the book has a nice feature that seems like a small thing, but is something I really appreciated as I began reading — space in the margins to write notes. Encouraged by this extra space, I took quite a few notes as I read. This post will focus on the book’s introduction.

If you are thinking about reading this book and are tempted to skip the introduction, my advice is — don’t! Back when we were students, I know we often skipped the introductions, as we didn’t consider them really part of the book. This introduction, however, is essential background. The introduction discusses four vignettes, two of which are true stories and two of which are “fictionalized accounts of familiar practice” (1). The two fictionalized accounts — one, a description of a unit on apples and the other, a description of a teacher in April realizing how much he has left to “cover” represent what the authors call the “twin sins of design” (3). The first unit is a string of activities related to apples. I have to admit that presented in the context of this book, the unit sounded absurd. I wasn’t sure what the students were supposed to learn about apples, aside from having some fun engaging in a series of activities, including making applesauce, going on a hayride, and writing stories about apples. The second unit is probably more familiar to high school teachers. Who among us hasn’t reached April and freaked out when we realize how much material we have left to cover? This year in American Literature, I ended up at The Great Gatsby. I don’t feel good about the lack of coverage the twentieth century received in my class, and that was one of the reasons I decided this book needed to be on my summer reading list. I need to plan smarter and better so that my students are exposed to a true survey of literature in my survey courses. I need to figure out what they need to understand, know, and be able to do. I love literature, and it is my compulsion to throw everything out there, but it is not the smartest thing to do given the constraints of time. I highlighted an appropriate quote: “[A]t its worst, a coverage orientation — marching through the textbook irrespective of priorities, desired results, learner needs and interests, or apt assessment evidence — may defeat its own aims” (3). While I agree with this statement, I wonder what our test-driven schools can do, especially in light of NCLB. I think that in some fields, teachers must feel obligated to ensure they approach the material from a coverage orientation. The problem, of course, is with the way we measure student success for NCLB. I am really glad I am not subject to these demands as a private school teacher. Later, the authors say “[m]any teachers believe that to design for understanding is incompatible with established content standards and state testing, we think that by the time you have read the entire book, you will consider this to be false” (9). Perhaps my fears about how well teachers can use UbD and still prepare students for standardized tests will be allayed.

I also made note of an interesting question asked in the introduction: “How can we accomplish the goal of understanding if the textbooks we use dispense volumes of out-of-context knowledge?” (4). One of my criticisms of the textbook series we are adopting, Prentice-Hall’s Literature, is that they pull in “Connections” from other disciplines that are tenuous at best. I do believe in the value of cross-curricular instruction, but I think forcing it when the connections are weak undermines learning and insults the intelligence of our students. The book will describe essential questions later in the text, but I was intrigued by the authors’ insistence that “[i]ndividual lessons are simply too short to allow for in-depth development of big ideas, exploration of essential questions, and authentic applications” (8). I completely agree and recall feeling frustrated by my middle school administrator’s insistence on my putting essential questions on the board each day. He was quite happy if they read something like “What is a pronoun?” or “Why do we need pronouns?”, but I always felt like I was simply rewording the objectives in the form of a question rather than really trying to communicate “big ideas” or overarching understanding of the material I was teaching.

Work Cited: Wiggins, Grant, and Jay McTighe. Understanding by Design. Expanded 2nd Edition. Alexandria, VA: ASCD, 2005.

[tags]UbD, Understanding by Design, Jay McTighe, Grant Wiggins, curriculum, assessment, education[/tags]

Plagiarism

I have been grading student essays this morning and just detected plagiarism in one of my students’ essays. It’s not the first time a student has turned in a plagiarized essay to me, and I am sure (sadly) that it won’t be the last. On the one hand, I know this student was sick when the essay was due, but I did offer her more time to complete the essay, and she declined. What is particularly troubling to me is that the essay contains sections entirely copied and pasted from Wikipedia or Answers.com. I find this distressing for many reasons. First of all, I think it is rather insulting to my intelligence that a student believes she can copy text from such well-known websites without my knowledge — indeed, I had provided students with links to the Wikipedia article she copied in order that they might find it a useful source. Second, it bothers me that the student must have believed turning in writing culled from Wikipedia was OK. I suppose I shouldn’t be surprised; our current culture encourages plagiarism — you can purchase essays online. I find it frustrating that students continue to steal content from the Internet. I imagine they do so because it’s easier than stealing it from a book, but I don’t think they realize how much easier it is to catch them at Internet plagiarism.

I have learned a couple of tricks that help me catch plagiarists. First of all, look for straight quotes as opposed to curly quotes. Straight quotes often indicate copying and pasting from the Internet because web standard displays quotation marks as two small, straight lines, whereas the default font in MS Word, Times New Roman, displays quotation marks as two curly marks. Straight quotes don’t always indicate plagiarism, but they are something to look for if you are suspicious. If you suspect plagiarism, type a sentence or two from the paper word for word into Google search. You should yield a result if the language is identical to that of another site or even if only a few words have been changed (if you don’t put quotes around the sentence). I found my plagiarist using both straight-quote identification and Google search.

What should you do if you catch a plagiarist? It depends upon the nature of the assignment. I give students zeroes. If the assignment is a major assignment, such as a term paper or research paper, I think discipline needs to be taken further. I think students who plagiarize long-term assignments need to have their parents notified and possibly be referred to administration. I didn’t elect to do that with my student. I think the zero will be enough. I think she’s a sweet girl, and I hate that she’s put me in this position. I did try to be understanding about her illness, offering her more time to finish her essay. She declined.

We all make choices. Part of our job as teachers is to help students realize that plagiarism is never the right choice. Even a poorly written essay wouldn’t have received a grade lower than an F (50-59) in my class. I have a hunch she would have earned at least a C if she’d done the work herself.

[tags]plagiarism, education, writing, instruction[/tags]

Socratic Seminar

I don’t often apologize for a lack of posting.  Contrary to conventional wisdom, my philosophy of blogging is that one should only do so when one has something to say.  This philosophy is freeing, in that I don’t litter my blog with posts I don’t care about just so I can keep readers.  The year is winding down, which is stressful anyway, but it doesn’t help much when external stress is brought to bear by someone who could control him/herself if he/she wanted to.  Such is the education life, though, no?

With that inviting introduction, we move into what I really wanted to talk about, which is the beauty that is the Socratic Seminar.  You may recall my students participated in a Socratic Seminar earlier this year centered around the question of who was most responsible for Romeo and Juliet’s deaths.  You can read about that seminar here, along with my reflections about the amazing job they did here.  Another class of mine recently participated in a Socratic Seminar centered around the question “What’s wrong with Holden?” after reading The Catcher in the Rye.

A Socratic Seminar can be based upon any book.  All you have to do, as the educator, is figure out what larger theme or question you want the students to discuss.  Students do all of the other work, but they need guidelines.  First of all, in my experience, students have never heard of a Socratic Seminar, and even those who have heard of one are not sure what to do.  Just outline it for them.  You can use my handout, changing all the relevant information: Socratic Seminar handout.  I culled some of the information on this handout from Greece Central School District’s website.  I think if students are given a similar handout, they will know what they need to do to prepare.

I try to give students at least some class time to prepare.  If the truth be told, it isn’t strictly necessary, but it allays some of their concerns if they can run questions by me first before the seminar.  It also gives those who are having a hard time with the task a chance to see what other students are doing to prepare.  You may need to do some modeling with middle school students, but I haven’t found this to to be necessary with my college prep and honors ninth graders — of course, your mileage may vary, so keep in mind who your students are and what they will need.

The most beautiful thing about Socratic Seminars is that they enable the teacher to assess a student’s understanding of the book, while at the same time ensuring that the student does all the work him/herself.  It is hard to bluff through this assignment without having read the book.  Students have to mark passages so they can defend their assertions.  Their audience is their toughest one — their peers — and their peers will call them on it if they try to BS.

One thing you may notice, as I did, is that Socratic Seminars will give students a chance to shine — a quiet girl who rarely talked in class until the Socratic Seminar simply came out of her shell and contributed a great deal.  I think the Socratic Seminar helped her realize she has valid and interesting things to say.  Another thing that may impress you is how hard the students will work.  They will look up quotes, read criticism (even if it is just online), jot down notes, and the like.  One student told me that even though he’s read Catcher twice, he basically re-read the book just to prepare for the seminar.

Tips for conducting a successful Socratic Seminar:

  • If you’re like me, it will be hard for you as the teacher to remain quiet while the students talk, but it’s essential.
  • Allow students to use hands if they can’t restrain themselves.
  • Supply post-its if students can’t mark in their books.
  • Make sure students are aware of expectations — that each of them must contribute both as a speaker and a listener.
  • Put chairs in a circle.  My chairs are not connected by desks, but if yours are, put desks in a circle.

You might be surprised with what your students come up with when they are put to the test, and the best thing about it is that they do all the work — you just have to listen.

[tags]Socratic Seminar, literature, education[/tags]

Rubrics

One last post, and I’m off to bed.  I do, after all, have to teach tomorrow.  I had a discussion with my principal about rubrics the other day, and today I read an article entitled “Why I Won’t Be Using Rubrics to Respond to Students’ Writing” by Maja Wilson (in English Journal, March 2007 — read it here if you are an EJ subscriber).  My only real issue with the article is that Ms. Wilson focuses on personal narrative, which is much harder to look at with an objective rubric.  I would have liked to have seen what she would have done with a persuasive essay, expository essay, or literary analysis, where I think more objectivity in the form of “looking for certain things” certainly exists.  I do, however, think she has some very good points.  I have been a staunch believer in the rubric, and have even written defenses on this very site this year, but my discussion and this article are really making me think.  I do think rubrics have helped me become more objective, but I think I have taken the objectivity too far and some of the human element in what my students are writing has not been considered.  I have ideas about how I will approach things differently next year.  If I had my way, I wouldn’t grade student writing at all, but simply give them feedback so they could improve.  School doesn’t work like that, however, and I have to assign grades to written work.  Instead of being a tool, my rubrics have become my crutch, and I think I could have given more tangible, valuable feedback this year.  I do plan to stick to my resolve about portfolios and typewritten feedback (at least every other essay) for next year.  It’s too late for me to collect data and see what sort of quantifiable impact this approach will have on my students, but I will keep you posted.

Maja Wilson is also the author of the Heinemann book Rethinking Rubrics in Writing Assessment.

[tags]rubrics, writing, assessment, Maja Wilson, English Journal[/tags]