Tuesday, May 10, 2011

End-of-Term Assessment: What I've Learned in the Last Two Years

School's out! My students have just finished their final exams, and I thought it would be appropriate to evaluate my own progress after two years of teaching, especially since I made some significant changes this year. Here's a review of what worked, what didn't, and what I've learned.

What worked:

1. Administering the reading quizzes as soon as the clock indicates that class time has begun seems to have eliminated tardiness, as I had hoped. Either that or this year's class was just more concerned with punctuality than last year's.

2. I have finally found a paper-grading rubric that yields grades I am (usually) happy with, but it works because it grades on a 4-point (i.e. GPA) scale, rather than on the 100-point (percentage) scale that students are used to. Explaining it to unhappy students has been difficult, but I can't figure out how to convert it.

3. This one's really basic: putting the desks in a circle went a long way to eliminating distracting side conversations. Last year, my classroom layout made circling desks impossible, and I had to resort to docking participation points for classroom distractions instead. Preventing the distractions in the first place was much more effective.

4. Providing students with a "creative option" on some assignments also worked out well. Not many students chose this option, but the assignments of those who did were exceptionally good. I'm not entirely sure why, but I know it's not because these students are the best ones in the class. I'd like to think it was because the creative option required them to think about the content on a deeper level in order to transform it into something new. I just hope it wasn't bias on my part (as in, "Oh boy--a break from the monotony! This is great work!").

5. Switching the focus of the final exam from course content to critical reading, thinking, and writing skills (with specific reference to texts read for class; basically, I gave them short passages from course texts and authors and a series of reading comprehension questions for each passage) worked out well, although there's still room for improvement. Last year I discovered how difficult it was to create a content-focused exam for a discussion course, especially when the discussion didn't always go the same direction in both sections. Sure, students were responsible for all the assigned reading, but for many of them, this was their first exposure to primary sources, and I didn't think it was fair to put something on the exam that I wasn't absolutely sure we talked about in class. This year I reasoned that since the main objectives of the course were to teach students to read a variety of genres of theological literature critically, to interact with them intelligently, and to write persuasively, the final exam should test those skills more than course content. The students will have to take additional theology courses at CUA, anyway, and those courses will focus on content mastery. The exam worked well, although since I didn't think to give a pretest at the beginning of the semester, I have no hard evidence to show how much progress the students made in acquiring these skills. Also, in hindsight, I think that I should have included an objective (matching or fill in the blank) section testing the students on their grasp of essential terms that they will run across later on.

What didn't work/needs improvement:

1. Reading quizzes didn't do enough to convince students to read in preparation for class. Many students were content to take their chances by guessing on the questions. I could eliminate guesswork by making the questions short answer or fill in the blank, but it was difficult to come up with questions that were easy enough to ensure that the students who really did the reading would be able to remember the answers but difficult enough to make blind guessing unprofitable. I could also weight the quizzes more heavily than I currently do.

2. Related to #1, reducing the length of reading passages also did not result in increased class participation. If anything, the number of students who read the texts actually declined (as the book Academically Adrift, which will be the subject of my next post, confirms).

3. The class session on speed reading was a bust this year. I had one student tell me "please don't assign speed reading ever again," even though I didn't have an assignment connected with the lesson and had no plans to grade anyone on their mastery of the techniques. I guess the latter didn't come across clearly in class. I think I will (mostly) take her advice, though. The "above-the-line" technique is easy to teach and master and has the potential to double reading speed instantly, so I think I will continue to teach it in class. But the full technique takes more than one session to learn and really needs to have homework attached to it for students to master. I may offer to teach it as a workshop series, but I don't think I'll attempt it again as a stand-alone lesson in a theology course, even if one of the major goals is to teach reading skills.

4. I need to improve my ability to rephrase the questions I ask in class discussions. I have this problem in Sunday School, too--I know what's in my head, but I can't seem to express it in a way that gets others there.

5. The rubric I used to grade the group presentations graded too highly. I'm pretty sure this is because I reverted to a percentage rubric (i.e. content is worth up to 55 points out of 100, observing time limits is worth up to 10 points, etc.) instead of using the GPA/"quality" system that worked so well for the written assignments. But GPA rubrics only work--I think--in cases where all grading criteria are weighted equally, and I don't think I want to weight observance of time limits equally with mastery of content. I'm not sure how to fix this.

6. The critical bibliographical essay assignment (honors section only) was a good idea, and the students seemed to appreciate the challenge. Most papers were good, and a few were excellent, but others had serious deficiencies relating either to poor or uninformed source selection or to an over-reliance on personal opinion instead of critical analysis. I'll definitely use this assignment again, but I need to provide more supervision of students' source choices (i.e., requiring them to submit abstracts for all three sources instead of only one) in order to make sure they don't paint themselves into a corner. Several students left my class still confused about the appropriateness of sources for academic papers, and that's unacceptable.

Other things I've learned:

1. Teaching is every bit as exhausting as being a student, although it's a different kind of tired. I was surprised at how much it took out of me last year. An experienced teacher explained that teaching is a kind of performance--inspiring and engaging students takes a fair amount of energy, both physical and mental. I have a new appreciation for elementary and preschool teachers--I can not imagine how much more tiring their jobs must be than mine.

2. Some students still see only what they wish the text says instead of what it actually says, no matter how you try to steer the discussion ("Is that really what Augustine is saying here?") or how many times you make this comment on their papers. I'm still trying to figure out how to get through to these students.

3. Some students just don't follow directions, even when they have an instruction sheet for an assignment in front of them. No one should have lost "format" points on papers, but about a third of one class consistently did, in spite of my repeated red inking and comments, both on papers and in class.

4. Related to #2 and #3, some students don't read the comments I make on papers and thus don't learn as much as they could from the experience. I was amazed at the number of "final" annotated bibliographies that I received that hadn't incorporated a single correction from the draft, although in hindsight (we all know this generation doesn't read much) I shouldn't have been so surprised.

5. Reducing student workload does not improve the quality of students' work. If anything, it has the opposite effect, as students either forget about or push to the side assignments that are less time-consuming. The old adage, "if you want a job done, give it to a busy person" applies here as well.

My faculty mentors have said that it takes two revisions of a course to get it exactly the way you want it, and this was only my second year (one revision). I tried several things differently this year, and for the most part, I would say that the overall experience was better. But there's still plenty of room for improvement, and I do think that one more revision would do the trick. So it was with some reluctance that I turned down the opportunity to return for a third year. The teacher part of me wants one more chance to get it right. The Ph.D. candidate part of me, however, knows that hiring committees consider how long it took an applicant to finish his/her degree, and that time is not on my side. I've been a student too long already, and teaching cuts heavily into writing time. I've recorded my ideas for next time here, and the sooner I finish the dissertation, the sooner "next time" will arrive.

No comments:

Post a Comment