All enterprises require measurement in order to enable their management. Testing, grading and evaluation of education programs are the metrics by which we measure students, teachers and schools.
November 22 - Students, Studying, and Multiple-Choice Questions
Multiple-choice questions are not the pariah of all test questions. They can make students think and measure their mastery of material. But they can also do little more than measure mastery of memorization. Memorizing is usually an easier option than thinking and truly understanding.
When you are a math teacher you are often faced with the dilemma of whether to assign partial credit to a problem that is incorrect, but that demonstrates some knowledge of the topic. Should I give half-credit? Three points out of five? My answer has typically been to give no credit…at first. However, taking a page from my colleagues in the English department (and grad school), I do allow for revisions, which ends up being a much better solution.
October 15 - A Different Kind of Final
Last semester I implemented a different kind of final exam. In the past I have used the standard multiple-choice and short-answer exams. I was thinking about making a change when I discovered Beyond Tests and Quizzes: Creative Assessment in the College Classroom, edited by Richard J. Mezeske and Barbara A. Mezeske. The second chapter, “Concept Mapping: Assessing Pre-Service Teachers’ Understanding and Knowledge,” describes an assessment method that tests higher-level thinking. The author shared his experience using concept maps as a final exam, included an example of the final exam project, offered rubrics for grading, and discussed the advantages and disadvantages of the strategy. I decided this was the change I was going to make.
There are two main forms of assessment often used within the online classroom. Both formative and summative assessments evaluate student learning and assist instructors in guiding instructional planning and delivery. While the purpose of a summative assessment is to check for mastery following the instruction, formative assessment focuses on informing teachers in ways to improve student learning during lesson delivery (Gualden, 2010). Each type of assessment has a specific place and role within education, both traditional and online.
We give students exams for two reasons: First, we have a professional responsibility to verify their mastery of the material. Second, we give exams because they promote learning. Unfortunately, too often the first reason overshadows the second. We tend to take learning outcomes for granted. We assume the learning happens, almost automatically, provided the student studies. But what if we considered how, as designers of exam experiences, we might maximize their inherent potential? Would any of these possibilities make for more and better learning from the exams your students take?
The guidelines suggested below propose how critical thinking skills can be assessed “scientifically” in psychology courses and programs. The authors begin by noting something about psychology faculty that is true of faculty in many other disciplines, which makes this article relevant to a much larger audience. “The reluctance of psychologists to assess the critical thinking (CT) of their students seems particularly ironic given that so many endorse CT as an outcome…” (p. 5) Their goal then is to offer “practical guidelines for collecting high-quality LOA (learning outcome assessment) data that can provide a scientific basis for improving CT instruction.” (p. 5) The guidelines are relevant to individual courses as well as collections of courses that comprise degree programs. Most are relevant to courses or programs in many disciplines; others are easily made so.
April 22 - Assessing Assessment: Five Keys to Success
There are those in the academic community who dread hearing and reading about assessment. But aside from the mandatory reporting required by credentialing and accreditation agencies, how can faculty members be sure that all of the assessment activities they are required to report actually produce change and are not just more paperwork?
After going out for tacos, our students can review the restaurant on a website. They watch audiences reach a verdict on talent each season on American Idol. When they play video games—and they play them a lot—their screens are filled with status and reward metrics. And after (and sometimes while) taking our classes, they can go online to www.ratemyprofessors.com.
The liberal arts college where I teach recently underwent review for accreditation. Like many other colleges and universities, we were criticized for our lack of assessment. Faculty resistance, it seems, may be the biggest barrier to implementing institutional assessment measures (Katz, 2010; Weimer, 2013). Both Weimer and Katz accredited faculty resistance to fears that assessment data could be used for “comparison shopping” and “educational consumerism.” While these fears are justified, at my college another fear prevails; the fear that assessment will lead to hand-holding strategies that will discourage independent thought in our students and result in failure to adequately prepare them for professional life.
March 1 - The Effects of Collaborative Testing
Although letting students work together on exam questions is still not a common instructional practice, it has been used more than might be expected and in a variety of ways. Sometimes students work together in groups; other times with a partner. Sometimes those groups are assembled by the instructor and sometimes students are allowed to select their partners or group members. Sometimes the groups share multiple exam experiences; other times they work collaboratively only once. Sometimes the group submits one exam with everyone in the group receiving that grade; other times students may talk about exam questions and answers but submit exams individually.