Wednesday, July 22, 2015

SUMMATIVE ASSESSMENT

Summative assessments are used to evaluate student learning, skill acquisition, and academic achievement at the conclusion of a defined instructional period—typically at the end of a project, unit, course, semester, program, or school year. Generally speaking, summative assessments are defined by three major criteria:

·         The tests, assignments, or projects are used to determine whether students have learned what they were expected to learn. In other words, what makes an assessment “summative” is not the design of the test, assignment, or self-evaluation, per se, but the way it is used—i.e., to determine whether and to what degree students have learned the material they have been taught.
·         Summative assessments are given at the conclusion of a specific instructional period, and therefore they are generally evaluative, rather than diagnostic—i.e., they are more appropriately used to determine learning progress and achievement, evaluate the effectiveness of educational programs, measure progress toward improvement goals, or make course-placement decisions, among other possible applications.
·         Summative-assessment results are often recorded as scores or grades that are then factored into a student’s permanent academic record, whether they end up as letter grades on a report card or test scores used in the college-admissions process. While summative assessments are typically a major component of the grading process in most districts, schools, and courses, not all assessments considered to be summative are graded.

Summative assessments are commonly contrasted with formative assessments, which collect detailed information that educators can use to improve instruction and student learning while it’s happening. In other words, formative assessments are often said to be for learning, while summative assessments are of learning. Or as assessment expert Paul Black put it, “When the cook tastes the soup, that’s formative assessment. When the customer tastes the soup, that’s summative assessment.” It should be noted, however, that the distinction betweenformative and summative is often fuzzy in practice, and educators may have divergent interpretations and opinions on the subject.
Some of the most well-known and widely discussed examples of summative assessments are the standardized tests administered by states and testing organizations, usually in math, reading, writing, and science. Other examples of summative assessments include:
·         End-of-unit or chapter tests.
·         End-of-term or semester tests.
·         Standardized tests that are used to for the purposes of school accountability, college admissions (e.g., the SAT or ACT), or end-of-course evaluation (e.g., Advanced Placement or International Baccalaureate exams).
·         Culminating demonstrations of learning or other forms of “performance assessment,” such as portfolios of student work that are collected over time and evaluated by teachers or capstone projects that students work on over extended periods of time and that they present and defend at the conclusion of a school year or their high school education.
While most summative assessments are given at the conclusion of an instructional period, some summative assessments can still be used diagnostically. For example, the growing availability of student data, made possible by online grading systems and databases, can give teachers access to assessment results from previous years or other courses. By reviewing this data, teachers may be able to identify students more likely to struggle academically in certain subject areas or with certain concepts. In addition, students may be allowed to take some summative tests multiple times, and teachers might use the results to help prepare students for future administrations of the test.
It should also be noted that districts and schools may use “interim” or “benchmark” tests to monitor the academic progress of students and determine whether they are on track to mastering the material that will be evaluated on end-of-course tests or standardized tests. Some educators consider interim tests to be formative, since they are often used diagnostically to inform instructional modifications, but others may consider them to be summative. There is ongoing debate in the education community about this distinction, and interim assessments may defined differently from place to place. See formative assessment for a more detailed discussion.

Reform

While educators have arguably been using “summative assessments” in various forms since the invention of schools and teaching, summative assessments have in recent decades become components of larger school-improvement efforts. As they always have, summative assessments can help teachers determine whether students are making adequate academic progress or meeting expected learning standards, and results may be used to inform modifications to instructional techniques, lesson designs, or teaching materials the next time a course, unit, or lesson is taught. Yet perhaps the biggest changes in the use of summative assessments have resulted from state and federal policies aimed at improving public education—specifically, standardized high-stakes tests used to make important decisions about schools, teachers, and students.

Debate


While there is little disagreement among educators about the need for or utility of summative assessments, debates and disagreements tend to center on issues of fairness and effectiveness, especially when summative-assessment results are used for high-stakes purposes. In these cases, educators, experts, reformers, policy makers, and others may debate whether assessments are being designed and used appropriately, or whether high-stakes tests are either beneficial or harmful to the educational process. For more detailed discussions of these issues, see high-stakes test, measurement error, test accommodations, test bias, score inflation,standardized test, and value-added measures.

Tuesday, July 21, 2015

Objective and Subjective Tests

Purpose of Model


Assessment: The process of evaluating the knowledge, skills, or beliefs of a student. The assessments can be objective or subjective. 

Objective Assessments - Questions on a tests that only have one correct answer (usually true or false, multiple choice, matching questions).
Assuming that all students in a classroom are taught the same material, these assessments are good for recalling factual knowledge. This test tends to be more reliable than the subjective test.

Subjective Assessments - Questions on a test that have more than one correct answer (usually short answer essay, open response essays, and problem solving questions).
The educator's judgement determines the final grade.  The open response and essay questions take longer than Objective tests. That is why there is usually a smaller amount of these questions on a test.


Research Basis

Throughout our research, we found that although objective test are reliable when designed effectively; they still do not offer a true sense of the child’s comprehension. Both tests take about the same amount of time to prepare and correct. There is more effort that goes into correcting subjective tests, but at the same time there is more planning involved when preparing objective tests.

Important Facts to Know:
·         Frederick J. Kelley in 1914 was recognized for creating the Multiple choice questions at the University of Kansas.

·         "The first uses of Multiple choice questions was to access the capabilities of World War I military recruits." (Wikipedia - multiple choice).

·         The first author to expose his work in the form of essays was Michel de Montaigne (1533-1592). His first essays were composed in 1572 and published in 1580 entitled Essais. 



Characteristics

 Objective Test

1.   Multiple Choice

2.   True - False

3.   Matching and Completion


Subjective Test

1.   Short answer essay

2.   Open response Essay 

3.   Problem solving

Before generating these types of tests in class, teachers might want to go by some of these procedures:


·        Generate a set of questions.

·        Arrange the layout of application (questionnaire, true-false, multiple choice).

·        Decide which questions will be on the test. 

·        Establish a grading scale for test.



Administration Implications


Throughout our research, we found that there is not enough training on designing tests for teachers. Designing tests needs to be more included in Professional Development courses so that Objective tests can be move beneficial to the students that are taking them. We found that are not aware of the undertaking that is involved in test designing. Test designing is so involved; it is not merely constructing test questions. Administrators need to be aware of the teacher’s capabilities and provide access to the appropriate training and professional development.

Tips for Designing Tests:
True-False

·Test only one idea in each item
·Write items that are either true or false without any qualifications 
·Be cautious when using negatives
·Maintain a Balance with items and correct responses
Multiple Choice

·Avoid using “all of the above” or “none of the above” options
·Arrange responses in logical order 
·Avoid any clues that lead the reader to the correct answer
 Matching Items

·Use homogeneous lists
·Use brief lists, with longer phrases on the left
·Keep matching section to 10 items or less

(Greg Conderman, 2002)

 Connection To Bloom's Taxonomy (What Level?)


This assessment model closely resembles the First Level - Cognitive domain of Bloom's Taxonomy.

Cognitive Learning Level: Mental skills (knowledge)        

In this domain the person goes through these categories:


·        Knowledge - the ability to recall information.

·        Comprehension - understand the meanings of ideas and is able to explain it in his / her own words.  Can interpret, rephrase or summarize their ideas on a test.

·        Application - Apllies what is learned in class and puts it into practice.

·        Analysis-  Make distinctions between facts and assumptions.

·        Evaluation - Select the best answer or solution.

Advantages / Disadvantages of Assesing Diverse Learners

Multiple Choice 

Advantages

·         Requires less time to administer. 
·         Evaluation of the students’ knowledge is faster than subjective testing. 
·         Students’ handwriting is irrelevant to multiple choice tests (clear, comprehensible results)

Disadvantages

·         The student might not interpret the question correctly (ambiguous question). 
·         "Multiple - guess" factor.  Test- takers might attempt to guess and answer rather than choosing the correct answer. 
·         Cannot receive partial credit on an answer. (Math problems, etc.) 
·         Measure "test taking ability" and not competence or intelligence. 

Essays

Advantages

·         Students can demonstrate their understanding of a topic. 
·         Open response - allows test taker to choose an area of familiarity and expand on it. 
·         Partial credit might be given. 
·         Fewer questions than Multiple choice exams.

Disadvantages

·         The student might not interpret the question correctly (ambiguous question).

True-False

Advantages

·         Students can answer questions in short period of time
·         Large amount of content can be assessed in a short period of time 
·         Useful for assessing factual knowledge

Disadvantages

·         Students have a 50-50 chance at guessing the correct answer

Necessary Learning Environment

The students need a teacher that is well trained and equipped on designing tests in order for the test to be effective in understanding a students level of comprehension.  All to often, teachers make mistakes when designing test and the students are the ones that pay for it. Research has shown that teachers continue to use assessment techiniques when they have not been properly trained to do so.
Some of the most common mistakes are:
·         Omitting direction
·         Writing incomplete stems
·         Requesting trivial facts rather than big ideas
·         Developing ambiguous questions
·         Providing clues to test questions
·         Teachers also tend to test at the their own level of knowledge
(Greg Conderman, 2002)

Teachers that have had adequate training, know how to design a test that will optimize the effectiveness of the assessment. Teachers with adequate training know how to design a test that is conducive to learning. Teachers with adequate training know the advantages versus the disadvantages to True-False questions. They also know how to balance and score a test, and when to use negatives.