How can teachers determine whether students are making appropriate progress?
Page 6: Administer, Score, and Graph
Now that the teacher has prepared a graph for each of her students, she is ready to administer and score GOM mathematic measures. The teacher should take care to ensure fidelity of implementation by following any accompanying guidelines for the measure. After the teacher has administered and scored each probe, she should graph each student’s scores to create a visual representation of his performance over time. Read on to learn more about this process.
The teacher should administer the selected progress monitoring measure frequently and at regular intervals. Some commercially available measures indicate how frequently the measure should be administered. Some measures are designed to be used weekly or bi-weekly, others once or twice a month. However, progress monitoring measures should be administered once per month at a minimum.
Mathematics measures can be administered in a variety of ways. These include:
- Individually — The teacher administers the measures to individual students; this might be required for any grade level but is almost always the case for early numeracy skills, like oral counting or number identification.
- In groups — The teacher administers the measures to the entire class at the same time.
- Using a computer — Students individually complete the measures on a computer.
Regardless of how they are administered, the teacher will time the probe. Students should try to complete as many problems or questions as possible during the allotted period, typically between two to ten minutes, depending on the grade level and the type of measure.
Tips for Administering Probes
- Explain to students that although they may not get a lot of correct answers on the probes at first, as the year progresses and as they learn new skills, their performance will continue to improve.
- Establish consistent administration procedures. Doing so facilitates the comparison of student performance over time and helps confirm that their scores are accurate reflections of their ability and not the result of inconsistent administration.
- Administer both computation probes and concept and application probes at the same time of day, one after another, and in the same order.
- Make sure students with disabilities whose individualized education programs (IEPs) specify testing accommodations receive the accommodations each time a probe is administered.
View the video below to see a teacher individually administering a number identification measure. Notice how the teacher provides precise directions, carefully following the administration guidelines associated with that measure to ensure implementation fidelity and accurate measurement (time: 1:30).
Source: National Center on Intensive Intervention
Commercially available probes come with detailed, standardized procedures to produce reliable and valid scores. Failing to follow these procedures can lead to inaccurate and misleading conclusions. In general, scoring a computation or a concepts and applications probe is simply a matter of determining how many items the student has solved correctly. However, depending on the grade level of the students, some additional scoring options might be available.
Elementary: In the case of elementary students, teachers have the additional option of scoring computation probes according to the number of digits correct. Regardless of whether they score by problems correct or digits correct, teachers in all classes and grades at a given school should score probes in the same way so that the scores are comparable. Click the link below for examples of an elementary computation probe that has been scored using both number of digits correct and number of problems correct.
The following elementary computation probe has been scored using two different methods: scoring by number of digits correct and scoring by number of problems correct.
Secondary: For students in middle and high school, problems should be scored by the number of problems correct. In the case of multi-step problems, partial credit can be given for correctly performed steps. Click the link below for an example of a scored secondary computation probe.
The sample secondary computation probe below is designed to assess students’ basic algebraic skills. Note that a normal probe would contain 60 questions and allow students five minutes to complete them. This 30-item example, which is the first of a two-page probe, is presented here for the sake of brevity and illustrative purposes. Anna has taken this probe and scored 22 problems correct out of 60. The 14 in the bottom right-hand corner of the sheet indicates the number Anna completed correctly out of this page’s 30 questions. To grade the probe, her teacher follows the standard scoring rules:
- Ignore skipped problems
- Accept mathematically equivalent answers
- Mark correct answers with a “C”
- Mark incorrect answers with a slash (/)
Anna’s final score on the probe is the number of questions she answered correctly.
Project AAIMS. (2014). Project AAIMS algebra progress monitoring measures [Algebra Basic Skills, Algebra Foundations]. Ames, IA: Iowa State University, College of Human Sciences, School of Education, Project AAIMS.
Although scoring probes using digits correct is a viable option at the elementary level, it is not recommended at the secondary level. Listen as Lynn Fuchs points out several issues that school personnel should consider as they decide whether to score probes by the number of digits correct or problems correct (time: 1:05). Next, Brad Witzel discusses the reasoning behind giving partial credit for correctly performed steps in multi-step problems. (time: 1:04).
Lynn Fuchs, PhD
Dunn Family Chair in Psychoeducational Assessment
Department of Special Education
Brad Witzel, PhD
Professor of Special Education
Most companies that provide progress monitoring measures include a tool that graphs students’ test scores, or data. Alternatively, the teacher or the student can graph the scores on paper or by using a graphing program or application. Regardless, by examining the data on the GOM graph, the teacher can determine whether a student is making adequate progress.
Ms. Wu has been administering computation probes to her students for the last six weeks. Recall that Raymond is taking a 1st-grade test because he is performing far below grade level. Raymond’s most recent computation test (week six) is below. Score this test for digits correct. Enter your answer below:
Now on the graph below, plot Raymond’s last 6 weeks of computation scores. The box below contains Raymond’s data for the previous 5 weeks: 6, 7, 6, 8, 7. The test you scored should be entered for week 6.
- Week 1=6
- Week 2=7
- Week 3=6
- Week 4=8
- Week 5=7
- Week 6=?
- This probe is a white sheet of paper labeled “Computation Probe” and has spaces to fill in the student’s name and date across the top of the page.
- The page is divided into five columns and five rows.
- The computation problems are adding two or three single-digit numbers, adding two two-digit numbers, subtracting two single-digit numbers, and subtracting a single-digit number from a two-digit number.
- Raymond has completed nine of the problems: 9 + 1, 9 – 7, 8 + 1, 7 – 5, 8 + 1 + 0, 5 + 1, 6 – 2, and 1 + 7 + 1. He has left the rest of the problems blank.Raymond’s teacher has marked two of the problems incorrect. Raymond added 10 and 3 instead of subtracting as the problem instructed him to do. Similarly, he added 7 to 5 instead of subtracting.