Monitor Student Progress |
||
Both research and common sense support the notion that we need to monitor student performance on an ongoing basis. If we are ever to know where we are, we will need to know where our students are. But that is exactly what we don't know. Try asking school staff where each of their students are on the reading comprehension indicator "drawing inferences." Which of their students is proficient? What evidence do they have that those students are proficient? What evidence do they have to identify what their students who are not proficient still need to learn. In a 1998 Phi Delta Kappan article entitled, "Inside the Black Box: Raising Standards Through Classroom Assessment," authors Paul Black and Dylan Wiliam argue that standards can be raised only by changes in classrooms. They assert, "There is a body of firm evidence that formative assessment is an essential component of classroom work and that its development can raise standards of achievement. We know of no other way of raising standards for which such a strong prima facie case can be made." The ultimate goal for monitoring student progress is to ensure that all students are successful in attaining proficiency on state and district standards. Teachers need to teach and assess the indicators they are responsible for teaching on an ongoing basis so that they will know where their students are at any given time in relationship to those indicators. Teachers need to regularly ask these four questions:
How do you develop a monitoring plan? How do you create data collection templates? Why start with the monitoring plan? What do you learn from your monitoring data? What do you do with the monitoring data? Resources How do you develop a monitoring plan? Whereas, teachers need to monitor progress on the indicators they are responsible for teaching, schools need to monitor student progress on the indicators related to their school improvement goals. Schools have to identify the student achievement data they need to collect to determine if they are making progress toward the attainment of their priority goals. If a school's goal is to meet the reading AYP target, then the school will need to collect individual student data on the content standards the state measures on reading at the indicator level. The school's monitoring plan should focus on tracking individual student progress on these indicators. In order to promote ownership, principals will want staff to collaboratively develop a monitoring plan. The staff need to divvy up the indicators in ways that make instructional sense and discuss how often data need to be collected on each indicator to determine progress. They need to set deadlines for collecting and submitting the agreed upon data. The discussion should be framed around the question, "What evidence have we collected (or should we collect) that students are learning specified indicators?" If the school district has a district curriculum, staff may wish to map the state content standard indicators against the district curriculum to determine if all standards are well covered. If there are indicators not presently being addressed, the team will need to decide who will teach and assess them and when during the school year. For indicators only addressed in the first semester, teams will need to decide how best to review them with students to ensure that students maintain proficiency. Once teachers know what indicators they are responsible for teaching and assessing and how frequently they need to submit the data, they need to determine the format for recording student performance on those indicators. A discussion among teams or departments about what opportunities they could give students to demonstrate proficiency on a specific indicator should help to broaden thinking and develop some consistency in how student performance is assessed. When the state applies a specific rubric or scoring tool to their assessment of this content area, it is important for teachers to understand the criteria used to score and be able to apply the same assessment criteria to determine whether a student is likely to demonstrate proficiency on the state assessment. Planning templates were created on the School Improvement in Maryland Web site to serve as a stimulus for discussing how best to monitor individual student progress on these indicators through an ongoing collection of classroom data as part of the regular instructional program. It is important to collect data on an ongoing basis. Some schools already collect data on a quarterly basis using a common assessment. Although quarterly assessments provide information about student performance, this strategy has a number of drawbacks: 1) it often results in teachers viewing the monitoring piece as external to their instructional program, 2) it is not frequent enough to inform instruction, and 3) it does not move staff to the ultimate goal. The ultimate goal is to have teachers instructing and assessing the indicators they are responsible for teaching on an ongoing basis so that they will know where their students are at any given time and will use the information to direct their instruction. It is worth emphasizing that in addition to the student performance data collected to monitor school improvement goals, teachers may also need tools to collect student performance data on all the indicators they are responsible for teaching. In a perfectly aligned system, this would replace a teacher's gradebook that is also a data collection tool though rarely aligned with the content standard indicators. [top] How do you create data collection templates? After schools have identified the student data they need to collect to monitor progress, they will find it useful to create a data collection template (a table, grid, database, or spreadsheet) for staff to use in recording the data. The school must also decide in what format they want to record the data and where it should be submitted. Sample monitoring plans and grade book templates developed by Title I schools can be viewed on the School Improvement in Maryland Web site. [top] Why start with the monitoring plan? There is no question that the monitoring plan, in and of itself, does not address staff needs in the areas of understanding the indicators, understanding what good student work looks like on the indicator, creating good observations and interpretations of student work, and analyzing the results. Some leaders argue that you need to provide staff development on those issues before you ask staff to monitor. But that might delay moving forward on a data collection process that is critical to understanding where students are. Creating a school-wide expectation and requirement to monitor and submit student performance data on the indicators provides a focus for the discussion and a more urgent need to learn how best to examine the work. The discussion of the performance results will naturally lead back to a discussion of how best to assess proficiency on the indicator, what the student performance tells you about what students know and don't know, and how you can use the diagnostic information to plan instruction to support students in demonstrating proficiency on the indicator. That should provide a stronger motivation for acquiring the appropriate skills. [top] What do you learn from your monitoring data? You learn much more than how students are performing. You will also learn how to frame questions that provide richer opportunities to understand student performance. Before you can have a meaningful discussion about the data, you will need to know what indicator was being assessed, what question was asked, how proficiency was defined, and how the student response was scored. In the process, teachers will sometimes learn that they didn't ask a question that solicited what they were trying to assess, hadn't clearly defined proficiency, or used a rubric that was not appropriate. It is only after everyone understands these pieces that discussing the data will be meaningful. [top] What do you do with the monitoring data? The monitoring data are only useful when they are examined and used to inform instruction. Consequently, teams of teachers need to analyze and discuss the instructional implications of the data on an ongoing basis. The discussion may be focused on a number of student achievement questions:
Rick DuFour identified a number of staff development needs for teachers to collect and discuss the data that would focus them on what students were learning. In his article, "The Learning-Centered Principal," he describes his role in the following way: "As principal, I played an important role in initiating, facilitating, and sustaining the process of shifting our collective focus from teaching to learning. To make collaborative teams the primary engine of our school improvement efforts, teachers needed time to collaborate. Teachers, accustomed to working in isolation, needed focus and parameters as they transitioned to working in teams. They needed a process to follow and guiding questions to pursue. They needed training, resources, and support to overcome difficulties they encountered while developing common outcomes, writing common assessments, and analyzing student achievement data."Leading a data dialogue effectively requires a focus, data, guiding questions, and an understanding of the collaborative inquiry process. Data-driven dialogue assists teams in making shared meaning of data, in surfacing multiple perspectives, in separating data from inference, and in making data-driven decisions. Though the data are key to the dialogue, the process of collaborative inquiry drives the results. When leading the data dialogue, you will find the Seven Norms of Collaborative Work, developed by Laura Lipton and Bruce Welman, to be helpful to the process. Lipton and Wellman also advise "allowing adequate time to explore assumptions, predictions, questions, and observations before offering explanations or solutions. In doing so, groups not only reach sounder conclusions but also build their capacity to inquire and learn together." [top] Resources for Monitoring Student Progress School Improvement in Maryland Web Site Develop a Monitoring Plan is a workshop for principals and school leaders to learn how to develop and present to staff a monitoring plan. ![]() Identify Data to Be Used in Monitoring provides planning templates created as a stimulus for discussing how best to monitor individual student progress on selected indicators. Create data collection templates provides a tool to create a customized grade book to monitor selected indicators taught during a unit or a grading quarter. You can also download the Excel spreadsheets onto your desktop to further customize or graph data. Examining your Monitoring Data is a workshop on how to structure data dialogues to discuss, analyze and make instructional decisions based on the data collected in your monitoring plan. ![]() What formative assessment data should we collect? These templates help teachers identify all of the indicators under each Maryland Content Standard in reading and mathematics which have been assessed on the Maryland School Performance Assessment Program (MSPAP). http://mdk12.org/data/course/m4w2/pr2/monitoring_plans.html School staff schools discuss what they did and learned from implementing monitoring tools in their Title I elementary schools. ![]() Monitoring Student Progress leads schools through the process of developing and using a monitoring plan and shares experiences of schools as they implement their plans. ![]() Online Articles How Classroom Assessments Improve Learning by Thomas R. Guskey in the February 2003 issue of Educational Leadership argues that the assessments most likely to improve student achievement are those that teachers create. Improving Teaching and Learning with Data-Based Decisions: Asking the Right Questions and Acting on the Answers by Nancy Protheroe in the Summer 2001 issue of ERS Spectrum. Assessing Student Learning--and My Teaching--Through Student Journals by physics teacher Bill Heinmiller finds the challenges of using student journals as an embedded assessment strategy are amply repaid by the benefits. Assessing Student Understanding with Interactive-Collaborative-Electronic Learning Logs by science teacher Paul Hickman describes how technology enhances communication between student research groups and their teacher. Implementing Portfolios and Student-Led Conferences middle school teacher Jennifer Williams describes an assessment strategy that caught on with teachers of all subject areas. Using Self Evaluation with Fourth Graders by Leah Poynter describes how elementary school students learn to assess their own achievement. A Snapshot of Assessment in a Standards-Based Classroom by Carol Midgett, a member of the NCTM Standards 2000 Writing Team, describes a single classroom activity to show how assessment provides guidance for the learning journey. Inside the Black Box: Raising Standards Through Classroom Assessment by Paul Black and Dylan Wiliam in the Phi Delta Kappan argues that there is firm evidence showing that formative assessment is an essential component of classroom work and that its development can raise standards of achievement. |
||||||||||||
|
|
||||||||||||
| How Have States Implemented AYP? |
| How Have States Designed Their Accountability Systems? |
| How Do States Report Progress? |
| How Do States Provide Technical Assistance to Districts and Schools? |