Showing posts with label NCLB. Show all posts
Showing posts with label NCLB. Show all posts

Monday, February 27, 2012

Minnesota's NCLB Waiver Will Likely Encourage Schools To Push Students Out


The Minnesota Department of Education (MDE) recently released a Q&A document about the new NCLB waiver the state got from the U.S. Department of Education. Reading through this document I have many many questions and many many concerns. Though the name of the new education law in Minnesota (and 9 other states as well) may sound nice the provisions leave me with some concerns. This policy is like the bystanders at the scene of an accident who think they are saving the life of someone in a crashed car by moving them out of it when in fact that movement might just be what snaps the victim's neck. I worry this policy will do this to education in our state.

Lets go through some of the statements from the Q& A that I find most bothersome or alarming:

"The Multiple Measurements Rating (MMR) that replaces Adequate Yearly Progress (AYP) as the primary measurement of school performance. The MMR looks at a proficiency, growth, achievement gap reduction and graduation rates."

This MMR rating system is still very short of being comprehensive as it only measures schools according to criteria that fall in line with the "All growth is good/Progress" frame of thought. There is nothing in this formula that measures the quality of life within the school walls, how happy students are, how schools impact student self-esteem, or even how well they prepare them for the "real world." What about measuring student retention rates as well as graduation rates? What about measuring attendance rates? What about student and parent satisfaction ratings? No. This MMR still places faith in the almighty bubble and assumes that multiple choice assessment tests measure what we think they do and that they are an equitable tool for measurement.

"Nothing in the assessments themselves will change under the waiver. Nor will the requirements for students to take the assessments change."

Then why did we pursue the waiver? What in blazes does it do for our state? This will do nothing to slow the decline and decay of things people actually value in the schools (the arts, school sports, student projects, community service, etc.). In fact, as we shall see later, it will likely make these things worse for those attending the poorest schools, especially in large districts.

"Nothing in the waiver changes the state's rigorous academic standards in any way. The statewide standards remain in place. What has changed is the way we measure schools' ability to help students meet those standards."
These standards are based on a wholly ill-conceived notion in the first place that all students should learn certain things at certain times in exactly the same way. The standards are far less about student learning than they are about restricting what is officially recognized as student learning. But, we are far from a point where we are going to see an end in sight to the standards movement so I never expected an NCLB waiver to shrug off all the excess baggage we have accumulated over the years since A Nation at Risk.

"Using the Minnesota Growth Model, each student is given a growth score based on how their assessment score compares to their predicted assessment score. Predicted scores are generated by looking at the statewide averages for each score from year-to-year."
So, according to MDE the equitable way to measure student growth is with a norm-referenced test? This sounds GREAT for those schools serving predominately poor minority students with cultural differences test makers rarely consider when drafting their questions. Not to mention the fact that most child development psychologists will tell you that children tend to make learning gains in spurts. Did anyone consult any experts on learning when this policy was drafted?

"As with the previous NCLB system, all schools, regardless of Title I status, will be measured for accountability. Every school will continue to receive an AYP determination, and every school will now get an MMR as well. However, the new school designations (Reward, Celebration, Focus, Priority and Continuous Improvement) will only apply to Title I schools."
So, just like NCLB, the only schools this really affects are those serving poor students. And, to add insult to injury we are going to implement, only for the poor schools, a ranking system that will either punish schools by putting them on an altogether separate list aside from the AYP list (which isn't going away despite the waiver) or punish them with "Rewards" (see Alfie Kohn). Again, this all hinges upon a faith-based assumption that the tests used to make these determinations actually measure what MDE and DOE think they measure. They don't. NCLB has been a kind of witch hunt but this waiver will only throw fuel on those torch flames and give the public more pitch forks to go after teachers and schools.

"The MMR and new accountability designations are directed exclusively at schools. However, districts will continue to receive annual AYP determinations."
Here is one of two major problems I have with this waiver. For small districts with only one school for each grade level this won't be a problem but for urban and suburban districts this undoubtedly punishes the students in the poorest schools for an inequity created by the district their schools are in. By relieving districts of responsibility for their lowest-performing schools and placing all accountability on those schools the students who for one reason or another are stuck in those schools are the ones who will be punished. In those large districts teachers with more seniority will likely transfer out of those schools to places where the MMR and AYP police are not going to be riding their coat tails leaving these schools mostly staffed with young, inexperienced teachers (a group with high turnover rate that now has been encouraged by organizations like Teach for America that has now established a presence in these districts). Essentially what this policy will do is ensure that the poorest students in our urban schools will not have access to highly-qualified experienced teachers.

"There will no longer be any mandatory set-asides for staff development."
This doesn't sound very much like the NCLB waiver has actual school improvement in mind. Why on Earth, if you are concerned with school improvement for our most needy schools, would you eliminate teacher professional development requirements? Makes no sense.

The other major problem I have with this waiver, and why I think this is bad for students, is that under the new MMR the only students who's scores matter are the ones who have attended the school for one full year. This means that schools have an incentive to pass along students who are under-performing, who are not making the kinds of gains that would improve the school's MMR. When I taught at an alternative school I saw this trend all the time with some of our most at-risk students. They would bounce from school to school (some just to avoid truancy officers but others who were pushed out) and never see the consistency needed to establish meaningful relationships with staff or make a committed connection with their studies. We are going to create incentives for schools to do more of this and not just with "at-risk" students, now all students who are not "progressing" fast enough will be at risk of being pushed out. Minnesota might be able to increase their MMR scores but only by fudging the numbers.

I have seen this strategy done before. Back then they called it the Texas Miracle and then Governor George W. Bush used it to claim on the campaign trail that he was going to become the Education President.

Thursday, April 21, 2011

Weekly Tech Tip: Making and Using Infographics

I am sorry it has been so long since my last Weekly Tech Tip but we have been doing state testing this month. This eats up district bandwidth so most use is prohibited for both students and teachers. Use of the Internet interferes with the ability for Pearson Education to deliver online assessments for both Math and Science and since we can only test a handful of kids at time (due to how much bandwidth it uses) it takes nearly the whole month to get all these students tested. As a result, most of this week's tech tip had to be done without the use of the Internet. I have also been assigned to proctor these tests so I couldn't talk while making this week's tech tip. I apologize for the lack of narration. Anyway, this week's tech tip is on infographics and how they can be used to help students make sense of numbers while analyzing complex problems using data and statistics. Since I have been knee deep in state testing I thought data regarding testing would make for an appropriate data set for this tech tip. Enjoy.

Weekly Tech Tip:


related links:
  • Infographic Generators:
Video Festival:
Link Stew:
Blog Carnival:

Retweetable Tweets:

Where there's smoke, there's fire. Where there are standards, there's standardized testing.less than a minute ago via Twitter for Mac Favorite Retweet Reply



@DianeRavitch Principal of my child's NYC charter school has asked the Board to change her title to Chief Education Officer - yes, CEO.less than a minute ago via Twitter for iPhone Favorite Retweet Reply



Here are some amazing videos related to mathematics. http://bit.ly/gc9muG #edchat #mathchatless than a minute ago via TweetDeck Favorite Retweet Reply



@markgarrison "'tchr wanted to know if they learn schoology today, are they going to have to learn something new in five years.' I hope so"less than a minute ago via Power Twitter Favorite Retweet Reply



Dewey: what the best and wisest parent wants for his child is what we should want for all children...anything less..destroys our democracyless than a minute ago via web Favorite Retweet Reply


On CNN just now, @m_rhee just said that the impact of a great teacher is "immeasurable." She said it herself.less than a minute ago via TweetDeck Favorite Retweet Reply


. @techlearning The "pro-teacher" language of individualism & personlization is code for drill & a steady diet of standardized testing.less than a minute ago via web Favorite Retweet Reply


@garystager it's staggering to think abt the cost of testing in US- supposed to be cheap, efficient- NOT.less than a minute ago via TweetDeck Favorite Retweet Reply


@DianeRavitch Maybe it's time to inform #parents that they can opt their kids out of #standardizedtests -- especially unreasonable onesless than a minute ago via web Favorite Retweet Reply

Tuesday, April 19, 2011

Make Your Own Infographics - How State Testing Impacts Technology Access

Yesterday I crunched some numbers and posted some infographics showing a conservative estimate of how much money standardized testing is costing schools. In reality the amount the state spends is probably much larger since this figure doesn't account for the salaries of employees at the Minnesota Department of Education whose jobs are either explicitly devoted to or have come to be consumed with test-driven data. It also doesn't account for the benefits packages of many of the employee salaries included in my figures. It doesn't account for capital expenses or utilities spent in the service of testing or test prep including computer labs, electricity, buildings, heating costs, maintenance staff, and all the other things that schools spend money on to keep their buildings operational. One could, I suppose, figure out what percentage of the school year is monopolized by these high stakes tests and their subsequent culture and paraphernalia. If all those were factored in, the actual cost of standardized testing becomes astronomical.

Today, however, I would like to focus on how these high stakes tests impact student access to school technology resources, namely computer technology.

Now school districts vary slightly their student contact days but most schools in Minnesota are in session around 172 days per year. Of those days:
  • 20 monopolize district technology resources for the MCAs. This includes not only student-use computers but also the internet and intranet throughout the district. So, even if a teacher's class is not being tested their classroom use of technology (either student computer stations or teacher computer including whatever machine they might use to display content on an interactive whiteboard).
  • 60 monopolize district technology resources for the NWEA. The same issues regarding Internet and intranet also apply.
  • 60 monopolize district technology resources for online test prep.
This leaves 32 instructional days where both the Internet and student computer labs are accessible to students for something other than testing or practice testing. This is shown in this infographic I created the other day using ManyEyes:

School District Technology Use Many Eyes
In those 32 days where district technology is not monopolized by testing or test prep scarce resources must be shared. This means that if district technology resources are only available for 18.6% of the year for higher-order learning experiences and those resources have to be shared that in a school with a 4:1 ratio of students to computers that they are really only available 6.2% of the time.

So, if testing and test prep monopolize 81.4% of the school's technology resources then we can clearly attribute that percentage of the district technology costs to the impact of testing.

But, lets take just a conservative estimate and only take a small percentage of these expenditures into our definitive figure for our running tally of how much state testing costs Minnesota. To do this we will assume that two computer labs in each building are utilized for testing and/or test prep. If these labs are on a 7 year replacement cycle then the equation to figure this out would look something like the following:

f(technology cost of testing)=2[(Cost of a computer lab X .814)/7] + (annual cost of internet * .814)

So, lets say the average computer lab costs $30,000 and the annual cost for internet in each school is around $30,000 (taken from my own school district data) then:

f(technology cost of testing)=2[($30,000 X .814)/7] + ($30,000 * .814)
f(technology cost of testing)=2[($24,420)/7] + ($24,420)
f(technology cost of testing)=2($3,488.57) + ($24,420)
f(technology cost of testing)=$6,977.14 + $24,420
f(technology cost of testing)=$31,397.14

So, according to the state website Minnesota has 2,637 schools so multiply f(technology cost of testing) by this number and we should have a conservative estimate of how much expense is spent on technology alone. That ends up being: $82,794,258

Add that to the running total from my last post we are now at:

$939 Million Dollars



Of course, if it were not for these tests most of this money would still be spent but it would be spent differently. Still the only discernible extra spending I can find so far is the $72 million dollars I discussed yesterday.

Monday, April 18, 2011

Make Your Own Infographics - What State Testing Costs Minnesota Schools

Ok, so far I have used Wordle, StatsPlanet, ManyEyes, and Gapminder to create infographics. But, when it comes to visualizing data, often the best infographics are ones you create yourself using a plain old image editor. For the following infographics I am going to use a combination of Microsoft Excel to calculate the data and Paint.net to spruce things up.

So, lets start with a baseline. $23 million is what the state of Minnesota pays Pearson Education each year to manage the Minnesota Comprehensive Assessment Tests in Math, Science, Reading, and Writing.


So, what could the state of Minnesota buy with that $23 million dollars?

Lets assume that each of these six teachers = 10 teachers:

And lets assume that this school bus = 1 field trip for every classroom of 25 children in the State.


And, lets assume that every book in this stack represents one book averaging $25/ea given to each classroom in the state of Minnesota:
And, lets assume that this laptop represents 1 laptop for each classroom in the state of Minnesota:

And, lets assume that this iPod Touch represents 1 hand-held multi-touch mobile computing device per classroom in the state of Minnesota:

So, what would $23 Million Dollars buy?


Now, the actual cost of testing goes beyond what we pay Pearson Education. These tests alone cost the district quite a bit in time, money, and resources to administer. Pearson does not provide proctors or testing equipment to schools so schools are left footing the bill for this. So, how much does it cost school districts each year?

Now, in my experience a school can only realistically test 25 students a time for a computer-based assessment. The state of Minnesota has 823,826.00 students in public school. But, tests are only given to 4 grade levels. If we divide the total number of students by 13 we will get an average number per grade level, then if we multiply that number by 4 we will get a good idea of how many students will be taking these tests. If we divide that number by 25 we get a conservative estimate of how many proctoring sessions for each computer-based test (Math & Science). Now, most schools I have worked in take all students taking a paper and pencil test and herd them into a large auditorium or cafeteria and get that test done all at once so for that we can take the number of schools in the state and multiply it by two to get the number of days it takes to proctor (assuming one session takes 1/2 a day).

Number of students......................................823,826.00
divide by 13 multiplied by 4
Number of students taking tests.................253,484.92
divide by 25 then multiply by 2
Number of proctoring sessions for
Math & Science.................................................20,287.79
Number of schools in Minnesota............................2,637
Multiply by 4
Number of Reading & Writing Test Sessions.....10,548
Add number of proctoring sessions for all tests
Total number of proctoring sessions..............30,826.79
# of proctor sessions per day per school.......................2
# of teachers needed to proctor tests............................3
Average Daily Salary + Benefits for a teacher..$327.87
Divide the total number of session by 2, multiply by 3, then multiply by cost of teachers
Cost for test proctors................................$15,160,718.28


So, it costs the state of Minnesota a total of $15,160,718.28 just for test proctors.
Now that $23 Million is more like $38 Million. Now, these funds are not ones that can be recouped but the time these teachers spend proctoring tests could be reallocated for other purposes if it was not for testing.

Of course, this is not the end of it. Since test results are somewhat difficult and cumbersome to analyze, and since these tests have such high stakes attached to them, most districts have hired someone to be their data analyst and testing coordinator. Sometimes this is a teacher position but usually it is an administrator which means it costs districts more to hire them. Lets just take a conservative estimate and say the way districts do this is 50/50. If the average teacher salary for someone near the top of the salary ladder is $60,000 (assuming that a district is not going to hire a new and inexperienced teacher for this position) and the average school administrator makes around $100,000 then half-way between is somewhere around $80,000. For sake of being conservative in our estimate lets leave out benefits for this one, which would ultimately drive the cost even higher. If there are 543 school districts in the state and each one needs a data specialist/test coordinator then that cost will be:

$80,000 X 543 = $43,440,000 annually for data specialists/testing coordinators

It is highly likely that most districts would not have this expense if it were not for the high-stakes testing required by NCLB. This means that we can add this number to the the $23 Million as extra spending.

Now both because Pearson does not release test results until well into the summer when it is hard to use them to differentiate instruction and because expensive data specialists need to justify the expense of their jobs, most school districts also use NWEA tests to get actionable data throughout the year on student achievement. The NWEA tests give immediate feedback and the subscription cost is fairly low but the tests are online, given for every grade level, and done quarterly. Which means, the actual cost to districts is much higher than the sticker price.

Assuming that every district decided to use this NWEA test the subscription alone would cost:

543 districts X $5,000 = $2,715,000 in NWEA subscriptions

Now this number is also additional spending and can be added to our running tally which is now:

$69,155,000

So, what is the cost for proctoring these tests? Lets find out:

Number of students in the state..................823,826.00
divide by 25 then multiply by 3
Total number of proctoring sessions..............98,859.12
# of proctor sessions per day per school.......................2
# of teachers needed to proctor tests............................3
Average Daily Salary + Benefits for a teacher..$327.87
Divide the total number of session by 2, multiply by 3, then multiply by cost of teachers
Cost for test proctors................................$194,476,957.38


Of course, since these tests have such high stakes attached to them most districts end up spending money on test-prep curriculum like Study Island. It is highly doubtful teachers or districts would use such a tool if it were not for the high-stakes of these tests. But, schools need students to learn how to take tests and be used to taking them online because in the NCLB world test taking is an important life skill. Lets assume that between Study Island and other test-prep curriculum districts spend money on that they average $5,000 a year for curriculum and subscription fees. Seems like a small price to pay for better test scores.

543 school districts X $5,000 = $2,715,000 in Test-Prep Curriculum

But, buying curriculum also means time devoted to implementing it. In the districts I have worked in, teachers have felt pressure to use this drill and practice curriculum that emphasizes low-level cognitive skills such as data recall and decoding. So how much of our tax dollars go to paying for this implementation?

Number of students......................................823,826.00
divide by 25
Total number of classrooms...........................32,953.04
# of days doing test prep for NWEA = 20 x 3 = 60 / 7 class periods * 4 tested subjects
# of days doing test prep for MCA = 20 / 7 class periods * 4 tested subjects
Average Daily Salary + Benefits for a teacher..$327.87
Cost to deliver test prep curriculum...................$493,909,733.02


So, total cost of ownership for these high-stakes tests is: $856 Million Dollars

and the total amount that would not be immediately reallocated toward other purposes:


What could the state do with $72 Million Dollars?



So, what kind of data-driven decision is this?

Tomorrow I will demonstrate what this means for how often kids get to use computer labs for anything but testing or practice testing.

Thursday, April 14, 2011

Wordle Fun

I am getting ready to make one of my Weekly Tech Tip videos that I hope will be ready within about a week. State testing obligations have kind of put a wrench in my normal routine and therefore I've not been able to keep up with my regular video production schedule. I also really want this one to to drive some important points home. Since I have to submit all of these to the Minnesota Department of Education for possible inclusion in their iTunesU channel the content of this one I really want to make sure is well done. The topic of the forthcoming video will be on the use of data visualization tools and infographics to improve math comprehension. For my examples I am going to draw data from the standardized testing business we are caught in the grips of. So, while the stated purpose of the video will be to show how to use infographic tools to help people understand numbers the numbers I will be using will hopefully draw some light on the realities of what the decision to let standardized tests be the be all and end all measure of school, teacher, and student success really does.

So, since our state tests limit my bandwidth and my ability to create video I thought I would share some of the infographics I am developing for this future instructional video. Some of these may make it in the video and some may not. But, lets have some fun anyway.

I think I will start by demonstrating a tool that for many of us has become a cliche...Wordle. Now, I am not a huge fan of this tool and at this point I feel like I have seen enough of them. That said, I still think it is a useful tool for analyzing the frequency of terms used in a larger text or speech. So, I today I will apply Wordle to some of the most important documents associated with standardized testing. Perhaps it can show us something, perhaps not, I don't know.

No Child Left Behind Act:

A Nation at Risk:
The Imperative for Educational Reform:


The Principles of Scientific Management (by Fredrick Taylor):


The Core Knowledge Blog:

Well, I'm not entirely sure how these infographics are helpful or what they tell us. One thing that jumps out at me clearly is the absence of the word"Learning" from any of these Wordles.

What do you notice?

What other documents should we apply this to?

Tomorrow I will post something with numbers.