Showing posts with label FSA. Show all posts
Showing posts with label FSA. Show all posts

Monday, January 12, 2015

Standardized testing: a pillar of privatization

It's FSA season again. Every year in British Columbia, every student in grades 4 and 7 has their regular classroom schedule put on hold for two weeks while they complete the Foundation Skills Assessment (FSA) -- a collection of standardized tests mandated by the provincial government.
Every student, parent, teacher and citizen should oppose these tests. There is a litany of reasons for this, but top among them is the role standardized tests play in the very destruction of public education itself -- by privatizing a public service. Masquerading as a test for system quality, they are in fact an instrument of system change, and not change for the better. 
The origin and rationale for standardized testing dates back to the cold war. As early as the 1960s, the U.S. National Assessment of Educational Progress (NEAP), funded with a grant from the Carnegie Corporation, was promoting the use of standardized exams for comparison of states and districts. The so--called "need" for testing was ramped up in the infamous report A Nation at Risk, published by the U.S. government during the Reagan administration in 1983. The report insisted that America's schools had to do better to fend off the Soviet threat.
As an international phenomenon, testing was promulgated by the OECD in the 1990s. It developed the Programme for International Student Assessment, PISA, as a way to measure member states and compare their education systems. Since this time, member states of the OECD have been only too happy to comply. State-wide testing was mandated federally in the US through the notorious No Child Left Behind act. BC has the FSAs. Ontario the EQAO. 
BC's province wide standardized exam system has been in use since 1974, but it has changed over time. The first testing program, administered in grades 4, 8 and 12, was called the Provincial Learning Assessment Program (PLAP), and was a replacement of IQ tests. The results of the PLAP were not published but rather used internally for curriculum review and to manage the school system. But in 1984 the BC government decided to publish the results of Grade 12 provincial exams and by 1998 the Fraser Institute published its first ranking of BC schools. In 2002 the BC Liberals abolished the school accreditation system altogether and now relies on Accountability Contracts from each school district to ensure school quality. These documents, produced by school boards, in turn rely heavily on FSA test scores and are of dubious quality. All FSA results are now routinely made available by government on their web site and the Fraser Institute publishes rankings annually. Media outlets gleefully report on the best and worst schools.
Thus the FSAs, like standardized testing in many jurisdictions, has morphed in the last half century from a mechanism designed to internally review the quality of an individual education system, to a comparison tool to rank schools and districts.
The changes that took place are not accidental. They are part and parcel of the usual fare of neo-liberalism: deregulation, defunding, market based provision of services, and privatization.
How does this work? In today's BC school system, a parent can pick up the Fraser Institute rankings and use them to choose a school. Because we no longer have closed school boundaries based on neighbourhoods, they can register their child in the school of their choice. As their child progresses, they have access to a litany of special programs, such as Sports Academies and International Baccalaureate, many of which provide enhanced services through additional fees. Of course it is some parents choosing to do this -- typically immigrant families and low income families simply send their children to the neighbourhood school. Many districts are therefore experiencing a form of "white flight" out of inner city schools.
If you were Milton Friedman, one of the intellectual architects of neo-liberal policy, you would look at this happily as a variant of what he called school vouchers. Acknowledging that even in the free-est of markets, the state has a role to play to ensure basic literacy levels, he advocated that all parents receive a voucher for their state education allowance with the ability to use it at the school of their choice. Now admittedly in Friedman's world, these schools would be privately administered, but the mechanism for parent choice (testing and ranking), the market of schools, and the additional resources provided through school fees all mimic the Friedman model. The virtual school voucher is the provincial funding that follows a child to attend the school of their choice. 
The US has taken the testing craze a few more steps. Not only do they have an insane battery of tests (at least two every year from grades 3 - 8), but they have attached high stakes to these tests so that every aspect of the school system becomes "accountable" to a test score. If a school does badly, close it. If a teacher doesn't improve student test scores, fire the teacher. If universities graduate new teachers whose students do badly, shut down the teacher preparation school. 
Unfortunately, the test scores mostly reflect one thing -- the socioeconomic status of the student writing the test. The inevitable result, therefore, is that it is poor (and disproportionately black) students who are losing their teachers and losing their schools. It is no accident that the first jurisdiction to have no public schools remaining at all is New Orleans.
We can learn from our neighbours to the south, where a growing anti-test movement is sweeping the country. We have the opportunity to scrap the testing and ranking before it completely takes over our public school system. If you are a parent, please withdraw your student from the FSA. If you are a teacher, please work with your colleagues to encourage parents and others to refuse to take the tests. If you are anyone else, work with teachers and parents to end the testing mania and advocate for a school system administered by and for the public.
This article has also appeared on my rabble.ca blog

Sunday, January 27, 2013

Data representation in Achievement Reports

Amidst the flurry of op-ed pieces about BC's annual standardized testing for students in Grades four and seven, I felt my nerves fray at this quote from BC's Minister of Education:

The FSA helps parents and educators determine the students and schools in need of extra support. The results complement the assessment and reporting by teachers and help school districts direct resources to where they are needed most. Additionally, it helps the Ministry of Education identify trends to improve teaching and learning for the coming school year.
...
I believe that one of strengths of the FSA is that by sampling every child we are able to get a comprehensive picture of how students are doing.

Using random samples for the FSA would make it very difficult to get the level of detail we obtain from all our students including aboriginal students, English-language learners and students with special needs. It would not provide the individual, school and district level information critical for both student intervention and long-term planning.


Hmmm. Let's see. The provincial framework for school accountability is the Achievement Contract. Each District develops a contract which outlines how the District will address learning challenges it identifies. Then, in January, each Superintendent files a report on how well the District is meeting its goals. Given the comments above, one would assume that FSA results are a primary source for objectively identifying issues at the school and district level. Is this true?

Have a look at the recent report from Delta. http://web.deltasd.bc.ca/sites/files/Superintendent%27s%20Annual%20Report%20on%20Student%20Achievement-2012.pdf The FSA test does not appear once in the report. This District chose instead to use report card marks and six year completion statistics. Perhaps that is because, in Delta's case, the FSA results are remarkably uninteresting. Here is a graph from the results published on the Ministry web site:



Each of the FSA graphs look remarkably similar. Take a look yourself to see all six FSA results: http://www.bced.gov.bc.ca/reports/pdfs/fsa/037.pdf. Yet here is a quote from the local news report based on the Achievement report:

Students in the Delta School District are performing better than they were five years ago, according to the district’s annual student achievement contract. (http://www.southdeltaleader.com/news/187337201.html)

One can only assume that in this case, the FSA results did not "help inform" the district about achievement rates.

Another interesting example is Greater Victoria. Here is a link to the Achievement report (attached to a recent Board meeting agenda): http://www.sd61.bc.ca/super/pdf/agendas/12_13/2013_01_21.pdf

In this report, some FSA data is used, although interestingly, it is pretty selective.

The report begins with the title: What is improving? And lists several areas:
  • Dogwood completion rate for all students
  • Dogwood completion rate for aboriginal students
  • FSA results for grade 7 aboriginal students in reading, writing and numeracy
  • FSA results for grade 4 aboriginal students in numeracy
  • FSA results for grade 4 students in writing and numeracy
  • FSA results for grade 7 students in reading, writing and numeracy
Given this list, one might expect to find similar list items in the section entitled: Challenging areas - which trends in student achievement are of concert to you? In particular, I would expect to see FSA results for grade 4 aboriginal students in writing and numeracy, and FSA results for grade 4 students in reading. But these don't appear. Instead, this section reads:

"Our data indicates an upward trend in student achievement. However, despite the 19.9% improvement in completion rate for aboriginal students and the 7% improvement in completion rates for all students since 2008, we continue to be acutely focused on, and determined to improve, our Dogwood completion rate for each and every student."

There is no mention of the areas lacking improvement.

Here are the grade 4 FSA results graphs produced by the Ministry:



I'm not sure I would use the words "upward trend" to describe this data. Before making any claims, I would want to know if whatever upward movement in numbers there is was statistically significant.

Instead of using these charts, the report includes the following text:


The first thing I notice when I looked at this list, is that for each bullet, a different date range is used. Or, put another way, certain data is excluded from the analysis. Given that the Ministry provides five year data for comparison, why would some years, for some grades/subjects, be left out? What was the criteria for omitting them?

Another example is the reporting of graduation rates in this chart:



Here is another chart, from the previously published Achievement Contract (http://www.bced.gov.bc.ca/schools/sdinfo/acc_contracts/2013/61.pdf):


Looking at these two charts, I wonder why the year 2008 was selected as the start year for the data chart demonstrating "improvement" for all students?

Greater Victoria also was in the news after this report was brought to a Board Meeting. Kudos to Lindsay Kines, who reported that the graduation rates increased from 76%, the previous high, in 04/05, to 78%, the current number. This is a very different way of describing the data than the chart showing the changes beginning from the low point in 2008. (http://www.timescolonist.com/news/local/graduation-rate-reaches-new-high-in-greater-victoria-school-district-1.51362)

I have to give the Ministry some credit. At least their charts and graphs all use the same date ranges, and includes the same information for every District. They are not picking and choosing which data to publish. But the scheme for "contracting" measurable improvements and then justifying performance with numbers appears to me to be a shell game. I wonder what "long term planning" the Minister imagines is happening? What objective information can anyone get from either the selective reporting from the Districts or the plethora of un-analysed data from the Ministry? What "comprehensive picture" does the Minister see here?