Manufacturing Stupidity


I don’t usually write about education. I don’t have any special expertise or knowledge about it, and anyway, fellow Jacobin writers Andrew Hartman and Megan Erickson are on the case. But this story (via Slashdot) touches on some of my more typical themes.

The linked post is written by Rob Krampf, a science educator in Florida who found some serious problems when he was trying to develop practice materials for fifth grade students preparing for the state’s mandatory science test, the FCAT. This is one of those so-called “high stakes tests” which are the idol of the education reform movement and the bane of left-wing education critics, because they are used to dole out financial incentives or penalties to schools. But the trouble with these tests goes beyond the standard criticism of testing-focused education. In the test questions Krampf received from the state, many of the “wrong” answers turned out to be just as correct as the supposedly “right” ones. This led to an exchange with state authorities that should be read in its entirety, for the dark comedy if nothing else. Here, however, is a representative sample from the FCAT:

This sample question offers the following observations, and asks which is scientifically testable.

  1. The petals of red roses are softer than the petals of yellow roses.

  2. The song of a mockingbird is prettier than the song of a cardinal.

  3. Orange blossoms give off a sweeter smell than gardenia flowers.

  4. Sunflowers with larger petals attract more bees than sunflowers with smaller petals.

The document indicates that 4 is the correct answer, but answers 1 and 3 are also scientifically testable.

For answer 1, the Sunshine State Standards list texture as a scientifically testable property in the third grade (SC.3.P.8.3), fourth grade (SC.4.P.8.1), and fifth grade (SC.5.P.8.1), so even the State Standards say it is a scientifically correct answer.

For answer 3, smell is a matter of chemistry. Give a decent chemist the chemical makeup of the scent of two different flowers, and she will be able to tell you which smells sweeter without ever smelling them.

While this question has three correct answers, any student that answered 1 or 3 would be graded as getting the question wrong. Why use scientifically correct “wrong” answers instead of using responses that were actually incorrect? Surely someone on the Content Advisory Committee knew enough science to spot this problem.

This article is for subscribers only. Please login or subscribe to access our full archives and beautiful print and digital magazine starting at just $3 a month.