that farshtunkiner test

by marjorieingall on April 14, 2010

Josie is anxious about the upcoming New York State third grade English Language Arts (ELA) and math tests. I say she doesn’t have to be perfect; she says she does. I say she just has to do her best; she says if she doesn’t get a 5 on the test, she will hate herself. WELCOME TO MY WORLD.

Unfortunately, the tests matter. Kids can be held back from 4th grade based solely on their scores, and schools can be penalized if kids aren’t deemed to have made sufficient progress from year to year. The test scores are the biggest chunk of schools’ letter grades, according to the Department of Education’s ham-fisted formula. And principals’ jobs and schools’ autonomy can ride on this flimsy data. (My kids’ school got a D last year and a B this year — but of course the school didn’t really improve that much. Tiny fluctuations in test scores were what made much of the difference, and since this is a very small school, every blip matters. Next year, I imagine we’ll go back down to a C or a D, since we won’t have made sufficient progress. And then we’ll rocket back up to a B again the year after that. It’s just like the Coney Island Cyclone! Whee!)

There’s this site called Brownie the Cow where you can take a 2006 4th grade ELA test. Dude. I’m a magna cum laude Harvard grad with a double concentration in English and Folklore & Mythology (two reading- and writing-heavy disciplines), and I had trouble. I’m a professional writer and I’m not at all sure I’d have passed. Take the writing test yourself and see what I mean.

Gah.

I do think Josie’s teacher is doing a good job preparing the kids without panicking them (Josie does that just fine on her own, alas), though it seems to me, from Jo’s reports, that a dismaying amount of instructional time is being devoted to test prep. I looked over her shoulder last night as she did a practice ELA test and my eyes bugged. I was honestly not sure of the right answers on a couple of questions.

One reading comprehension question was based on a story about a one-room schoolhouse on the frontier. The correct answer to a question about how teaching in such a school was different from the way teachers teach today? Teachers of the past had mixed-age classrooms. Uh, MY KID GOES TO A SCHOOL WITH MIXED-AGE CLASSROOMS. For any child in my child’s school, getting the question “right” means negating their own experience of school and gaming the test. Good luck with that, kids.

Then there was the question based on “The Painter and the Judge, a folktale from China.” A mean judge told a painter to make him a painting. This mean judge often failed to pay people for their work and was basically a dick. So the painter simply wrote COWS ON GRASS on a scroll of paper. “Where is the grass?” asked the mean judge. “The cows ate it,” the painter replied. “Then where are the cows?” asked the judge. The painter answered, “Seeing as they’d eaten all the grass, there wasn’t much point in them hanging around any longer, was there? So they left.”

Good story! Love it! But here’s the test question:

How was the painting the painter gave the judge different from most paintings?

A. It had no pictures on it.

B. It had real grass on it.

C. It showed cows eating grass.

D. It told a story.

Is that not a sucky question?? I could make a good argument for A or D being a fine answer. Do most paintings feature pictures (in which case, the correct answer is A) or do most paintings not tell a story (in which case, the correct answer is D)? For the answer to be A, we have to know what a picture is. Merriam-Webster defines it as “a design or representation.” So can non-representational paintings be said to have pictures on them? I don’t know, because I JUST HAD A SEIZURE. For the answer to be D, most paintings have to NOT tell a story. But many paintings tell stories, literally or figuratively. BASICALLY, I WANT TO SLAP THIS TEST QUESTION AROUND LIKE IT’S PAINT AND I’M JACKSON POLLOCK. Come on! Is this is the best question the test-makers could come up with? In 2007 the DOE signed an $80 million contract with McGraw-Hill to produce interim assessment tests to be given every six weeks as prep for the state tests. I am not opposed to measurement, or even standardized testing, as long as a) the tests are GOOD and VALID and produce USABLE DATA and b) the tests are used the way the testmakers intended, meaning they’re not super-high-stakes for any given kid. The DoE is flailing on both counts here. Veyizmir.

{ 3 trackbacks }

that farshtunkiner test, part 2
April 26, 2010 at 2:37 pm
grading your kid’s tests
April 27, 2010 at 10:23 am
“were you high when you wrote that?”
May 11, 2012 at 11:23 am

{ 7 comments… read them below or add one }

Julie Polito April 14, 2010 at 3:25 pm

Righteous rant, babe. I feel your pain (just finished the CSAP here, ugh ugh ugh.)

Mim April 14, 2010 at 3:52 pm

Man, those test questions are abysmal. just browsed the brownie the cow site and got thoroughly depressed. Am wondering what the landcspe looks like in my own home state — my kids are still too young for school, so i guess i’ll be finding out in a few years.

Jacob Davies April 14, 2010 at 4:04 pm

That’s my least favorite type of multiple-choice question: the one that has a a couple of obviously wrong answers, one answer that is right if you are fairly literal-minded and thinking at the level of the person the test is addressed to and several that could be just as right if you think at all creatively. So you spend your time trying to figure out how stupid the test-maker thinks the typical test-taker is and answering accordingly. Multiple-choice tests should not be an exercise in iterative game theory!

Well, there’s the other kind that ask questions whose “right” answer is one that depends on your ideology lining up with the questioner. I hate those too.

Jill Davidson April 15, 2010 at 3:19 am

I just tweeted this (as @cesnational). So powerful to have the parent’s view of the limits and consequences of this overemphasis on high stakes standardized tests. Your thoughts get us a lot closer to grasping what Josie is really learning about what’s important as a result of this.

marjorieingall April 16, 2010 at 8:01 am

i remember visiting ellis island as a kid and seeing their vintage “are you too retarded [sic] to be allowed into america” test. they used pictures (since obviously not all the immigrants could read english) and there was one in which the test-taker was supposed to deduce that the children in the picture were crying because their pet bunny was dead and they had to bury it. apparently a bunch of immigrants got it wrong because, hi, who has a bunny as a pet? the immigrants’ interpretation: the children were crying because they were hungry and wanted to eat the bunny. WRONG. NO AMERICA FOR YOU!

renee April 16, 2010 at 10:18 am

What a relief–this is a NY State test! I’m sure the tests here in Maine are thoroughly fair and sensible.

My older daughter is in first grade, and she told me yesterday that she is having her first reading and writing test on May 21. (Why are they getting the kids worked up about a test that’s more than a month away?) But when I asked if she was worried about it, she said no. So I just have to not be worried about whether she’s worried.

Minnesota Mamaleh April 22, 2010 at 9:49 pm

oh the dreaded standardized tests! ugh! and ugh again! as a teacher i hated the test prep as teaching time, the sit time, the not being able to help kids. and don’t even get me started on testing ell kids (with the same test as native speakers). as a parent i already feel my blood boiling over all of the above! my fingers are crossed that i won’t become a complain-ish parent that i used to struggle with! just one more *ugh!* for good measure!

Leave a Comment

Previous post:

Next post: