September 14, 2011

SAT reading scores down

From CBS:
SAT reading scores for the high school class of 2011 were the lowest on record, and combined reading and math scores fell to their lowest point since 1995. 
The College Board, which released the scores Wednesday, said the results reflect the record size and diversity of the pool of test-takers. ... 
Still, it’s just the second time in the last two decades reading scores have fallen as much in a single year. And reading scores are now notably lower than as recently as 2005, when the average was 508. 

In contrast, scores on state exams mandated by the No Child Left Behind act have gone up, UP, UP! I wonder why? Perhaps it has something to do with the fact that the College Board and ETS don't have large material incentives to get scores up by hook or by crook. There's this concept called "conflict of interest" that you may have heard of, although evidently George W. Bush and Ted Kennedy hadn't.
Average math scores for the class of 2011 fell one point to 514 and scores on the critical reading section fell two points to 489.

My guess is that math is more amenable to schoolroom instruction, since kids seldom do math for fun on their own. Since 1983, America has invested a lot in math teaching (often at the expense of history, arts, music, etc.), and we've gotten a (quite) modest but positive ROI. Reading in the classroom and homework, however, is merely a fraction of the total reading kids do (or ought to do), so spending less time on other subjects and more on reading has a more marginal effect.
College Board officials pointed to a range of indicators that the test-taking pool has expanded, particularly among Hispanics, which is a good sign that more students are aspiring to college. For instance, roughly 27 percent of the 1.65 million test-takers last year came from a home where English was not the only language, up from 19 percent just a decade ago.

Up through 2007, it was common for Hispanics to drop out of high school to take construction jobs, or the like. Since unemployment went up, Hispanics have been flooding into community colleges to give themselves something to do. Presumably, more marginal students are taking the SAT, depressing scores.

Also, they've been letting more and more students take the SAT for free since 2007, so the number of minority test takers increased from 553,000 to 720,000 from 2007 to 2011. (Here's the College Board's report.)
But the increasingly diverse group of test-takers is clearly having more trouble with reading and writing than with math. Wayne Camara, College Board vice president of research, said recent curriculum reforms that pushed math instruction may be coming at the expense of reading and writing — especially in an era when students are reading less and less at home. 
“We’re looking and wondering if (more) efforts in English and reading and writing would benefit” students, Camara said. ../
Based on research at 100 colleges, the College Board calculated that scoring 1550 (equivalent to about a 930 on the SAT M+V before 1995) or above on the three sections of the test indicated a 65-percent likelihood of attaining at least a B-minus average in the freshman year of college.

I once took a detailed look at what percentage of students in LA County public high schools score 1000 out of 1600 (M+V) on the SAT, which is a little below that 1550 out of 2400 cutoff that the College Board suggests. Among LAUSD seniors, only 14% scored at least 1000/1600.

The CB report says that this score of 517 / 800 is very close to the minimum Proficient score on the fed's NAEP test of 12th graders. 517 is about the 57th percentile, while 500 is exactly the 50th percentile this year.
Overall, 43 percent of test-takers reached that benchmark. The College Board emphasized the tool is for policymakers, and shouldn’t be used by college admissions officers to evaluate individual candidates. 
The main message from the College Board was the importance of a rigorous curriculum, which is a strong and perhaps growing predictor of SAT scores. 
For instance, nearly one in five students takes less than four years of high school English. That’s about the same percentage as a decade ago, but it now makes a much bigger difference on SAT scores: The reading scores of those students have fallen from 500 to 462. Students who took AP and honors classes, meanwhile, score significantly higher across the board.

Causality!
A decline in average scores isn’t necessarily good news for top students who were applying to competitive colleges. The number of high scores is also increasing. For instance, the number of students with math scores of at least 700 is up 22 percent since 2007.

Some of that may be ACT takers also taking the SAT. But, I think it's pretty clear that the SAT is more and more being successfully gamed by the upper middle class's Tiger Mothers. College Board / ETS don't have strong incentives to lift average scores, but they also don't have strong incentives to crack down on whatever it is that is allowing elite offspring to separate themselves from the masses.

For example, when I went to Rice, the average SAT score was about 1300. Now, it's about 1440, which makes me 140 points awesomer. What incentive do I have to complain?

9 comments:

  1. 1 point? 2 points?

    By all means, let's make huge inferences based on margin-of-error artifacts.

    ReplyDelete
  2. Gaming the SAT...the best I ever saw of that genre in the old days was Up Your SAT, which came out around 1990. There is indeed an art to these tests, but that didn't matter much when they were infrequent and there wasn't much more than rumor about how to beat them. There were clues and tells, but only the bright students figured them out. I remember that there were all sorts of legends, even among bright students taking the SAT's in the 70's, when I took them. I was quite happy to let people keep believing those stupid ideas, and kept my own decoding to myself. The dynamic is different now.

    Is there much real data on whether the new section actually measures anything?

    ReplyDelete
  3. "College Board / ETS don't have strong incentives to lift average scores, but they also don't have strong incentives to crack down on whatever it is that is allowing elite offspring to separate themselves from the masses."

    The earlier a kid figures out that life is a game, the more likely he is to win. Obviously: high test scores = elite college admission = high monetary compensation in the world of work = sex with cute chicks = sports cars = summer home in Malibu.

    ReplyDelete
  4. Those low scores must have been the reason why I was able to miss 2 questions on the Critical Reading portion of the SAT and still get an 800.

    ReplyDelete
  5. Charles Murray in Real Education, I think, noted that math but not verbal scores had recovered from the big decline. His theory was that schools had reacted by making their math classes rigorous, since it's easy to tell if your math class is slack, but hadn't made their English classes rigorous, since it's easier to fail to realize you're rigorous there.

    ReplyDelete
  6. Difference Maker9/14/11, 9:27 PM

    high test scores = elite college admission = high monetary compensation in the world of work = sex with cute chicks = sports cars = summer home in Malibu.

    Now that you put it that way, I'm highly motivated!

    ReplyDelete
  7. Young people aren't doing as much reading now?

    OMG LOL ROFL

    Wonder why?

    ReplyDelete
  8. "high test scores = elite college admission = high monetary compensation in the world of work = sex with cute chicks = sports cars = summer home in Malibu.

    Now that you put it that way, I'm highly motivated!"

    I am not. It's the last three outcomes that really don't do anything for me.

    Sir, will rolling away from the web and cracking open that GRE book get me frequent sex with one hot, intelligent, stable guy for many consistent years, a collection of weird musical instruments, vacations to world heritage cites around the globe, lots of healthy, happy and smart kids and a summer house in Alaska?

    ReplyDelete
  9. "For example, when I went to Rice, the average SAT score was about 1300. Now, it's about 1440, which makes me 140 points awesomer. What incentive do I have to complain?"

    Check out this article:
    "The Flynn effect puzzle: A 30-year examination from the right tail of the ability distribution provides some missing pieces (Intelligence, In Press)

    ReplyDelete

Comments are moderated, at whim.