by Seth Saavedra │Thursday, April 11th, 2018
This past Tuesday at midnight 2017 NAEP scores went public. Amidst the hullabaloo that accompanies this ritual is a predictable chain of events:
- Four hundred "What to Expect" pieces
- Accidental releases of embargoed information
- Late night Twitter stalking of #NAEPDay
- All too many all too hot takes
- Ambitious overreaches and alarmist shrieks
- Even more ambitious counter "think" pieces
- RESULTS ACTUALLY READ
- Level-headed commentary
- "Welp, what does NAEP actually tell us?"
- Next shiny edu-thing
Before I jump into the fray at stage nine, let's cover the NAEP basics.
Often called "The Nation's Report Card", NAEP is the National Assessment of Educational Progress, the U.S.'s most comprehensive view of what students know in a wide range of topics. It is a low stakes, demographically representative, and minimally changing assessment that tracks academic progress over time. The National Center for Education Statistics, in the U.S. Department of Education, administers the project. For many, NAEP is our best barometer of how much students have learned, particularly in fourth and eighth grades.
Across the U.S.
The NAEP story of the past decade has been disappointing, particularly the past four years. Some have labeled this period "Education's Lost Decade". Beyond the dramatic rhetoric, the lack of movement in student learning is troubling.
The speculation and analysis about why, after fifteen years of upward progress, we have stalled runs the gamut. Experts point to everything from diminishing returns on education investment to hangover effects of The Great Recession to Federal Department of Education overreach.
When you sort NAEP scores by federal initiative, students of all backgrounds made far greater gains from 1996-02 (Clinton’s Goals 2000) and 2003-10 (Bush’s NCLB) than 2011-17 (Obama’s Race to the Top). Why? Vote below!— Marc Porter Magee (@marcportermagee) April 11, 2018
As researchers dig further into restricted-use data over the coming weeks we'll gain additional insights about this great NAEP flattening. Meanwhile, us advocates, practitioners, parents, policy wonks, and business leaders must remain focused on bending the trend line upward again, especially for students of color and those from low-income backgrounds.
NAEP in New Mexico
While our sunsets in The Land of Enchantment are dazzling, our NAEP results aren't, often coming in last or next to last in the nation. This time around, only Louisiana and Puerto Rico consistently come in behind us.
So, let's do that. When controls are applied for age, race/ethnicity, frequency of English spoken at home, special education status, free or reduced-price lunch eligibility, and English language learner status, New Mexico moves up slightly. Below, the yellow lines are raw, unadjusted scores while the blue lines take into account the factors above.
As you can see, New Mexico bumps up a bit with controls applied - on average 12 places upward. In 8th grade reading, we move from dead last to 26th. And, in three out of four areas, New Mexico has moved upward since 2009, marking tangible progress.
As the New Mexico Public Education Department shared via email, "About 2,500 4th and 8th grade students from 150 elementary and 120 middle schools in New Mexico took the NAEP exam online, for the first time ever, in reading and math." That's one of the values of NAEP, that it takes representative samplings from each state.
Next, let's look at demographic differences in NAEP scores across the state:
As with the national results from the last decade, the results haven't changed much here. Though there are a few notable exceptions:
- Since 2009, Hispanic students have grown in all areas;
- African American students did not reach a statistically significant sample in 2015 or 2017, leaving out an important student population;
- American Indian students remained flat in two areas, lost ground in another, and made growth in the fourth; and
- White students saw growth in reading and backslid slightly in math in 2017.
What Does It All Mean?
My main takeaway for our 2017 NAEP results is two-fold: our Hispanic students are on the rise and we have a lot of work ahead. For all the ill conceived critiques of PARCC, NAEP is the antidote. It's low stakes. It takes a representative sample. It's every other year. It covers every state - and can control for demographic factors. And yet, New Mexico still falls far behind the pack.
Yet, we've made progress over the past decade, particularly for Hispanic students, even though it's stalled out recently. We have hard questions to ask ourselves. Where should our future investments in education be made? It's clear that "business as usual" only works for adults in the system, not our students. Where are our current bright spots and how do we scale them up? In districts such as Gadsden and Farmington, we see meaningful progress. How do we encourage more smart innovation in a sector that badly needs it?
And lastly, as Morgan Polikoff writes, "We need more rigorous investigation of these results to understand whether they can really tell us anything about policy effects." In other words, what impact do “college- and career-readiness standards” have on student achievement? What about the effects from so-called "community schools"? Much more research is needed here to better understand the early gains we made as a state and to get us moving upward again.
To continue your 2017 NAEP reading/listening:
- New Mexico's 2017 NAEP Profile
- "New Mexico Showing Slight Gain in Math and Reading" by Shelby Perea
- "NAEP 2017: America's 'Lost Decade' of educational progress" by Mike Petrilli
- "The Biggest Gainers and Losers Over ‘Education’s Lost Decade’" by Kevin Mahnken
- "Could the Disappointing 2017 NAEP Scores Be Due to the Great Recession?" by C. Kirabo Jackson
- "NAEP Results Again Show That Biennial National Tests Aren’t Worth It" by Phillip Burgoyne-Allen
- "The 2017 NAEP Results: Nothing To See Here?" by Morgan Polikoff
- America's Gradebook: How Does Your State Stack Up? from the Urban Institute
- "Policymakers, Educators Look for Reasons Behind NAEP Results" by Linda Jacobson
- PODCAST: "Is America Still A Nation at Risk?"
- PODCAST: "A Lost Decade for U.S. Education?"