91制片厂视频

Special Report
Reading & Literacy

There鈥檚 a Design Flaw With Many Reading Tests. Here鈥檚 One State鈥檚 Fix

Louisiana鈥檚 pilot links to its homegrown curriculum, not decontextualized reading passages
By Libby Stanford 鈥 January 15, 2024 9 min read
Image of topics on an overlay of reading passages.
  • Save to favorites
  • Print
Email Copy URL

Editor鈥檚 Note: Click on the words highlighted in this story to pull up a definition and short research summary.

When is a reading test not a true reading test? Most of the time.

For years, cognitive scientists have lamented that the year-end standardized tests almost every state uses Because they rely on decontextualized reading passages, students who don鈥檛 have exposure to the topics at hand鈥攚hether mammals, archeology, travel, or literature鈥攄on鈥檛 tend to do as well as those that have been exposed to background knowledge on that topic.

As a result, a standardized reading test, they鈥檝e pointed out, isn鈥檛 really so much a measure of how well a child can read as it is of how much they know, and the related vocabulary they鈥檝e been exposed to.

In 2018, Louisiana became the first state to try to change the equation.

With federal approval, the state was the first to develop an English/language arts assessment that directly corresponds with its Guidebooks curriculum, a statewide, teacher-developed ELA curriculum available in grades K-8. The test measures students on content and texts that they鈥檝e already been exposed to in class, not passages that are completely unfamiliar to them.

The idea was to create a test that aligns better to what research shows about reading comprehension and encourages teachers to focus on curriculum rather than generic test-taking skills.

鈥淚t鈥檚 not just that kids will do better in demonstrating their reading comprehension when they are tested on books that they鈥檝e actually read before, knowledge that they鈥檝e extensively studied,鈥 said John White, the former state superintendent in Louisiana who oversaw the beginning stages of the pilot before leaving office in 2020. 鈥淚t鈥檚 鈥 actually assuring that kids have learned and have stored the knowledge that is conveyed by the texts that they鈥檙e reading.鈥

鈥淚t鈥檚 that shift in teaching that is really the heart of this project,鈥 White said.

But while the project has big ambitions, its progress has been slow-going and its future is unclear. Few districts are participating, and the state has no immediate plans to expand the pilot. The Pelican State has also released few technical details about how the state鈥檚 students stack up on this new exam compared to those who take the more traditional reading test most students take.

The pilot could provide a wealth of information to other states and districts about what kinds of testing work, said Dan Willingham, a professor of K-12 psychology and science at the University of Virginia.

鈥淥ne of the great benefits of this distributed local education system should be that we can experiment,鈥 he said. 鈥淒ifferent states will do things different ways and then states will learn from one another. There鈥檚 been remarkably little interest in doing that. It鈥檚 a great a idea to have this experimentation and I hope that districts and states actually follow through.鈥

The baseball experiment

The inspiration for the testing pilot came from an expanding research base showing that reading comprehension is heavily dependent on student knowledge. Among the best-known studies is one from 1988, known as 鈥淭he Baseball Experiment.鈥

The researchers, divided a group of 64 junior high students into four groups based on their reading ability and knowledge of baseball. Each student read a passage about a half inning of a baseball game and were then asked to recount it.

The students who were at lower reading levels but had prior knowledge of baseball outperformed the students at higher reading levels with less knowledge of baseball, suggesting that background knowledge goes a long way in reading comprehension.

Subject-specific knowledge doesn鈥檛 automatically transfer to general knowledge, which is where the push for 鈥渒nowledge building鈥 curriculum comes in: These texts purport to build broader, conceptual knowledge by engaging students in deep, substantive ideas across content areas.

All that adds up to thinking about how a curriculum and aligned test could support the aims of literacy rather than detract from it, said Jessica Baghian, a former assistant state superintendent and chief academic policy officer at the Louisiana education department.

鈥淚f we could even the playing field so that kids, as much as possible, had an even understanding of the background knowledge that鈥檚 important for a particular study, we could really know more about how strong their reading was, rather than potentially鈥攅ven though we try to avoid bias鈥攁ssessing more about income and access than skill,鈥 said Baghian, who helped oversee the development of the pilot before she left the department in 2020.

Two major developments helped lay the groundwork for the exam. The first was the creation of Guidebooks, the state鈥檚 homegrown curriculum, developed in the mid-2010s to respond to the Common Core State Standards. Teachers wrote the lessons included in the curriculum, which is uploaded on the state鈥檚 website available to anyone across the United States to use freely. Students鈥 reading scores were increasing under Guidebooks curriculum before the state started to align it with the pilot exam.

Second, federal policy shifted as Guidebooks came onstream, allowing states to submit plans to pilot less rigid testing models.

Louisiana was the first state to receive an Innovative Assessment waiver from the U.S. Department of 91制片厂视频, and in 2020, it received a $3 million grant to scale the new pilot program.

A change in teachers

The test-heavy federal requirements that have held sway for more than two decades have made teachers apprehensive about testing, and it was no different with the Louisiana pilot, said White, who . White is now the chief success officer at Great Minds, an organization that helps districts create and implement high-quality curriculum.

鈥淭eachers鈥 view of their job is now almost universally in the core subjects anchored in standards and tests as defining instruments of success,鈥 White said. 鈥淪o the fear is that when those things change, people want to be opting into a system in which they feel secure.鈥

Ultimately, teachers warmed to the test because it largely supports their day-to-day work, White and Baghian said. They can continue teaching the curriculum content through the end of the course, rather than drop everything to turn to test prep, like they typically would.

The goal was to replace time spent on students practicing questions on random texts 鈥渨ith deep efforts to make meaning out of texts that were building knowledge that was essential for them to learn and ultimately to use in comprehending further texts,鈥 White said. Teachers can spend more time having students discuss the novels, poems, and memoirs they read in class.

Louisiana educators aren鈥檛 the only ones who feel this way about tests. In a November EdWeek Research Center survey, 57 percent of teachers, principals, and district leaders said that state reading tests for students don鈥檛 provide an accurate assessment of reading comprehension.

Dana Talley, chief academic officer of the Lincoln Parish school district in Ruston, La., said it took some time to convince teachers in her district to focus on teaching the curriculum and not switch to test prep as the exams approached. But teachers ultimately came around because of the wealth of feedback they got under the pilot test.

Lincoln Parish is one of 20 districts using the pilot for 6th through 8th grades in the 2023-24 school year, according to

鈥淭he teachers are very aware of the data and they want that data to be good,鈥 said Talley, who also worked at the education department with White and Baghian before joining Lincoln Parish in 2020. 鈥淲hat we were able to convince them of is that, one, we think the results are going to make more sense and be more tightly aligned to what you did in the classroom ... and then you鈥檙e going to get this data along the way that鈥檚 going to help you identify some gaps in some places that you really need to shore up on as you move through the year.鈥

But because the pilot is only operating in a small range of grades, many participating teachers still spend time practicing 鈥渃old reads鈥 of unfamiliar books, poems, and articles. They feel a duty to prep kids for that format, which will show up on college-entrance exams.

鈥淭eachers in particular are sensitive to the fact that ultimately when kids go on, they鈥檙e still going to encounter the ACT, which has no basis in particular bodies of knowledge or particular texts, and that still gives them some concern,鈥 White said. 鈥淏ut there鈥檚 a lot of evidence that teachers are willing 鈥 to shift the way they use other tests and the way they prepare students for tests because of the nature of this test and because they are more confident that they understand what鈥檚 going to be on the test.鈥

An uncertain future

Although it鈥檚 been five years since the testing pilot began, it鈥檚 unclear where the test is headed or if it will be used statewide anytime soon. The 20 districts involved in the pilot in 2023-24 is an increase from the 16 districts that were involved last school year, but they account for just 28 percent of the state鈥檚 total districts. (Districts are given the opportunity to sign up at the beginning of each school year.)

It鈥檚 also available only in the 6th through 8th grades, said Thomas Lambert, the assistant superintendent of assessments, accountability, and analytics at the Louisiana education department. In total, that amounts to 10 percent of the state鈥檚 students in those grades, he said.

As of now, the state doesn鈥檛 have any immediate plans to expand the pilot beyond those grades.

鈥淭he fact that we only have 16 districts that signed on voluntarily [in 2022-23] means to me that folks are not ready for this to be assigned or adopted wide scale,鈥 Lambert said.

Educators Worry About Reading Tests' Accuracy. Here's Why

The EdWeek Research Center asked principals, teachers, and other educators in a survey to explain why they felt their state reading tests did鈥攐r didn鈥檛鈥攑rovide a good gauge of students鈥 reading comprehension. Their responses dovetail with the concerns cognitive scientists have raised about reading tests.

  • 鈥淭hey provide only one point of data, on a given day, and in that given context (a computerized test, surrounded by other testing students).鈥
  • 鈥淭he texts are modeled for the test, and do not take into account varying backgrounds or interests. Answering the questions requires skills related to test-taking that do not relate to comprehension of what they read.鈥
  • 鈥淭hey are all forced to read the same passage, regardless of where their interest lies so if you鈥檙e not interested in the material, you won鈥檛 answer well or care.鈥
  • 鈥淭he texts are typically not interesting and based in topics for which our students have little or no background knowledge (not contextualized in previously taught science or social studies concepts).鈥
  • 鈥淭he texts and tasks can be very content-specific, so if they do not have any background information they are not able to do the task.鈥
  • 鈥淭he students are not equipped sometimes to read the amount of that time (stamina) and then respond with an answer without teacher guidance. This is not a real world situation鈥攁s no teacher should even just give an assignment such as this without some sort of scaffolding or instruction or discussion through the text. This is especially true for students with disabilities.鈥

The reasons why are complex to undo. Districts have expressed concerns about losing control of curriculum and uncertainty around the future of the exams, Lambert said. Choosing to use the exam effectively locks districts into using the Guidebooks materials.

鈥淭he background knowledge component is something that is important to make sure that students have an opportunity to show that they鈥檝e learned,鈥 Lambert said. 鈥淏ut [it鈥檚 also important] making sure that local districts are able to make curricular choices so that they can identify the programming that鈥檚 going to best serve their student population without an assessment defining what that curriculum needs to look like.鈥

Politics may further complicate things. In January, the Louisiana board of elementary and secondary education will have eight new members, and Jeff Landry, a Republican, will take over from Gov. John Bel Edwards, a Democrat.

The test also doesn鈥檛 yet have verified student data to back it up. Because it has only been used for a few years, the state isn鈥檛 going to release data showing how students performed on the pilot test compared with the traditional exams for some time, Lambert said.

Louisiana鈥檚 annual report on the program to the federal 91制片厂视频 Department shows that students have scored similarly or slightly higher on the testing pilot than they do on the state鈥檚 typical reading tests. It鈥檚 still unclear if the test is helping close achievement gaps.

That doesn鈥檛 mean it鈥檚 dead in the water, though. With the right support, the test could have major implications for the future of standardized testing.

鈥淲e have to recognize that as important as testing is, and it is very important, the design of today鈥檚 reading test is holding teachers back from making the most out of the high-quality curriculum that so many of our school systems have chosen,鈥 White said.

Words Used in Story

Vocabulary:

The words used in a language. Best practices for vocabulary instruction include teaching words within a meaningful context (rather than the traditional list of unrelated words), offering children multiple exposures to a word and opportunities to use it, and connecting new words to related words that children already know.


Reading comprehension:

The ability to understand what one reads. The skills that underlie reading comprehension, though, are . Students need to be able to decode the words on the page, understand the vocabulary used, apply their own background knowledge to make sense of text, parse syntax and text structure, and monitor their own understanding as they read. Supporting students鈥 reading comprehension requires carefully planned and sequenced instruction.


Knowledge-building curriculum:

An approach to English/language arts instruction that aims to systematically grow students鈥 knowledge about the world. Literacy skills鈥攕uch as applying comprehension strategies, analyzing text, writing about texts, and discussing them鈥攁re taught in the context of this content. Studies show that teaching students literacy skills in context in this way can improve reading outcomes, though many curricula in this category have not been evaluated for efficacy.


Reading-comprehension assessment:

A test of students鈥 ability to understand what they read. Most of these assessments, such as the ones states give at the end of the year, test general comprehension skills鈥攁sking students to read unfamiliar passages and then answer related questions. Because students鈥 comprehension abilities are tightly connected to their background knowledge on the topic, some researchers have argued that reading-comprehension assessments should be more closely related to the content that students learn throughout the school year.


See the full list of words used in this special report in our glossary here.

A version of this article appeared in the December 13, 2023 edition of 91制片厂视频 Week as There鈥檚 a Design Flaw With Many Reading Tests

Events

School Climate & Safety K-12 Essentials Forum Strengthen Students鈥 Connections to School
Join this free event to learn how schools are creating the space for students to form strong bonds with each other and trusted adults.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Reading & Literacy Webinar
Creating Confident Readers: Why Differentiated Instruction is Equitable Instruction
Join us as we break down how differentiated instruction can advance your school鈥檚 literacy and equity goals.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
IT Infrastructure & Management Webinar
Future-Proofing Your School's Tech Ecosystem: Strategies for Asset Tracking, Sustainability, and Budget Optimization
Gain actionable insights into effective asset management, budget optimization, and sustainable IT practices.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Reading & Literacy The Key Parts of a 'Science of Reading' Transformation, According to One State Chief
Under Carey Wright's leadership, Mississippi pulled off a reading "miracle." She has a similar transformation in mind for Maryland.
6 min read
Dr. Carey Wright, the interim state superintendent for Maryland, discusses improving literacy instruction and achievement with Stephen Sawchuk, an assistant managing editor for 91制片厂视频 Week, during the 2024 91制片厂视频 Symposium in Arlington, Va. on Friday, May 3, 2024.
Carey Wright, the state superintendent for Maryland, discusses improving literacy instruction and achievement during 91制片厂视频 Week's 91制片厂视频 Symposium in Arlington, Va., on May 3, 2024.
Sam Mallon/91制片厂视频 Week
Reading & Literacy Teachers Are Still Teaching Older Students Basic Reading Skills, Survey Finds
Who across the K-12 spectrum engages frequently in activities that promote foundational reading skills? The answer may come as a surprise.
4 min read
Group of kids reading while sitting on the floor in the library
Zinkevych/iStock/Getty
Reading & Literacy Spotlight Spotlight on The Science of Reading in Practice
This Spotlight will help you analyze new curricula designed to build knowledge, review the benefits of reading aloud to students, and more.
Reading & Literacy Opinion Readers Can Struggle at Any Age. Here's How Teachers Can Help
Struggling readers may be able to read the words but fail to make the necessary connections between ideas and their meaning.
8 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty