What the Score Report Leaves Out
Notes on Diagnosis
Open the College Board’s score report and, under the heading Knowledge and Skills, the Reading & Writing section unfolds into four domains: Information and Ideas, Craft and Structure, Expression of Ideas, and Standard English Conventions. Beneath each is a short row of small bars, some filled and some left empty — the report’s shorthand for how many questions in that domain the student answered correctly.
Parents tend to read these reports in two ways. One takes the bars at face value and comes to the test-prep tutor with certainty: Her daughter’s weakness is Information and Ideas, and the tutor’s job is to help her daughter improve on Information and Ideas. The other finds the report opaque and assumes the opacity is hiding something — that a deeper message lies beneath the surface, waiting for a specialist who can divine it the way a fortune-teller reads tea leaves.
Both give the report too much credit. One can hardly blame parents for following the lead of institutions that treat the report with a certain technocratic solemnity. But as a diagnostic tool for test-preparation, the SAT score report is at best a blunt instrument. It marks where a student lost points, but it does so only in the broadest of strokes, and it says nothing at all about why.
~
Four Domains, Twenty Question Types, Skills Divers and Sundry
By the score report’s account, four domains cover the whole of Reading & Writing. In my own taxonomy, the section runs to twenty substantively and strategically distinct question types. Information and Ideas alone breaks into seven subtypes that recur across five common passage structures. “Help my daughter improve on Information and Ideas,” then, is not yet an instruction. It names a city, but the work happens street by street.
And while that fine topography is needed, it’s by no means the full picture. The twenty question types are not isolated islands. The same underlying skills run beneath many of them — recovering an author’s meaning, drawing a valid conclusion, tracking how the parts of a text connect, holding a word to its precise sense. A student with misses across several question types is often failing at one or two particular skills they happen to share.
The report’s domains do not track these skills. Information and Ideas, for example, bundles question types that ask for quite different things: Main Idea, despite its name, turns almost entirely on verifying specific passage information, while Command of Evidence and Inference turn on the logical relationship between answer and passage. Identifying the right relationships calls upon distinct faculties, since supporting a claim is not the same as inferring a conclusion. The Information and Ideas “domain” is an amalgam. It isolates neither a single skill nor even a coherent set of them.
Useful diagnosis therefore moves beyond the score report in two ways. It drills down, pinning a student's misses to specific question types and subtypes, far below the resolution of four domains. And it reads across those question types, noting where misses cluster around shared skills that the report never mentions.
~
Which and Why
But suppose the report broke a student's performance down as finely as my own taxonomy does. It would still answer only one question: which questions are being missed. It would say nothing about why — and why is the central question of effective test-preparation.
The failure modes are many: not recognizing the question type, or not knowing there are subtypes worth recognizing; holding no particular standard for judging answer choices, or holding the wrong ones; reading the passage with an interpretive mindset where a literal one is wanted; a careless misread under time pressure; language too hard to follow. A miss is a symptom. Two students can miss the same question for different reasons, yet the report shows the same empty bar for both.
Consider the “wrong standard” failure mode. A run of Command of Evidence misses needn't signal a reasoning gap — not if the student has been taught to eliminate answers carrying "value judgments" instead of asking the one question that matters: which choice would support the claim. The skill is intact; the standard is wrong.
The why is not recoverable from an inventory of missed questions, no matter how granular. It emerges through Socratic review. When I analyze a miss with a student, I work through the same sequence every time. Can you name the question type? Do you know the rule or the strategy it calls for? Why did you like the wrong answer? Why, precisely, is that answer wrong? What stopped you from trusting the correct one? How can you prove it is correct?
The answers are telling. They distinguish strategic gaps from genuine ceilings. They separate false standards from missing skills. They surface the rules and assumptions a student brings to the test, including the ones the student didn’t know they were holding, and that the score report’s row of bars could never show.
~
This is why I begin every new engagement with a Diagnostic Review: a 60-minute session built around a student's recent Reading & Writing performance on an official practice test. Working through each missed question by the Socratic method that anchors all my instruction, I identify the strategic errors behind the misses and note the specific question types where they concentrate. Within 24 hours, the family receives a written assessment noting what I observed and detailing a plan aligned with the student’s timeline, target score, and highest-leverage areas.
~
The SAT score report has its uses. But as a road map for effective preparation, it provides scant guidance — like telling a lost traveler the way to get from New York to London is to go north and east. Where a student is going wrong, and why, can be known with real precision. But that precision comes from the tutor, not the report. Parents sometimes expect it to run the other way: that a good tutor will use the report to tailor their work to what it shows. In truth the report shows far too little to tailor anything. It falls to the tutor to bring the detail the report only gestures at. No tea leaves required.
~ Dave Walker