Unvarnished Truths: 5 Counter-Intuitive Lessons from West Virginia’s Historical School Assessment Data
Standardized test scores are frequently presented as impartial indicators of academic progress, providing parents, educators, and lawmakers with a clean metric of school quality. Yet headline proficiency figures can easily construct a comforting illusion of success while obscuring structural weaknesses underneath.
When the federal No Child Left Behind (NCLB) Act took effect in the early 2000s, state education departments across the country rushed to design new tests, set performance benchmarks, and meet ambitious accountability targets. West Virginia’s K–12 public assessment data from 2000 through 2006 offers a compelling case study in this national experiment. As the state transitioned from a national norm-referenced exam to a custom criterion-referenced test, its performance records revealed how test design, lowered proficiency bars, and data aggregation can systematically "game" accountability metrics.
By looking beneath the headline figures from this critical six-year era, education leaders and policy analysts can draw five counter-intuitive takeaways about what was really happening inside West Virginia's classrooms.
1. The "Lake Wobegon" Illusion: How Reused Tests Made Every County "Above Average"
From the 1999–2000 through the 2002–03 school year, West Virginia evaluated its 55 county school districts using the Stanford Achievement Test, 9th Edition (SAT-9, Form S). As a nationally norm-referenced test administered every April, the state benchmarked institutional success against a straightforward goal: having a majority of students score above the 50th national percentile in reading and mathematics.
Between 1999 and 2002, official state summaries showed a striking outcome: not a single one of West Virginia’s 55 counties had a majority of elementary students score below the 50th national percentile.
Key Data Insight: Between 1999 and 2002, zero out of 55 West Virginia counties fell below the national average in elementary test scores. However, investigative analysis revealed that the state administered the exact same SAT-9 Form S test questions repeatedly every spring from 1996 through 2002, creating score inflation through item familiarity rather than sudden academic breakthroughs.
This apparent statewide excellence was an artifact of test administration. Because classroom instruction and test preparation aligned directly to identical recurring test questions over six consecutive years, student scores rose predictably.
The illusion fractured in spring 2003 when federal NCLB mandates took effect. Federal guidelines required states to expand student inclusion rules, significantly curtailing the practice of excluding lower-functioning students and English learners from state reporting. The moment all enrolled students were included in district averages, several high-poverty counties in the southern coalfields immediately dropped below the 50th national percentile—demonstrating how quickly administrative score inflation collapses when inclusion rules tighten.
2. The 55-Point "Honesty Gap": High State Scores Masked Federal Realities
In spring 2004, West Virginia overhauled its assessment architecture by replacing the SAT-9 with the West Virginia Educational Standards Test (WESTEST). Built specifically to align with state content standards across Reading/Language Arts, Mathematics, Science, and Social Studies, WESTEST sorted student performance into five tiers: Novice, Partial Mastery, Mastery, Above Mastery, and Distinguished. Under state rules, achieving "Mastery" or higher designated a student as NCLB proficient.
By spring 2005, state WESTEST reports celebrated sweeping achievement, declaring that 81% of 4th-grade students were proficient in Reading. However, when the National Assessment of Educational Progress (NAEP)—the rigorous, gold-standard federal exam—evaluated West Virginia 4th graders that same year, only 26% demonstrated proficiency in Reading.
Key Data Insight: In 2005, West Virginia reported an 81% reading proficiency rate for 4th graders on its state exam, whereas NAEP reported a 26% proficiency rate—creating a 55-percentage-point "Honesty Gap." Adjacent 2006–07 federal data confirmed similar gaps ranging from 46 to 57 percentage points across 4th and 8th-grade Reading and Math.
This vast divergence occurred because West Virginia set its state proficiency threshold (Mastery) at a lenient level that mapped closer to NAEP’s "Basic" benchmark (which sat at 63% to 68%) rather than NAEP's robust "Proficient" standard.
Setting an accessible bar allowed 82.7% of West Virginia public schools (635 of 797) to meet federal Adequate Yearly Progress (AYP) targets in 2006–07, outperforming the national school pass rate of 70%. Yet, during this same window, West Virginia’s Advanced Placement (AP) exam participation lagged far behind national trends at 13.6%, compared to 24.2% nationally. The state had built a compliance system that awarded high NCLB pass rates without delivering nationally competitive academic output.
3. The High School Slump: Math Surged, but 10th Grade Reading Actually Fell
Between 2004 and 2006, statewide WESTEST performance displayed positive overall trajectories. The unweighted seven-grade average proficiency rose from 77.1% to 80.0% in Reading/Language Arts (+2.9 percentage points) and jumped from 67.7% to 75.4% in Mathematics (+7.7 percentage points), putting every tested grade well above West Virginia's 2006 NCLB Annual Measurable Objectives (AMOs).
However, progress was uneven across grade levels. While elementary and middle grades recorded sharp gains—led by Grade 6 Math, which surged 12 percentage points (rising from 63% to 75%)—high school performance faltered. Grade 10 Reading/Language Arts was the only tested cohort in the entire state to suffer a two-year decline, slipping 1 percentage point from 77% in 2004 down to 76% in 2006.
Trend Category | Elementary Grades (3–5) | Middle School Grades (6–8) | High School (Grade 10) |
Reading/ELA Trends (2004–2006) | Rose across all grades; Grade 4 posted the state's largest gain (+9 pp, 73% to 82%). Settled at 79%–82% in 2006. | Showed modest, steady growth (+1 pp to +3 pp). Settled at a uniform 81% proficiency in 2006. | Suffered the state's only two-year decline (-1 pp, falling from 77% in 2004 to 76% in 2006). |
Mathematics Trends (2004–2006) | Peaked at 77%–80% in 2006. Grade 5 Math jumped +9 pp (71% to 80%), becoming the state's only cohort where Math surpassed ELA (80% vs. 79%). | Surged dramatically; Grade 6 jumped +12 pp (63% to 75%) and Grade 7 gained +9 pp (66% to 75%). | Trailed upper-elementary levels, reaching 69% proficiency in 2006 (up +5 pp from 64% in 2004). |
A distinct policy mechanism explains why high school grades stagnated while younger grades climbed. Unlike states that mandated high school exit examinations as a condition for receiving a diploma, West Virginia used WESTEST exclusively for institutional NCLB accountability.
Because no individual graduation consequences were tied to WESTEST performance, student test-taking motivation naturally waned in secondary classrooms. This motivational slump compounded cumulative learning gaps just as high school coursework shifted into advanced literary analysis and complex algebra.
4. The Masking Effect: Statewide Averages Hid Deep Racial, Economic, and Regional Gaps
Because statewide WESTEST proficiency averages consistently exceeded 75% in Reading and 70% in Math, high-level administrative summaries gave the impression that public schools were serving all demographic groups effectively. However, disaggregating the underlying student data exposed severe inequities across racial, economic, and geographic lines.
During the 2002–03 baseline transition period, overall state Reading proficiency stood at 61%. Yet Black non-Hispanic students scored at just 28% proficiency—a 34-percentage-point gap compared to White peers (62%). Students with disabilities trailed White peers by 23 percentage points in Reading (39% vs. 62%) and 26 percentage points in Math (44% vs. 70%). Economically disadvantaged students trailed statewide averages by 10 points in Reading (51%) and 8 points in Math (61%).
Key Data Insight: Disaggregated 2002–03 baseline data revealed a 34-percentage-point Reading gap between Black (28%) and White (62%) students. Furthermore, a four-year study (2004–05 to 2007–08) found that WESTEST pass rates in coal-mining counties (74.87%) were statistically significantly lower than in non-mining counties (78.74%, p = .0001).
Regional economic factors also mirrored academic outcomes. A peer-reviewed study by Cain and Hendryx (2010) analyzing WESTEST pass rates across four academic years (2004–05 through 2007–08) documented that students in coal-mining counties had statistically significantly lower proficiency pass rates (74.87%) than students in non-mining counties (78.74%, p = .0001).
The researchers explicitly caveated that this regional disparity should not be reduced to a single cause; rather, it reflects a complex mix of unmeasured socioeconomic confounds, community educational attainment levels, and environmental riskscape factors associated with heavy extraction industries. Aggregated state averages allowed state leaders to tout policy wins while economically challenged and historically underserved communities remained behind.
5. The Digital "Black Hole": Why Historical Data Disappears and How to Fix It
Policy researchers seeking to analyze West Virginia’s 55 county school districts between 2000 and 2006 encounter a major hurdle: complete, machine-readable 55-county numerical score tables for this era are missing from modern public data portals.
The West Virginia Department of Education’s (WVDE) modern Zoom WV dashboard begins reporting data in 2014–15, the online KIDS COUNT Data Center omits pre-2014 county figures for 8th-grade math, and federal trend summaries mark 2000–2003 state proficiency as "not applicable" due to the SAT-9 transition. Legacy state NCLB web pages have been decommissioned, locking seven years of county performance data in offline paper records or university archives.
Attempting to digitize and bridge these historical records presents severe technical risks. Because the norm-referenced SAT-9 (2000–2003) and the criterion-referenced WESTEST (2004–2006) used fundamentally different scoring scales, plotting both regimes on a single trendline creates extreme scale distortion.
To preserve historical integrity when building modern education dashboards, data system architects must enforce three strict data architecture guardrails:
- Hard Visual Breaks: Forcing explicit visual disconnects between 2003 and 2004 trendlines on user interfaces so norm-referenced national percentiles are never graphically connected to criterion-referenced mastery rates.
- Metadata Tagging: Assigning distinct
assessment_regimetags (SAT-9vs.WESTEST) across all district files to ensure unit integrity across multi-year queries. - Privacy Suppression Flags: Enforcing automatic data suppression rules whenever student subgroup counts drop below policy thresholds (<30 students for WESTEST, <50 students for 2002–03 SAT-9) to prevent small-subgroup score volatility and protect student privacy.
Conclusion: Lessons for the Future of Educational Accountability
West Virginia’s historical assessment data illustrates three enduring principles of educational policy: high-stakes testing incentives heavily influence how test scores behave, artificially low cut-scores create a false sense of institutional success, and top-level state averages mask critical demographic and regional inequities.
As modern school districts transition toward adaptive digital assessments, automated reporting tools, and AI-driven learning dashboards, policy leaders face the challenge of evaluating progress accurately without repeating past mistakes.
How can education leaders design modern accountability frameworks that measure authentic student growth rather than the structural incentives of test design?
-------------------------------------------------------------------------------------------------------------
Briefing Document: West Virginia K–12 Public School Assessment System (2000–2006)
Executive Summary
Between 2000 and 2006, West Virginia’s public K–12 educational assessment architecture experienced a major structural reform driven by the federal No Child Left Behind (NCLB) Act of 2001. This period is split into two distinct, un-equated measurement eras: the Stanford Achievement Test, 9th Edition (SAT-9) era (2000–2003), characterized by norm-referenced national percentile ranks, and the West Virginia Educational Standards Test (WESTEST) era (2004–2006), characterized by criterion-referenced mastery levels.
Statewide proficiency under WESTEST (scoring at Mastery, Above Mastery, or Distinguished) demonstrated substantial progress across all seven tested grades (Grades 3–8 and 10). From 2004 to 2006, unweighted seven-grade average proficiency increased from 77.1% to 80.0% in Reading/Language Arts (ELA) and surged from 67.7% to 75.4% in Mathematics (+7.7 percentage points), narrowing the historical performance gap between the two subjects by more than half. By 2006, every tested grade band outperformed West Virginia's federal NCLB Annual Measurable Objectives (AMOs).
However, rigorous analysis of the source records exposes three critical structural qualifications:
- High School Performance Erosion: Tenth-grade achievement consistently lagged elementary and middle grades, posting the lowest proficiency in Mathematics (69% in 2006) and recording the state's only two-year proficiency decline in Reading/ELA (falling from 77% to 76%).
- Subgroup Disparities and Economic Gaps: High statewide averages masked persistent demographic equity gaps (e.g., a 34-point Black-White reading gap in the 2002–03 baseline) and statistically significant performance deficits in coal-mining counties compared to non-mining counties (74.87% vs. 78.74%).
- The WESTEST–NAEP "Honesty Gap": State WESTEST cut scores were set substantially below national standards. In 2005, Grade 4 Reading WESTEST proficiency (81%) diverged from National Assessment of Educational Progress (NAEP) proficiency (26%) by 55 percentage points, tracking closer to NAEP's basic threshold.
Furthermore, a significant public archival gap exists: complete, machine-readable 55-county numerical score matrices for 2000–2006 are absent from modern state digital portals (such as Zoom WV). To resolve this, this briefing document details an archival retrieval protocol alongside a normalized database architecture to enable historical data integration without scale distortion.
Assessment Regime Shift and Governance Architecture (2000–2006)
Understanding West Virginia school performance requires separating two incompatible testing systems. From 1996 through the 2002–03 school year, the state administered the norm-referenced SAT-9 (Form S) in April to students in grades 3 through 11, evaluating performance against a national percentile rank (NPR) baseline rather than state academic standards. Under this model, U.S. Department of Education reviewers noted in November 2000 that West Virginia lacked criterion-referenced performance standards and disaggregated subgroup reporting.
To comply with federal NCLB mandates, the West Virginia Board of Education overhauled Policy 2340 and Policy 2320, replacing the SAT-9 in spring 2004 with the custom-developed, criterion-referenced WESTEST (built with CTB/McGraw-Hill). Formally administered in Reading/Language Arts, Mathematics, Science, and Social Studies across grades 3–8 and 10, WESTEST established five performance levels: Novice, Partial Mastery (federally mapped to Basic), Mastery (designated as NCLB Proficient), Above Mastery, and Distinguished.
ERA 1: 2000–2003 (SAT-9 Form S)
Norm-Referenced Percentiles | Grades 3–11
--------------------------------------------------
SPRING 2004 REGIME BREAK (NOT COMPARABLE)
--------------------------------------------------
ERA 2: 2004–2006 (WESTEST Framework)
Criterion-Referenced | 5 Mastery Tiers
Alongside the core exam, accountability rules were rewritten:
- Participation and Academic Year Rules: School districts were required to test at least 95% of enrolled students. The Full Academic Year (FAY) inclusion rule tightened from continuous enrollment after October in 2002–03 to continuous enrollment from the 5th instructional day through the spring testing window under WESTEST.
- Subgroup Reporting Thresholds: Minimum subgroup reporting sizes dropped from 50 students under 2002–03 SAT-9 rules to 30 students for WESTEST Adequate Yearly Progress (AYP) determinations. Small schools (<50 students) were evaluated using three-year averaging.
- Alternate Assessments: The West Virginia Alternate Performance Task Assessment (APTA) catered to students with significant cognitive disabilities, capping proficient scores at 1% of tested students for county and state AYP determinations.
Assessment Component | Active Years & Grades Tested | Primary Reporting Metrics | NCLB AYP & Policy Role |
SAT-9 (Form S) | 1999–2000 to 2002–03; Grades 3–11 | National Percentile Rank (NPR) & Stanines | Transitional AYP in 2002–03 (n=50 threshold); not aligned to WV standards. |
WESTEST (Core AYP) | 2003–04 to 2005–06; Grades 3–8, 10 | 5 Mastery Levels (% Mastery & Above = Proficient) | Primary NCLB AYP trigger (n=30 threshold; 95% participation required). |
WESTEST (Non-AYP) | 2003–04 to 2005–06; Grades 3–8, 10 | 5 Mastery Levels | Reported for standards tracking; did not trigger NCLB AYP in 2004–06. |
WV Writing Assessment | 2000–2006; Grades 4, 7, 10 | Mastery Levels (At or Above Mastery) | Standalone written composition exam (evaluated 5 writing domains). |
WV APTA (Alternate) | 2003–04 to 2005–06; Eligible Grades | Alternate Performance Tiers | Included in AYP with a 1% proficient cap per county and state. |
Core Academic Performance Trends: WESTEST ELA and Mathematics (2004–2006)
During the three comparable WESTEST test cycles (2004, 2005, and 2006), statewide student proficiency climbed steadily. Unweighted seven-grade average Reading/ELA proficiency rose from 77.1% in 2004 to 80.0% in 2006 (+2.9 percentage points). Mathematics posted even larger gains, rising from 67.7% in 2004 to 75.4% in 2006 (+7.7 percentage points).
Grade Level & Band | Reading/ELA 2004 | Reading/ELA 2006 | Math 2004 | Math 2006 | 2006 AMO Target | 2006 Margin vs. AMO |
Grade 3 (Elementary) | 77% | 80% (+3 pp) | 72% | 79% (+7 pp) | ELA: 72% / Math: 67% | ELA: +8 pp / Math: +12 pp |
Grade 4 (Elementary) | 73% | 82% (+9 pp) | 69% | 77% (+8 pp) | ELA: 72% / Math: 67% | ELA: +10 pp / Math: +10 pp |
Grade 5 (Elementary) | 76% | 79% (+3 pp) | 71% | 80% (+9 pp) | ELA: 72% / Math: 67% | ELA: +7 pp / Math: +13 pp |
Grade 6 (Middle) | 78% | 81% (+3 pp) | 63% | 75% (+12 pp) | ELA: 75% / Math: 64% | ELA: +6 pp / Math: +11 pp |
Grade 7 (Middle) | 79% | 81% (+2 pp) | 66% | 75% (+9 pp) | ELA: 75% / Math: 64% | ELA: +6 pp / Math: +11 pp |
Grade 8 (Middle) | 80% | 81% (+1 pp) | 69% | 73% (+4 pp) | ELA: 75% / Math: 64% | ELA: +6 pp / Math: +9 pp |
Grade 10 (High School) | 77% | 76% (-1 pp) | 64% | 69% (+5 pp) | ELA: 71% / Math: 59% | ELA: +5 pp / Math: +10 pp |
Unweighted Mean | 77.1% | 80.0% (+2.9 pp) | 67.7% | 75.4% (+7.7 pp) | — | — |
Key Structural Performance Patterns
- Calibration Effects & Middle-Grades Math Surge: The steepest gains occurred between 2004 and 2005 due to initial test calibration and unfamiliarity with test pacing in 2004. Grade 6 Math jumped 10 points in a single year (63% to 73%), while Grade 4 Reading jumped 8 points (73% to 81%). By 2006, Grade 5 Math reached 80%, becoming the only cohort where Mathematics proficiency exceeded Reading/ELA (79%).
- High School Achievement Dip: Secondary grades demonstrated weaker performance. Grade 10 Reading dipped from 77% in 2004 to 75% in 2005 before settling at 76% in 2006—representing the state's sole net decline. Grade 10 Math was the lowest-performing subject-grade cohort overall at 69%. Lower test-taking stakes (WESTEST was not a graduation exit exam) combined with rigorous high school coursework contributed to this gradient.
- Statewide AMOs vs. Local Realities: All tested grades exceeded federal 2006 AMOs by 5 to 10 percentage points in Reading and 9 to 13 points in Math. However, because statewide aggregates pool all students, these margins masked regional deficits in rural counties and disaggregated demographic subgroups.
Non-AYP Subject Domains: Science, Social Studies, and Writing
West Virginia assessed three additional subjects outside the core NCLB ELA/Math accountability framework: WESTEST Science (Grades 3–8, 10), WESTEST Social Studies (Grades 3–8, 10), and the standalone West Virginia Writing Assessment (Grades 4, 7, 10). Complete 2004–2006 county tables for these subjects were omitted from federal EDFacts/CSPR databases.
Subject Hierarchy and Benchmark Findings
- Science vs. Social Studies Hierarchy: A four-year retrospective study of WESTEST pass rates (Cain & Hendryx, 2010) established that Science consistently yielded the highest pass rates among all four WESTEST subjects, whereas Social Studies yielded the lowest.
- 2008 Original WESTEST Benchmarks: In the final spring 2008 administration of the original WESTEST, Grade 8 statewide proficiency reached 85% in Science and 71% in Social Studies (compared to 81% in ELA and 73% in Math). Another grade band reached 86% in Science and 78% in Social Studies.
- Writing Assessment Performance: The standalone Writing Assessment evaluated composition across five domains: organization, development, word usage, sentence structure, and mechanics. Archived 2007 data revealed that 70% of 4th graders and 76% of 7th graders achieved Mastery or above, leaving 30% of 4th graders and 24% of 7th graders below mastery.
County-Level Regional Disparities and Archival Data Gaps
West Virginia’s K–12 public education system consists of 55 single-county school districts. Digital access to 2000–2006 county-level score tables is severely limited because modern portals (Zoom WV) start in 2014–15 and legacy state portals have been decommissioned. Researchers also face naming collisions with the Higher Education Policy Commission’s West Virginia Report Card, which tracks college-going rates rather than K–12 performance.
Despite archival gaps, four primary bodies of county-level evidence exist:
- SAT-9 Score Inflation (1996–2002): According to analysis published in the Nonpartisan Education Review, West Virginia administered the exact same SAT-9 Form S test items repeatedly from 1996 to 2002. Curriculum alignment to recurring test items inflated scores, resulting in zero counties having a majority of elementary students score below the national 50th percentile between 1999 and 2002.
- Impact of 2003 NCLB Inclusion Mandates: Enforcing NCLB participation rules in spring 2003 reduced the exclusion of lower-functioning students. This shift caused several high-poverty southern coalfield counties to drop below the 50th national percentile for the first time.
- Disaggregated Subgroup Reporting Cohort: Due to low racial diversity statewide, only 12 counties contained sufficient minority student populations to trigger NCLB disaggregated reporting in 2002–03: Monongalia, Marion, Berkeley, Jefferson, Ohio, Kanawha, Cabell, Logan, McDowell, Fayette, Mercer, and Raleigh.
- Coal-Mining vs. Non-Mining Performance Gap: Cain and Hendryx (2010) documented statistically significant differences in WESTEST pass rates between coal-mining counties (74.87%) and non-mining counties (78.74%) (p = .0001). The authors noted that this gap reflects complex interactions between socioeconomic status, educational resources, and environmental factors.
Repository / Source | Geographic Scope | Digitized Years Online | Archival Status & Key Utility |
WVDE Zoom WV Portal | Statewide, 55 Counties, Schools | 2014–15 to Present | No 2000–2006 Data: Modern portal; legacy SAT-9 and WESTEST files are not hosted. |
KIDS COUNT Data Center | Statewide, 55 Counties | 2014–15, 2021, 2023–2026 | Incomplete: Lists 55 counties for 8th-grade math, but omits pre-2014 numerical data. |
Legacy WVDE NCLB Portal / Print Cards | Statewide, 55 Counties, Schools | 1998–99 to 2005–06 | Offline Archival: Authoritative source for annual county tables; requires physical/archival retrieval. |
ERIC ED506214 (Center on Ed Policy) | Statewide by Grade | 2004–2008 | Statewide Only: Complete verified ELA and Math proficiency for grades 3–8 and 10 (2000–03 listed NA). |
Subgroup Equity Diagnostics and the WESTEST–NAEP Calibration Gap
During the 2005–06 school year, West Virginia served 280,866 students across 797 schools. The student population exhibited high rates of economic disadvantage (49.1% vs. 40.9% nationally) and special education needs (17.6% vs. 13.6% nationally), but a very small English Learner population (0.7% LEP vs. 8.5% nationally).
Disaggregated Subgroup Gaps (2002–03 Baseline)
In the 2002–03 transitional baseline administration (Grades 3–11), overall state proficiency was 61% in Reading and 69% in Mathematics. Disaggregation revealed deep achievement gaps:
- Racial Gap: Black non-Hispanic students trailed White peers by 34 percentage points in Reading (28% vs. 62%) and 15 percentage points in Mathematics (55% vs. 70%).
- Disability Gap: Students with disabilities trailed overall state averages by 22 points in Reading (39% vs. 61%) and 25 points in Mathematics (44% vs. 69%).
- Socioeconomic Gap: Economically disadvantaged students trailed overall state averages by 10 points in Reading (51%) and 8 points in Math (61%).
The WESTEST–NAEP "Honesty Gap"
State WESTEST proficiency cutoffs were set significantly lower than national NAEP standards. In 2005, 81% of West Virginia 4th graders were deemed proficient in Reading on WESTEST, whereas NAEP classified only 26% of 4th graders as proficient—a 55-percentage-point divergence.
Grade 4 Reading Calibration Gap (2005 / 2006–07)
WESTEST State Proficient: [==================== 81% - 83% ====================]
NAEP Basic Standard: [============= 63% =============]
NAEP Proficient Standard: [===== 26% - 28% =====]
| <------- 55 Percentage Point Gap -------> |
Adjacent CSPR and NAEP data from 2006–07 confirmed that state proficiency tracked closer to NAEP's Basic threshold:
- Grade 4 Reading (2006–07): WESTEST 83% vs. NAEP Basic 63% vs. NAEP Proficient 28% (55 pp gap).
- Grade 8 Reading (2006–07): WESTEST 80% vs. NAEP Basic 68% vs. NAEP Proficient 23% (57 pp gap).
- Grade 4 Math (2006–07): WESTEST 79% vs. NAEP Basic 81% vs. NAEP Proficient 33% (46 pp gap).
- Grade 8 Math (2006–07): WESTEST 71% vs. NAEP Basic 61% vs. NAEP Proficient 19% (52 pp gap).
This lenient cut score explains why 82.7% of West Virginia public schools met AYP in 2006–07 (compared to 70% nationally), even as Advanced Placement participation lagged national averages (13.6% vs. 24.2%).
Assessment Metric & Vintage | Subject & Grade Band | State Reported % Proficient | NAEP % Basic or Above | NAEP % Proficient | State vs. NAEP Gap |
2003 NAEP Baseline | Reading, Grade 4 | 61% (Gr 3–11 Baseline) | 65% | 29% | — |
2003 NAEP Baseline | Math, Grade 8 | 69% (Gr 3–11 Baseline) | 63% | 20% | — |
2005 Core Window | Reading, Grade 4 | 81% | Not Reported | 26% | +55 pp |
2006–07 CSPR / NAEP Context | Reading, Grade 4 | 83% | 63% | 28% | +55 pp |
2006–07 CSPR / NAEP Context | Reading, Grade 8 | 80% | 68% | 23% | +57 pp |
2006–07 CSPR / NAEP Context | Math, Grade 4 | 79% | 81% | 33% | +46 pp |
2006–07 CSPR / NAEP Context | Math, Grade 8 | 71% | 61% | 19% | +52 pp |
Interactive Web Implementation Blueprint and Primary Retrieval Protocol
To build a complete 55-county by 7-year interactive web database without scale distortion, historical data must be retrieved directly from archival state custodians.
Primary Archival Retrieval Strategy
- WVDE Records Request: Submit a formal request to the WVDE Office of Assessment (Building 6, 1900 Kanawha Boulevard East, Charleston, WV 25305) requesting flat-file extracts for all 55 counties:
- 1999–2000 through 2002–03 SAT-9 mean NPRs by grade (3–11) and subject.
- 2003–04 through 2005–06 WESTEST mastery level distributions (Novice through Distinguished) for all core subjects.
- 2000–2006 Writing Assessment mastery percentages for grades 4, 7, and 10.
- Library Compilations: Query West Virginia University and Marshall University libraries for print/microfiche volumes of West Virginia Report Cards: County-by-County Trend Data (1998–99 through 2002–03).
- KIDS COUNT Publications: Retrieve annual print KIDS COUNT Data Books (2001–2007) from the West Virginia Center on Budget and Policy (1610 Washington St. E., Suite 200, Charleston, WV 25311) to extract county-level free/reduced meal eligibility covariates.
Database Architecture Blueprint
To prevent inappropriate trendline interpolation across the 2003–04 assessment regime break, the interactive web application must enforce the following relational schema:
Schema Field Name | Data Type | Valid Formats & Range | Architectural Enforcement Role |
| String | 7-digit NCES ID / County Name | Primary key for district search, coalfield vs. panhandle filters, and GIS mapping. |
| String |
| Controls time slider; triggers visual regime breaks at 2003–04. |
| Enum |
| Prevents plotting norm-referenced NPRs on the same axis as criterion-referenced proficiency. |
| Enum |
| Filter tabs for all five tested academic domains. |
| Float | NPR (0–99) or % Proficient (0–100) | Enforces single-axis integrity; powers mastery tier tooltips. |
| Float / Null | Grade-specific AMOs (e.g., Elem ELA 72%) | Dynamically draws NCLB compliance lines on 2005–06 ELA and Math charts. |
Key Insights & Notable Verbatim Quotes
The following verbatim excerpts highlight the core empirical and policy insights governing West Virginia’s 2000–2006 assessment record:
Structural Measurement Break "Between 2000 and 2006, West Virginia's public K–12 assessment system underwent a structural break that prevents plotting all seven years on a single continuous numerical scale." — Context: Contextualizing the shift from SAT-9 national percentiles to WESTEST criterion-referenced mastery levels.
SAT-9 Item Reuse and Score Inflation "...West Virginia administered the exact same SAT-9 Form S test questions repeatedly from 1996 through 2002... between 1999 and 2002 not a single one of West Virginia's 55 counties had a majority of elementary students score below the national average (50th percentile)." — Context: Analysis from the Nonpartisan Education Review explaining why early SAT-9 county performance appeared artificially high.
High School Test-Taking Stakes "...Because WESTEST was not used as a high school graduation exit exam, lower student test-taking stakes in tenth grade may have compounded cumulative academic deficits as coursework progressed toward algebraic reasoning and complex literary analysis." — Context: Explaining why Grade 10 Reading dropped (-1 pp) and Grade 10 Math trailed elementary proficiency by up to 11 percentage points.
Coal-Mining County Achievement Gaps "...found statistically significantly lower proficiency pass rates in West Virginia coal-mining counties relative to non-mining counties (including a reported comparison of 74.87% versus 78.74%, p = .0001)." — Context: Cain & Hendryx (2010) findings on regional socioeconomic and environmental performance disparities across West Virginia's 55 counties.
Limitations of Statewide Aggregates "...because statewide totals pool all tested students, these headline margins did not guarantee that smaller rural counties or disaggregated demographic subgroups cleared the same thresholds... percent-proficient cutoffs [cannot] detect movement occurring well below or above the Mastery line." — Context: Cautioning against relying solely on state-level AMO compliance figures to evaluate district-level equity.
No comments:
Post a Comment