DATA - Washington State Board Of Education

Title:As Related To:Relevant ToBoard Roles:PolicyConsiderations /Key Questions:Smarter Balanced Assessment Results DiscussionGoal One: Develop and supportpolicies to close the achievementand opportunity gaps.Goal Three: Ensure that everystudent has the opportunity to meetcareer and college ready standards.Goal Two: Developcomprehensive accountability,recognition, and supports forstudents, schools, and districts.Goal Four: Provide effectiveoversight of the K-12 system.Policy LeadershipSystem OversightAdvocacyCommunicationConvening and FacilitatingWhat insights can be gathered from data on Smarter Balanced assessmentresults? What conclusions do these insights yield about Smarter Balancedimplementation?Possible BoardAction:ReviewApproveMaterialsIncluded inPacket:MemoGraphs / GraphicsThird-Party MaterialsPowerPointSynopsis:OtherAdoptOtherThis section of the packet includes a data spotlight on Smarter Balancedassessment results. The spotlight addresses the following five takeaways: What does the participation rate look like across the state? How does the academic performance of Washington students compareto students from other states on the Smarter Balanced assessment(SBA)? How many 11th grade students who tested in Level 1 or 2 on the HSPEwere eligible to meet graduation requirements by passing the SBA? How does the performance by students on the 5th and 8th grade scienceMSPs in 2015 compare to previous years? Even though the Smarter Balanced assessments are very different fromthe MSPs, you probably want to know how the 2014 MSP proficiencydata compare to the 2015 Smarter Balanced data for grades 3 to 8.Prepared for the September 10-11, 2015 Board Meeting114

DATA SPOTLIGHT ON SMARTER BALANCED ASSESSMENT RESULTSWhat does the participation rate look like across the state?The participation rates on the 11th grade Smarter Balanced assessment were about 50 percent statewidebut varied considerably by district. Participation was especially low in the Puget Sound area, King andPierce counties, and along I‐5 and I‐90. The map below shows the districts with the lowest participationhighlighted in red. Federal and state accountability systems require that at least 95 percent of studentsparticipate in the statewide assessments.Table 1: Districts with the lowest reported AYP participation rates in math in Washington.School DistrictLopez SDSnohomish SDStanwood‐Camano SDOrcas Island SDEnumclaw SDMercer Island SDEdmonds SDFederal Way SDBellevue SDLa Conner SDAYP MathParticipation Rates13.3 %13.5 %14.6 %16.6 %17.0 %17.5 %18.4 %18.4 %18.7 %18.8 %Prepared for the September 10‐11, 2015 Board Meeting115The student participation rates on the statewideassessments differ for ELA and math, with the ELArate typically being a little higher than the mathparticipation rate. Table 1 shows the schooldistricts with the lowest participation rates on theSmarter Balanced math assessment as reportedby the OSPI. Districts with very low participationrates are not reported per OSPI suppression rules.

How does the academic performance of Washington students compare to students from other stateson the Smarter Balanced assessment (SBA)?Washington students generally score higher on the NAEP and SBA than the other states that havereleased SBA results. Washington’s math results are particularly high as compared to the other states.More students meet proficiency standards on the SBA than the NAEP. Why might this be? For all state data examined here, a higher percentage of students meet standards on the SBAthan on the NAEP and of the two content areas, the results for the math assessments are themost alike. This suggests that the level of rigor needed to reach proficiency is lower for theSmarter Balanced than for the NAEP.One cannot say for certainty that there is a difference in the level of rigor required to reachproficiency because the NAEP is reading only and the SBA combines reading and writing into anELA assessment. Also, the NAEP is administered to a representative sample of students whilethe SBA is administered to all students. Students who took the NAEP in 2013 are a differentcohort than the students who took the Smarter Balanced in 2015.State to state comparisons are complicated by assessments that are designed in partnershipwith the consortium but are tailored to be unique to a given state. Missouri and Idaho areadministering customized SBA tests that share some elements of the SBA but may be differentin meaningful ways. This is an early state comparison and, in the future, differences amongstate‐specific assessments by SBAC and differences in demographics or economics will need tobe considered in state‐to‐state comparisons. In this analysis, Oregon is the closest comparisonto Washington in demographics, economics, location, and use of the same assessment.Table 2: Comparison of Smarter Balanced assessment results to the latest NAEP results.*Missouri uses the Missouri Assessment Program(MAP), a state‐administered assessmentdeveloped in partnership with the SmarterBalanced Assessment Consortium.**Only preliminary results are available fromIdaho, full results will be released in October2015. Idaho uses the Idaho StandardAchievement Tests (ISAT) by Smarter Balanced.Values are based on percentage proficient. Theaverage is based on the mean of the five states.Difference is 2015 SBA minus 2013 NAEP.These data are a WA SBE follow‐up to theHechinger Report: The surprising initial resultsfrom a new Common Core exam article thathighlighted the difference between newassessment results and 2013 NAEP results.Fourth Grade English AverageIdaho**Missouri*OregonWashingtonWest VirginiaEighth Grade English AverageIdaho**Missouri*OregonWashingtonWest VirginiaFourth Grade Math AverageIdaho**Missouri*OregonWashingtonWest VirginiaEighth Grade MathAverageIdaho**Missouri*OregonWashingtonWest VirginiaPrepared for the September 10‐11, 2015 Board Meeting1162013 NAEP 2015 SBADifference33.651.2 17.63346 133559 243351 184055 152745 1835.653.6 183852 143658 223758 214257 152543 1840.446 5.64046 63950 114045 54854 63535033.836 2.23637 13328‐53444 104246 42425 1

2015 SBA Result2013 NAEP NationalAverage2013 NAEP ResultThese two charts visually demonstrate that each of the five states had a greater deviation between SBAresults and NAEP results in reading than in math. The deviation is even greater at the eighth grade level.How many 11th grade students who tested in Level 1 or 2 on the HSPE were eligible to meet graduationrequirements by passing the SBA?Of the 11th grade students not having met the HSPE Reading or Writing or the EOC Math graduationrequirements as 10th graders, 1384 met or exceeded the SBAC ELA scaled score of 2548 meaning that these students can usethe SBAC result as an approved alternative for meeting the ELA graduation requirement. 135 met or exceeded the SBAC Math scaled score of 2595 and will be able to use the SBAC resultas an approved alternative for meeting Math graduation requirement.Prepared for the September 10‐11, 2015 Board Meeting117

How does the performance by students on the 5th and 8th Grade Science MSPs in 2015 compare toprevious years?The percentage of students meeting standards in science was lower in 2015 for all (except for one)student groups on both the 5th and 8th Grade MSPs after remaining relatively stable for the previousthree years. On the two charts below, the number of students comprising each group is included in theparentheses to the right of the bar chart label. The charts show that the achievement gaps in science forthe Targeted Subgroup members increased because the decline in 2015 was greater for the TargetedSubgroup members than for the Non‐Targeted Subgroup members.The percentage of students meeting standard on the 5th Grade MSP in Science Fell three percentage points (4.4 percent) in 2015 from 2012 for the All Students group. Fell more than 4.4 percent for the Hispanic, Black, Pacific Islander, and American Indian groups.5th Grade SciencePercent Change from 2012 to 2015ALL Students (78,520)Asian (4543)White (43,931)Two or More (5,485)Hispanic/Latino (17,506)Black/African American (3453)Hawaiian/Pacific Islander (828)American Indian/Alaskan Native ��11.7‐25‐20‐15‐10‐50Percent ChangeThe percentage of students meeting standard on the 8th Grade MSP in Science Fell 6.6 percentage points (8.6 percent) in 2015 from 2012 for the All Students group. Fell more than 8.6 percent for the Hispanic, Black, and American Indian student groups.8th Grade SciencePercent Change from 2012 to 2015ALL Students (78,795)Asian (5,977)Two or More (5,081)White (45,404)Hawaiian/Pacific Islander (816)Hispanic/Latino (16,561)Black/African American (3.471)American Indian/Alaskan Native 7‐23.1‐25‐20‐15‐10‐5Percent ChangePrepared for the September 10‐11, 2015 Board Meeting1180

Even though the Smarter Balanced assessments are very different from the MSPs, you probably wantto know how the 2014 MSP proficiency data compare relative to the 2015 Smarter Balanced data forgrades three to eight.PERCENT MEETING STANDARDM S P R EA D I N G A N D S BAC E L 7.653.956.756.8GRADE 5GRADE 6GRADE 7GRADE 8The percentages ofstudents meetingstandard on the 2015SBAC ELA are 10 to 20percentage points lowerthan 2014 MSP Readingpercentages.200GRADE 3GRADE 4PERCENT MEETING STANDARDM S P M AT H A N D S BAC M AT 5.948.045.546.1200GRADE 3GRADE 4GRADE 5GRADE 6GRADE 7GRADE 8PERCENT MEETING STANDARD ‐ SBACPERCENT MEETING STANDARDThe percentages ofstudents meetingstandard on the 2015SBAC Math are 7 to 18percentage points lowerthan the corresponding2014 MSP 56.84052.054.048.045.548.046.1GRADE 3GRADE 4GRADE 5GRADE 6200GRADE 7Prepared for the September 10‐11, 2015 Board Meeting119GRADE 8See that the percentage ofstudents meeting standardon the SBAC ELA increasesfrom the lower grades tothe upper grades (52.0 to56.7 percent), while thepercentage of studentsmeeting standard on theSBAC math decreasesfrom the lower grades tothe upper grades (56.6 to46.1 percent).

How does the performance by students on the 5th and 8th grade science MSPs in 2015 compare to previous years? Even though the Smarter Balanced assessments are very different from the MSPs, you probably want to know how the 2014 MSP proficiency data compare to the 2015 Smarter Balanced data for grades 3 to 8. 114