New Hampshire StatewideAssessment System2018–2019Volume 6Score Interpretation Guide
NH SAS 2018–2019 Technical Report: Volume 6TABLE OF CONTENTS1. NEW HAMPSHIRE SCORE REPORTS . 1Overview of New Hampshire’s Score Reports. 1Overall Scores and Reporting Categories . 2Online Reporting System. 4Available Reports on the New Hampshire Online Reporting System. 4Reporting by Subgroup . 5Reports . 6Summary Performance Report . 6Aggregate-Level Subject Report . 9Aggregate-Level Reporting Category Report . 12Aggregate-Level Standards Report . 16Student Roster Subject Report . 22Student Roster Reporting Category Report . 26Individual Student Report . 30Interpretive Guide. 36Reports by Subgroup . 37Data File . 392. INTERPRETATION OF REPORTED SCORES . 39Scale Scores . 39Standard Error of Measurement . 40Performance Levels . 40Achievement Category for Reporting Categories . 41Cut Scores . 41Aggregated Scores . 42Writing Performance . 42Relative Strengths and Weaknesses . 43Appropriate Uses for Scores and Reports. 433. SUMMARY. 44LIST OF TABLESTable 1: Reporting Categories for ELA/Reading . 3Table 2: Reporting Categories for Mathematics. 3Table 3: Disciplines for Science . 4Table 4: Score Reports Summary . 4Table 5: List of Subgroup Categories . 6Table 6: NH SAS ELA/Reading Proficiency Cut Scores . 41Table 7: NH SAS Mathematics Proficiency Cut Scores . 41Table 8: NH SAS Science Proficiency Cut Scores. 42Table 9: Writing Scoring Dimensions . 43Score Interpretation GuideiNew Hampshire Department of Education
NH SAS 2018–2019 Technical Report: Volume 6LIST OF FIGURESFigure 1: Sample State Summary Performance Report . 7Figure 2: Sample District-Level Summary Performance Report . 8Figure 3: Sample District Aggregate-Level Subject Report for Grade 6 Mathematics. 10Figure 4: Sample District Aggregate-Level Subject Report for Grade 6 ELA/Reading . 11Figure 5: Sample District Aggregate-Level Subject Report for Grade 5 Science . 12Figure 6: Sample District Aggregate-Level Reporting Category Report for Grade 6 Mathematics 14Figure 7: Sample District Aggregate-Level Reporting Category Report for Grade 6 ELA/Reading. 15Figure 8: Sample District Aggregate-Level Discipline Report for Grade 5 Science . 16Figure 9: Sample District Aggregate-Level Standards Report for Grade 6 ELA/Reading . 18Figure 10: Sample District Aggregate-Level Standards Report for Grade 6 Mathematics . 19Figure 11: Sample District Aggregate-Level Disciplinary Core Ideas Report for Grade 5 Science 22Figure 12: Sample Student Roster Subject Report for Grade 6 Mathematics . 23Figure 13: Sample Student Roster Subject Report for Grade 6 ELA/Reading . 24Figure 14: Sample Student Roster Subject Report for Grade 5 Science . 25Figure 15: Sample Student Roster Reporting Category Report for Grade 6 ELA/Reading . 27Figure 16: Sample Student Roster Reporting Category Report for Grade 6 Mathematics . 28Figure 17: Sample Student Roster Discipline Report for Grade 5 Science . 29Figure 18: Sample Individual Student Report for Grade 6 ELA/Reading . 31Figure 19: Sample Individual Student Report for Grade 6 Mathematics . 33Figure 20: Sample Individual Student Report for Grade 5 Science . 35Figure 21: Supplemental Interpretive Guide . 37Figure 22: Sample District Aggregate-Level Subject Report for Grade 6 Mathematics, by EnrolledGrade . 38Figure 23: Data File . 39LIST OF APPENDICESAppendix A: Online Reporting System User GuideAppendix B: NH SAS AutoScore Frequently Asked QuestionsAppendix C: New Hampshire Statewide Assessment System, Printing Batch ISRsScore Interpretation GuideiiNew Hampshire Department of Education
NH SAS 2018–2019 Technical Report: Volume 61. NEW HAMPSHIRE SCORE REPORTSIn spring 2019, the following New Hampshire Statewide Assessment System (NH SAS) tests wereadministered to New Hampshire students: grades 3–8 English language arts (ELA); grades 3–8mathematics; and grades 5, 8, and 11 science. In this technical report, the term reading is used whenreferring only to the reading test component or items; writing is used when referring only to the textbased writing task.The purpose of the Score Interpretation Guide is to document the features of the New HampshireOnline Reporting System (ORS), which is designed to assist stakeholders in reviewing anddownloading the test results and understanding and appropriately using the results of the stateassessments. Additionally, this volume describes the score types reported for the spring 2019assessments, the appropriate uses of those score types, the inferences that can be drawn from them,and features of the score report.OVERVIEW OF NEW HAMPSHIRE’S SCORE REPORTSNH SAS tests were administered statewide in spring 2019. Test scores from each spring 2019assessment were provided to districts and schools through the New Hampshire ORS almostimmediately after tests were graded, starting on March 19, 2019. The ORS provides information onstudent performance and aggregated summaries at several levels: state, district, school, teacher, androster.The ORS (https://nh.reports.airast.org/) is a web-based application that provides NH SAS results atvarious levels. Test results are available for users based on their roles and the privileges they receivebased on the authentication granted to them. There are four basic levels of user roles: the state, district,school, and teacher levels. Each user is granted drill-down access to reports in the system based onhis or her assigned role. This means that teachers can access data for their roster(s) of students only,schools can access data for the students in their school only, and districts can access data for allschools and students in their district.The following users have access to the system: State users can access all data at the state, district, school, teacher, and student levels.District Test Coordinator (DC) users can access all data for their district and the schoolsand students in their district.School Test Coordinator (SC) users can access all data for their school and the students intheir school.Teacher (TE) users can access all aggregate data for their roster(s) and the students withintheir roster(s).Access to reports is password protected, and users can access data at and below their assigned level.For example, an SC user can access the school report of students for his or her school but not foranother school.Score Interpretation Guide1New Hampshire Department of Education
NH SAS 2018–2019 Technical Report: Volume 6OVERALL SCORES AND REPORTING CATEGORIESEach student receives a single scale score for each subject tested if there is a valid score to report.The validity of a score is determined using invalidation rules, which define a set of parameters underwhich a student’s test may be counted. For ELA and mathematics, a student’s score will beautomatically invalidated if he or she fails to respond to at least five test items. Failure to provide aresponse in the written portion of ELA tests will also result in an invalidated score. For science, ascore is invalidated only if the student did not complete at least one item on the test (or the score ismanually invalidated). Normally, a student takes a test in the test delivery system (TDS) and thensubmits it. The TDS then forwards the test for scoring before the ORS reports the scores. However,tests may also be manually invalidated before reaching the ORS if testing irregularities occur (e.g.,cheating, unscheduled interruptions, loss of power or Internet).A student’s score is based on only the operational items on the assessment. A scale score is used todescribe how well a student performed on a test and can be an estimate of students’ knowledge andskills measured. The scale score is transformed from a theta score, which is estimated based on itemresponse theory (IRT) models as described in Volume 1 of this technical report. Low scale scoresindicate that the student does not possess sufficient knowledge and skills measured by the test.Conversely, high scale scores indicate that the student has proficient knowledge and skills measuredby the test. Interpretation of scale scores is more meaningful when the scale scores are used alongwith performance levels and performance-level descriptors (PLDs).Based on the scale score, a student will receive an overall performance level. Performance levels areproficiency categories on a test, which students fall into based on their scale scores. For the NH SAS,scale scores are mapped into four performance levels: Level 1: Below ProficientLevel 2: Approaching ProficientLevel 3: ProficientLevel 4: Above ProficientPLDs set out content-area knowledge and skills that students at each performance level are expectedto possess. PLDs are determined by comparing a student’s scale score against carefully determinedcut scores, which are unique to each grade and subject. Cut score points are listed in Section 2.5: CutScores, with additional details included in Volume 3.Performance levels can be interpreted based on PLDs, which represent a more descriptive analysisof a student’s abilities based on his or her performance level. Generally, students performing on NHSAS at Levels 3 and 4 are considered on track to demonstrate progress toward mastery of theknowledge and skills necessary for college and career readiness.In addition to an overall score, students will receive reporting category scores. Reporting categoriesrepresent distinct groups of knowledge within each grade and subject. For the NH SAS, studentperformance on each reporting category is reported using three achievement categories:1. Low2. At or Approaching3. On or AboveScore Interpretation Guide2New Hampshire Department of Education
NH SAS 2018–2019 Technical Report: Volume 6Unlike the performance levels for the overall test, student performance within each of the reportingcategories is evaluated entirely in relation to the reporting category proficiency cut score.Performance-level classifications are computed to classify student performance levels for each ofthe content-standard subscales. For each subscale, the band is generally defined as a range extending1.5 Standard Error of Measurement (SEM) below to 1.5 SEM above the proficiency cut score usedon the overall test.Students performing at either Low or On or Above can be interpreted as student performance clearlybelow or above the Proficient cut score for a specific reporting category. Students performing at Ator Approaching can be interpreted as student performances that do not provide enough informationto tell whether students reached the Proficient mark for the specific reporting category. Students areclassified as At or Approaching if the spread of their SEM (as described in the previous paragraph)lies both above and below the performance level’s proficiency cut score.Table 1, Table 2, and Table 3 display the reporting categories by grade and subject.Table 1: Reporting Categories for ELA/ReadingGrade3–8Reporting Category1. Reading Literary Text2. Reading Informational TextTable 2: Reporting Categories for MathematicsGradeReporting Category3–220.127.116.11.5.Operations and Algebraic ThinkingNumber and Operations in Base Ten and FractionsMeasurement, Data, and GeometryModeling and Problem SolvingUse Mathematical Reasoning18.104.22.168.5.Ratios and Proportional Relationships and Number SystemsExpressions and EquationsGeometry & Statistics and ProbabilityModeling and Problem SolvingUse Mathematical Reasoning22.214.171.124.5.6.Ratios and Proportional Relationships and Number SystemsExpressions and EquationsGeometryStatistics and ProbabilityModeling and Problem SolvingUse Mathematical Reasoning126.96.36.199.5.Expressions and Equations and Number SystemsFunctionsGeometry & Statistics and ProbabilityModeling and Problem SolvingUse Mathematical ReasoningScore Interpretation Guide3New Hampshire Department of Education
NH SAS 2018–2019 Technical Report: Volume 6Table 3: Disciplines for ScienceGrade5, 8, 11Discipline1. Physical Sciences2. Life Sciences3. Earth and Space SciencesONLINE REPORTING SYSTEMThe ORS generates a set of online score reports that describes student performance for students,parents, educators, and other stakeholders. The online score reports are produced after the tests aresubmitted by the students, hand-scored and machine-scored, and processed into the ORS. In additionto each individual student’s score report, the ORS produces aggregate score reports for teachers,schools, districts, and states. The timely accessibility of aggregate score reports helps users monitorstudent performance in each subject and grade area, evaluate the effectiveness of instructionalstrategies, and inform the adoption of strategies to improve student learning and teaching during theschool year.Furthermore, to facilitate comparisons, each aggregate report contains the summary results for theselected aggregate unit, as well as all aggregate units above the selected aggregate. For example, ifa school is selected, the summary results of the district to which the school belongs and the summaryresults of the state are also provided so that the school performance can be compared with the districtperformance and the state performance. If a teacher is selected, the summary results for the school,district, and state above the teacher are also provided for comparison purposes. Table 4 lists the typesof online reports and the levels at which they can be viewed (student, roster, school, district, andstate).AVAILABLE REPORTS ON THE NEW HAMPSHIRE ONLINE REPORTINGSYSTEMThe New Hampshire ORS is hierarchically structured. An authorized user can view reports at his orher own aggregated unit and any lower level of aggregation. For example, a school user can viewthe reports and data at the school and student levels of his or her school only. DC users can view thereports and data for their districts and the student-level results for all their schools.Table 4 summarizes the types of score reports that are available in the ORS and the levels at whichthe reports can be viewed. A description of each report is also provided. Data files are also accessiblefor districts to download.For detailed information on available reports and features, educators can refer to the ORS user guide.The 2018–2019 NH SAS Online Reporting System User Guide is included in Appendix A.Table 4: Score Reports SummaryReportDescriptionSummaryPerformanceSummary of achievement (to date)across grades and subjects orcourses for the current administrationScore Interpretation GuideLevel of Availability4StateDistrictSchoolRoster StudentNew Hampshire Department of Education
NH SAS 2018–2019 Technical Report: Volume 6ReportAggregate-LevelSubject ReportAggregate-LevelReportingCategory ReportAggregate-LevelStandard ReportStudent-LevelSubject ReportStudent-LevelReportingCategory ReportDescriptionLevel of AvailabilitySummary of overall performance for asubject and a grade for all students inthe defined level of aggregationSummary of overall performance oneach reporting category for a givensubject and grade across all studentswithin the selected level ofaggregationSummary of overall performance oneach standard for a given subject andgrade across all students within theselected level of aggregationList of all students who belong to aschool, teacher, or roster with theirassociated subject or course scoresfor the current administration.List of all students who belong to aschool, teacher, or roster with theirassociated reporting categoryperformance for the currentadministrationIndividual StudentReportDetailed information about a selectedstudent’s achievement in a specifiedsubject or course, including overallsubject and reporting category resultsData FilesText/CSV files containing overall andreporting category scale scores andperformance levels along withdemographic in
NH SAS 2018–2019 Technical Report: Volume 6 Score Interpretation Guide 1 New Hampshire Department of Education 1. NEW HAMPSHIRE SCORE REPORTS In spring 2019, the following New Hampshire Statewide Assessment System (NH SAS) tests were administered to New Hampshire stu
2015 NEW HAMPSHIRE AERONAUTICS PROGRAM REVIEW CONFERENCE May 8, 2015 8 The Bureau of Aeronautics is responsible for providing New Hampshire with an air transportation system that is safe and efficient. In addition to our State, New Hampshire airports have a regional and national importance. Airports allow an opportunity
FRANCHISE AGREEMENT BETWEEN THE TOWN OF BARRINGTON, NEW HAMPSHIRE AND METROCAST CABLEVISION OF NEW HAMPSHIRE, LLC WHEREAS, MetroCast Cablevision of New Hampshire, LLC (hereinafter "MetroCast" or "Franchisee") is the duly authorized current holder of a cable television franchise authorizing the construction and operation of a cable communications system in the Town of Barrington,
This Annual Report Form shall be flied with the New Hampshire Public Utilities Commission, 8 Old Suncook Road, Concord, New Hampshire 03301-5185,on or before March31 of each year, in accor dance with the requirements of New Hampshire RSA 374:13 Form of Accounts and Records.
2 0 1 4 A N N U A L R E P O R T. New Hampshire Historical Society Page 2 2014 Annual Report 30 Park Street Concord, New Hampshire 03301 . William P. Veillette Amherst Bert R. Whittemore Concord Phil Zea . Mount Washington Cog Railway New Hampshire Distributors, Inc. New Hampshire Federal Credit Union BUSINESS PARTNERS
80-1208 New England Power v. New Hampshire 80-1471 Commonwealth v. New Hampshire 80-1610 Roberts v. New Hampshire MEMORANDUM TO THE CONFERENCE: As suggested at our last Conference, I have prepared - with assistance from Frank Lorson - the attached form of a propo
Community Engagement and Leadership in the Statewide Health Improvement Partnership This report is part of a series of Statewide Health Improvement Partnership (SHIP) evaluation studies. . Minnesota’s Statewide Health Improvement Partnership is a chronic disease prevention initiative active in all 87 Minnesota counties and 10 Tribal Nations .
Illinois Initial Statewide Transition Plan - February 2020 3 Summary of Revisions to Illinois' HCBS Waiver Statewide Transition Plan The following is a brief listing of major additions/changes made to this Statewide Transition Plan since the previous version was posted to Illinois Healthcare and Family Services' website on February 1, 2017.
Studying the Korean language is even more challenging and fascinating than studying other languages. Korea has an ancient culture. Over the centuries, it has— amazingly—been able to mix all the influences coming from Central Asia, the Steppes, Manchuria, China, Japan, and the West into a beautiful, brilliant, and unique new culture. This cultural richness has affected the Korean language .