Administration Practices For Standardized Assessments

3y ago
35 Views
2 Downloads
487.45 KB
13 Pages
Last View : 8d ago
Last Download : 3m ago
Upload by : Aarya Seiber
Transcription

.assessment reportAdministration Practices forStandardized Assessments.Sasha ZuckerWith assistance from:Margarita GalindoElaine GraingerNancy SeveranceApril 2004Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsAdministration Practicesfor Standardized AssessmentsNote: This report is based on “Appropriate Administration Practices withStandardized Tests” published in Testing Information Bulletin No. 3 by HarcourtBrace Educational Measurement, June 1996.IntroductionPearson Inc. (Pearson) develops and distributes a variety ofassessments for educational and clinical purposes. To meet the goal of producinghighly valid, reliable results for test users, each of these products is developedaccording to strict guidelines. For standardized tests, the way in which the test isadministered is equally important. By carefully adhering to administration practices, atest user can contribute to the validity and reliability of each student’s results.Moreover, following appropriate administration practices satisfies widely acceptedethical standards and codes of responsibilities required for test administrators. Thisreport discusses general and documented administration practices for standardizedassessments, especially with regard to Pearson’s educational assessment products,such as the Stanford Achievement Test Series, Tenth Edition (Stanford 10).Assessment StandardizationThe way in which an assessment is administered to students is especially importantfor standardized assessments. During the development process, standardizationestablishes uniform procedures for using the assessment so that observation,administration, equipment, materials, and scoring rules will be the same for everystudent to whom it is administered (Millman and Greene, 1993). The goal of thisuniformity is to make the assessment’s results as objective as possible so that they canbe considered valid and meaningful when used to compare the assessed qualities ofstudents. If an assessment’s results are perceived to have been significantly affectedby external factors that occur before, during, or after its administration, they canfeasibly be considered subject to different interpretations, thereby decreasing theirinformational value (Nitko, 2004). Standardization attempts to control these externalfactors to the greatest degree possible so that the assessment is a valid measurementtool that produces meaningful results.2Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsFor a norm-referenced assessment, such as Stanford 10, standardization is especiallyimportant. A valid scoring system for a norm-referenced assessment—such aspercentile ranks, stanines, or normal curve equivalents—can only be developed usinglarge-scale trials with a well-defined, national sample of students (the norm group).The standardization process is conducted under highly controlled conditions,including the time limits (if specified) for each test in the assessment’s battery, thematerials the students may use during the assessment (such as scratch paper orcalculators), and the directions for administering (see Figure 1).When the published version of the assessment is administered to students, theconditions under which the test was normed must be replicated as closely as possible.Deviation from the norming conditions may invalidate scores that measure a student’sachievement compared to the norm group and can make the results less meaningful(Nitko, 2004). Therefore, the administrator of a norm-referenced test should carefullyfollow the directions for administering.Figure 1. Directions for administering the Stanford 10 Primary 1 Practice Test.3Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsPearson’s rigorous attention to detail is reflected in the extensive directions foradministering created for each assessment. The directions for administering for eachassessment product provide specific instructions for procedures to follow before,during, and after test administration. The are each developed and evaluated prior totest standardization. During standardization, the materials are verified for accuracyand utility. Care should be taken in following a test’s directions for administering. Asdiscussed below, certain accommodations may be necessary.Assessment Accommodations and ModificationsIt is important to note that in certain cases changes to the administration of astandardized assessment may be appropriate. The No Child Left Behind Act of 2001(NCLB), as well as the 1997 reauthorization of the Individuals with Disabilities Act of1975 (IDEA), requires changes to an assessment to accommodate the needs ofstudents with disabilities and English language learners.Assessment AccommodationsAn assessment accommodation can be a change in format, response, setting, timing,or scheduling that does not alter in any significant way what the test measures or thecomparability of scores (Phillips, 1993). A change to an assessment qualifies as anaccommodation when it has been demonstrated as not invalidating a student’s results.Accommodations that are appropriate are often detailed in the individual educationplan (IEP) for a student with a disability and should already be present in theclassroom environment (Nitko, 2004; Thurlow, Elliott, and Ysseldyke, 1998; Tindaland Fuchs, 1999). For further discussion of the types of accommodations that arepermitted for Pearson’s assessment products, see Case, 2003a and Case, 2003b.Assessment ModificationsIn contrast, an assessment modification refers to a change in administration that altersthe constructs assessed or the comparability of scores (Phillips, 1993). When makingchanges to an assessment to meet a student’s needs, policy makers (at state educationagencies or large school districts) must determine whether the change is anaccommodation or a modification. If the change is an accommodation, then the scorescan be compared to the scores of other students (and aggregated with the norm group,if applicable). If the change is a modification, the student’s results may need to bereported separately from those of the other students and can be compared only to theresults of students who were administered the test with the same modification.4Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsProfessional Responsibilities in Assessment AdministrationAnyone administering an educational assessment to students is expected to assumecertain responsibilities documented in the codes and standards of professionaleducation organizations. Some general principles of appropriate conduct for personsadministering assessments include protecting the safety, health, and welfare of allexaminees; knowing and complying with relevant state and federal laws; maintainingand improving competence in educational assessment; and performing allresponsibilities with honesty, integrity, due care, and fairness (Nitko, 2004). TheCode of Professional Responsibilities in Educational Measurement (the NationalCouncil on Measurement in Education, 1995) offers guidance for those whoadminister assessments, including the responsibilities to “understand the proceduresneeded to administer the assessment prior to administration”; to “administerstandardized assessments according to the prescribed procedures and conditions”; andto “avoid any conditions in the conduct of the assessment that might invalidate theresults.” These standards of conduct are widely recognized and apply to anyone whotakes the professional responsibility of administering an assessment to students.Qualifications for Using AssessmentsFor certain Pearson assessment products, purchasing eligibility is restricted toindividuals with specific training and experience in a relevant area of assessment.Pearson complies with the Standards for Educational and Psychological Testing(American Educational Research Association et al., 1999) and with the professionaland ethical standards of several professional organizations, including the AmericanCounseling Association (ACA), the American Psychological Association (APA), theCouncil of Exceptional Children (CEC), the National Association of SchoolPsychologists (NASP), and the previously mentioned National Council onMeasurement in Education. To uphold these standards, Pearson may require propercredentials from the purchaser of an assessment and retains the right to withhold orwithdraw approval for a test purchase where there is evidence of violation ofcommonly accepted testing practices. See Pearson’s catalogs of assessment productsfor detailed information about purchasing qualifications.Qualifications for Using Educational AssessmentsAlthough some assessment instruments require specialized training to ensure theirappropriate professional use, Stanford 10 is designed to be administered by a teacheror counselor without the need for additional specialized qualifications or training. Forelementary school students, the administrator is usually the students’ teacher.However, the test administrator is expected, in accordance with the professionalresponsibilities discussed above, to become familiar with the Stanford 10 directionsfor administering and strictly follow examination procedures.5Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsQualifications for Using Psychological AssessmentsPearson publishes psychological assessment products for a wide variety of users,including paraprofessionals, education specialists, and individuals with a high level oftraining in administering and interpreting results from specific tests. Some tests, suchas intelligence tests, are restricted to individuals with this specific training, whileothers are not. Pearson indicates who is qualified to use the psychologicalassessments in its catalog by classifying them as A-, B-, or C-level instruments.Table 1. Instrument Level Classifications and Qualified Users.Instrument LevelQualified UsersAIndividuals without advanced training inassessment administration and interpretation ofassessment results.BIndividuals with more expertise than usersqualified for an A-level instrument as theadministration of the assessment and interpretationof its results are more complex. Individualscertified by an organization recognized byPearson and with relevant training and experiencein administering and interpreting the assessmentmay qualify.CIndividuals with a doctorate in psychology,education or a related field, or licensure.Individuals with certification by certain agenciesand national organizations may also qualify basedon training and expertise.For additional information on qualifications for purchasing and using Pearsonassessment products, contact the Pearson Qualifications Group at 1-800-211-8378.6Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsProcedures Before TestingTo ensure that a standardized educational assessment produces results that accuratelyassess student achievement, Pearson recommends that, in addition to the productspecific directions for administering, examiners follow the procedures below.Maintaining Assessment Security and IntegrityUpon purchasing and receiving assessment materials from Pearson, the testadministrator must protect their security and value by guarding them against improperuse and distribution. Materials should be stored in locked files or storage cabinets thatare accessible only to authorized personnel. No reproduction of test materials isallowed in any form or by any means, electronic or mechanical. The materials shouldbe released only to persons who are qualified to interpret and use them properly, whohave a professional, responsible interest in their use, and who agree to safeguard theirsecurity and integrity.Preparing Students for TestingThe test administrator may also be responsible for preparing the students for theassessment. For students to give their maximum performance on an educationalassessment, those who are responsible for administering the assessment must providethem with basic information that they require, including when the assessment will beadministered, the content and abilities that will be assessed, what the assessment willemphasize, the standard or level of performance expected, how the assessmentperformance will be scored, and how the results of the assessment will be used tomake decisions (Mehrens & Lehmann, 1991; Nitko, 2004).It is Pearson’s view that the best preparation that teachers can provide to theirstudents for a standardized educational achievement test is to focus instruction on thelocal curriculum rather than on the format and content of a specific test. Schools mayalso prepare students for a standardized assessment by teaching general test-takingskills, such as paying attention to oral and written directions, writing responses ormarking answers neatly, and using assessment time wisely to complete all therequired tasks (Nitko, 2004; Oosterhof, 2001).To assist students in preparing for Stanford 10, Pearson publishes Stanford 10practice tests that were factored into the assessment’s standardization process.Materials for students who require further assistance with test-taking skills arepublished by Pearson Achieve under the Rigby and Steck-Vaughn imprints(http://www.pearsonassess.com).Stanford 10 Practice TestsStanford 10 incorporates a number of design innovations that set it apart fromtraditional standardized achievement tests, including full-color layout, use of placemarkers to guide early-grade-level students, and no time limits. To help familiarizeboth test administrators and students with this new test-taking experience in a way7Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized Assessmentsthat does not invalidate results, practice tests for the SESAT, Primary, Intermediate,and Advanced levels of Stanford 10 are available. The Advanced level practice testmay also be used for the TASK levels. Stanford 10 practice tests are very brief andare designed to familiarize the test administrators and students with the test’s contentand format.If available, this practice test should be administered one week before the actualassessment is scheduled to occur. This practice allows both students and testadministrators to learn to follow the directions and fill in the answer spaces correctly.Moreover, the practice test enables students to understand how to respond to thedifferent types of Stanford 10 items. Finally, because norm groups used practice testsduring the standardization process, norm-referenced scores from Stanford 10 are mostaccurate when students have taken the practice tests prior to taking the actualStanford 10.Preparing Test Administrators for TestingPersons administering a standardized assessment should familiarize themselves withthe materials and procedures well in advance of the testing periods. If permitted bythe school district, they should carefully read and examine the directions foradministering, student test booklets, answer documents, and any other materialsprovided for testing.Scheduling Testing PeriodsTesting periods should be scheduled at a time that encourages maximum studentperformance. Scheduling test periods immediately before or after a vacation, on thedays of school events, on Monday mornings, or on Friday afternoons is discouraged.It is recommended that no more than two subtests be administered in one sitting andthat a brief rest period be given between subtests. The Stanford 10 directions foradministering recommends rest periods of approximately 10 minutes.One of the features of Stanford 10 is that it is an untimed test. A time schedule foreach subtest based on research from standardization is provided for planningpurposes. Test administrators should plan for enough time for students to completethe test.Selecting a Testing EnvironmentThe environment selected for administering Pearson’s educational assessmentsshould parallel the classroom environment as closely as possible. Standardizededucational assessments should be administered to classroom-sized groups of abouttwenty-five students. In larger groups, the test administrator should have one assistantfor every 25 students (see Table 2). Because students seem to perform better whenthey are familiar with the test administrator, the persons administering the testsshould, if possible, be the students’ own classroom teachers. Any people who assistthe test administrator should also be familiar to the students.8Copyright 2004 by Pearson Education, Inc. or its affiliate(s). All rights reserved.Pearson and the Pearson logo are trademarks of Pearson Education, Inc. or its affiliate(s).

.ASSESSMENT REPORTAdministration Practices for Standardized AssessmentsTable 2. Administrators and Proctors Required for Test Administration.Number of StudentsAdministrators Required1–251 administrator26–501 administrator and 1 proctor51–751 administrator and 2 proctors76–1001 administrator and 3 proctorsPractices During TestingDuring testing, the test administrator should follow the directions for administeringexactly as written. The directions for administering typically include informationabout the following.Testing MaterialsPersons administering educational assessments may be required to supply certainmaterials that students need to complete the assessment. For example, mosteducational assessments require test booklets, answer sheets, soft-lead pencils, andscratch paper. Certain levels of Stanford 10 allow students to use place markers tohelp keep their place on the page or in the test booklet, rulers, mathematics formulareference sheets, and calculators, if allowed for mathematics subtests.The directions for administering may also specify materials required by the personsadministering the assessment. Extra materials required by the students should be kepton hand and distributed as necessary. A “DO NOT DISTURB” sign should beavailable to hang on the door to the testing room. Although Stanford 10 isstandardized as an untimed test giving students the opportunity to respond to everyitem without a time limit (Case, 2003c), the directions for administration recommendthat a digital watch or a clock with a second hand be available for the administrator.The Testing Room EnvironmentThe physical conditions of the room should be carefully controlled during testing.Students should be seated in an arrangement that prevents them from seeing the workof other students. The students’ desks and work spaces should be clear with sufficientroom for the test booklets and answer sheets. Cover any materials and information onthe walls, bulletin boards, and chalkboards that might help students to answer9Copyright 2

ASSESSMENT REPORT Administration Practices for Standardized Assessments 2 Administration Practices for Standardized Assessments Note: This report is based on “Appropriate Administration Practices with

Related Documents:

Bruksanvisning för bilstereo . Bruksanvisning for bilstereo . Instrukcja obsługi samochodowego odtwarzacza stereo . Operating Instructions for Car Stereo . 610-104 . SV . Bruksanvisning i original

10 tips och tricks för att lyckas med ert sap-projekt 20 SAPSANYTT 2/2015 De flesta projektledare känner säkert till Cobb’s paradox. Martin Cobb verkade som CIO för sekretariatet för Treasury Board of Canada 1995 då han ställde frågan

service i Norge och Finland drivs inom ramen för ett enskilt företag (NRK. 1 och Yleisradio), fin ns det i Sverige tre: Ett för tv (Sveriges Television , SVT ), ett för radio (Sveriges Radio , SR ) och ett för utbildnings program (Sveriges Utbildningsradio, UR, vilket till följd av sin begränsade storlek inte återfinns bland de 25 största

Hotell För hotell anges de tre klasserna A/B, C och D. Det betyder att den "normala" standarden C är acceptabel men att motiven för en högre standard är starka. Ljudklass C motsvarar de tidigare normkraven för hotell, ljudklass A/B motsvarar kraven för moderna hotell med hög standard och ljudklass D kan användas vid

LÄS NOGGRANT FÖLJANDE VILLKOR FÖR APPLE DEVELOPER PROGRAM LICENCE . Apple Developer Program License Agreement Syfte Du vill använda Apple-mjukvara (enligt definitionen nedan) för att utveckla en eller flera Applikationer (enligt definitionen nedan) för Apple-märkta produkter. . Applikationer som utvecklas för iOS-produkter, Apple .

och krav. Maskinerna skriver ut upp till fyra tum breda etiketter med direkt termoteknik och termotransferteknik och är lämpliga för en lång rad användningsområden på vertikala marknader. TD-seriens professionella etikettskrivare för . skrivbordet. Brothers nya avancerade 4-tums etikettskrivare för skrivbordet är effektiva och enkla att

Den kanadensiska språkvetaren Jim Cummins har visat i sin forskning från år 1979 att det kan ta 1 till 3 år för att lära sig ett vardagsspråk och mellan 5 till 7 år för att behärska ett akademiskt språk.4 Han införde två begrepp för att beskriva elevernas språkliga kompetens: BI

alimentaire à la quantité de cet additif qui peut être ingérée quotidiennement tout au long d’une vie sans risque pour la santé : elle est donc valable pour l’enfant comme pour l’adulte. Etablie par des scientifiques compétents, la DJA est fondée sur une évaluation des données toxicologiques disponibles. Deux cas se présentent. Soit après des séries d’études, les experts .