Understanding How We Calculated BTEC Results For Summer 2020

3m ago
8 Views
0 Downloads
159.90 KB
5 Pages
Last View : Today
Last Download : n/a
Upload by : Macey Ridenour
Share:
Transcription

Understanding how wecalculated BTEC resultsfor summer 2020We used the Centre Assessment Grades that you submittedand standardised these, supported by qualitative checks.Evidence you provided us with:Information on our systems: actual grades for completed internal units historical data of performance at individualcentre level for the past three academic years(2016/2017, 2017/2018, 2018/2019) - where notavailable, see FAQs on method used Centre Assessment Grades (CAG) for incompleteinternal units, based on the grade the learnermost likely would have achieved rank order of learners at programme level forgraded BTECs prior attainment data at centre level (at eitherKey Stage 2 or 4), depending on learners’ agefor graded qualifications other information to support qualitative checks(e.g. past Standards Verification reports)Statistical standardisationWe reviewed the evidence you provided us with against our expectations, which were informed by theinformation on our systems. There were three possible outcomes for the unit:Making adjustments to gradesCentre have been cautious withgrades submitted gradesadjusted upwardsCentreGradeFinalGradeCentre grades submitted are inline with our expectations gradessubmitted were acceptedCentreGradeFinalGradeCentre have been generous with grades For graded qualifications: grades adjusted downwards.For ungraded qualifications: grades not released till additionalevidence provided, or centres reviewed the submitted pass rateCentreGradeFinalGradeQuick Links - See the links below for details of how we calculated results for different qualification types.BTEC qualificationswith all internalgraded unitsBTEC qualifications withall internal, ungraded(pass/fail) unitsBTEC qualifications withmix of internal andexternal graded units:BTEC Level 1Introductory (2016)BTEC Entry Level (E1, E2, E3)BTEC Level 1/2 FirstsBTEC Level 2 Firsts(QCF)BTEC Level 1 (QCF)PSD, Workskills (Level 1 & 2)Life SkillsBTEC Level 1/2 TechAwardsBTEC Level 3Nationals (QCF)BTEC Specialist (Level 1-3)BTEC Professional (Level 4-7)BTEC Level 2 TechnicalsBTEC Level 3 Nationals(RQF)Workingout yourlearners’final resultsFrequentlyAskedQuestionsPEUK A2154 Version 1.0 BTEC July 2020 DCL1: PublicWe can confirm we have accepted approximately 98% of Level 3 submitted grades and that where adjustmentswere made, this was on the basis of strong statistical evidence both upwards and downwards. This year's resultswill be broadly in line with previous years' outcomes.

BTEC qualifications with all internal graded unitsBTEC qualificationType of BTEC units featuredBTEC Level 1 Introductory (2016)Internal graded unitsWe reviewed the information you submittedto us (actual unit grades and CAG) against ourexpectations for your centre.BTEC Level 2 Firsts (QCF)BTEC Level 3 Nationals (QCF)For each completed unit, which has not alreadybeen quality assured and signed off by theStandards Verification process, we reviewed theunit grades submitted against our expectations.Some other BTEC qualificationsfeature all internal graded units e.g.some BTEC Specialist qualifications(please check your specification toconfirm whether all the units aregraded or not).Our expectations were based on your centre’shistorical data (the average for the past threeyears) and prior attainment data (at KS2 or KS4).Based on all of the evidence, we either accepted thegrades you put forward, or adjusted them up/down,using the rank order.BTEC qualifications with internal ungraded ‘pass/fail’ unitsBTEC qualificationType of BTEC units featuredBTEC Entry Level (E1, E2, E3)Internal ungraded unit (‘Pass/fail’)We reviewed the information you submittedto us (actual unit grades and CAG) against ourexpectations for your centre.BTEC Level 1 (QCF)PSD, Workskills (Level 1 & 2)Our expectations were based on your centre’shistorical data (the average for the past threeyears).Life SkillsBTEC Specialist (Level 1-3)*If your grades were significantly higher or lowerthan our expectations, we did further qualitativechecks.BTEC Professional (Level 4-7)*Please note that a few individual titles within these suites may featuregraded units, rather than pass/fail, in which case they follow the modelabove instead. Please check the specification to confirm whether unitsare graded or not.Based on this, we either accepted grades submittedif there was sufficient evidence, or did not releaseresults until you provided additional evidence, or youreviewed your submitted pass rate.* Please also note that a small numberof qualifications within these groupsof qualifications follow an ‘adaptedassessment’ approach, so resultsare not calculated. Please seeour spreadsheet here forconfirmation of whetheryour qualification followsan adapted assessment orcalculated results approach. PEUK A2154 Version 1.0 BTEC July 2020 DCL1: PublicThese checks included reviewing past SV reports,or contacting you to ask for further information.

BTEC qualifications with mix of internal and external graded unitsBTEC qualification*BTEC Level 1/2 FirstsBTEC Level 1/2 Tech AwardsBTEC Level 2 TechnicalsBTEC Level 3 Nationals (RQF)Type of BTEC units featuredInternal graded units (P/M/D):We reviewed the information you submitted to us (actual unitgrades and CAG) against our expectations for your centre.For each completed unit, which was not already qualityassured and signed off by the Standards Verificationprocess, we reviewed the unit grades submitted against ourexpectations.Our expectations were based on your centre’s historical data(the average for the past three years) and prior attainmentdata (at KS2 or KS4).Based on this, we either accepted grades submitted, or adjustedthem up/down.External unit - first sitting:We used the rank order, learner’s performance on internalunits and your centre’s prior attainment profile to predicttheir overall qualification grade on a scale (high/medium/low).Then we assigned points to the qualification grade, using theBTEC specification.We deducted the points from the moderated internal units, towork out the total number of points for external unit(s).* Please also note that a small numberof qualifications within these groups ofqualifications follow an 'adapted assessment'approach, so results are not calculated. Pleasesee our spreadsheet here for confirmation ofwhether your qualification follows an adaptedassessment or calculated results approach.We subtracted points from any completed external units,then divided this number by the remaining number ofexternal units to allocate points to each, proportionally tothe size of each external unit. These points represent a unitgrade, as outlined in the BTEC specification.We checked the calculated results for external assessmentsagainst data we have (e.g. prior attainment, historicalachievement rates for the unit, performance on internalunits). We may have adjusted our calculations up or down.External unit - resit attempt:We calculated the average resit improvement rate at yourindividual centre for this unit (e.g. % with one grade upimprovement, % with two grades up improvement) todetermine which learners are likely to improve performancecompared to their best banked attempt.We calculated the average resit improvement in points basedon a learner’s best banked attempt and calculated the newpoints for the learners who we have identified as likely toimprove their performance. PEUK A2154 Version 1.0 BTEC July 2020 DCL1: PublicThis was why it was important for us to have a minimum levelof evidence from you about learners’ completed internal units,including at least one mandatory unit (as performance onmandatory units is a stronger indicator of performance onexternal units).

Working out your learners’ final results: We performed a number of qualitative checks to sense check the calculated unit grades. We aggregated the unit grades and checked they met the BTEC specification rules. As long as the unit grades met the specification’s requirements, we calculated the overallqualification grade for completing learners on graded and ungraded qualifications. Results could then be issued to centres.For ungraded qualifications:For graded qualifications: this means learners must have achieved aminimum number of credits or units to beawarded the qualification. this means all the units are assigned points these unit points are added together to providethe qualification grade points the qualification grade points determine thefinal qualification grade.Frequently Asked QuestionsWe reviewed the Ofqual requirements for awardingand calculating results this summer for vocationalqualifications. We also consulted extensively withOfqual and other Awarding Organisations on aspectsof the approach.Part of our consideration included the information wealready had on our systems and evidence we couldreasonably request from your centre.We developed, tested and refined the statisticalmodel, using historical data to identify the bestapproach for calculating BTEC results. This was thenunderpinned by qualitative checks, to sense check theoutcomes, as well implement specific checks (e.g. forsmall or new centres).Part of our analysis involved comparing outcomesto previous years to ensure this year’s learnersare neither disadvantaged nor advantaged by theprocess.Is the process for calculating results forcompleting and non-completing (i.e. mid-flight)learners the same?Broadly the approach is the same, except for BTECqualifications with external assessment. Two points ofdifference there included ensuring that where resultsfor non-completing learners were being claimed, thata minimum specified level of evidence had alreadybeen banked to enable us to more reliably calculate results for externally assessed units.The second point of difference was in with BTECqualifications with external assessment, whereby inorder to calculate results for externally assessed unitswe first separately predicted overall qualificationoutcomes (and associated points available) forcompleting and non-completing learners, usingthe rank order information you supplied us with.Historical data shows that these two groups oflearners perform differently on external assessments,as they are at a different stage in the programme.Within that parameter, we preserved the rank orderprovided.I am a new centre (new to Pearson/this BTECprogramme), we don’t have three years ofhistorical data for this BTEC qualification. Howwill you calculate my learners’ grades?Given our size, we have data on many centresin the UK. When there is no or limited historicaldata available for a centre for a particular BTECprogramme, we were able to identify characteristicsthat your centre has (e.g. prior attainment of cohort,size of cohort). Using these characteristics, we canascertain an average for your type of centre anduse the information we have for that centre type tocalculate results.Continued overleaf. PEUK A2154 Version 1.0 BTEC July 2020 DCL1: PublicHow did you come up with this model forcalculating results?

Frequently Asked QuestionsWe know that results for small centres, or those withlimited historical data can vary from one year toanother. We have taken this into account during theprocess and ensured that it is fair for all learners. Wehave many qualitative checks in place to check onthe accuracy and validity of results issued, and one isspecifically to ensure and monitor that small centresare not adversely impacted, due to a more dramaticvariation of year on year historic performance.Our centre recently merged and we have differentsites. How will you calculate my learners’ grades?Fortunately, your centre number for BTECqualifications includes a subsite affix (creating a sixdigit centre number). This means we have historicaldata for your centre at a subsite level and just as weasked you to put forward Centre Assessment Gradesand rank order at subsite level, we calculated resultson that basis.My centre’s results have been improving year onyear, will this upward trajectory be considered?We did not attempt to model centre trajectoriesbecause the characteristics of your current cohortare more significant determinants of attainment thanan individual centre trajectory. This is similar to theprocess for general qualifications, set by Ofqual, whostated: “For the vast majority of schools and collegesany year-on-year variation in results for a givensubject is quite small, with small changes up anddown seen. The lack of stability over a 3-year periodin improvements or deteriorations in performancefor the overwhelming majority of centres meansthat any statistical model is likely to be unacceptablyunreliable in predicting any trends in performance in2020. For this reason, the trajectory of schools andcollege results will not be taken into account in thestandardisation process.”We have a substantially different cohort to prioryears; how will this be considered?How will you calculate results for new BTEC units(without a track record)?Subject experts have identified appropriate cognateunits (units from other BTEC qualifications thatare similar in content and demand to the newBTEC units), and we have used historical data andvalue-added relationship for these cognate units tostandardise and calculate grades for the new BTECunits.What do the calculated results look like forsummer 2020?It is too early to confirm final results across allour BTEC suites at this stage. However interimfindings suggest that most learners will receive thesame grade as their Centre Assessment Grade.Results therefore will broadly be in line with tutors’expectations, professional judgements and previousyears’ outcomes. This is partly explained by the longhistory of tutor assessment, which is at the heart ofBTEC qualifications, as well as the fact most of theteaching would have been delivered so the gradesare largely based on completed or near-completedlearner work and evidence.A small proportion of learners will have adjustedgrades (either upwards or downwards), wheresubmitted grades were not in line with expectations,based on the information and evidence we have.We will publish in August a results summary ofnational qualification outcomes on Edexcel Online,like in previous years.I think some of the results issued at my centreare incorrect, can I appeal on behalf of a learner/learners?Yes, you will be able to appeal results on certaingrounds. We are currently awaiting the outcomes ofthe Ofqual consultation on appeals and are workingclosely with JCQ and the other exam boards onfinalising details of the appeals process, including thedifferent grounds for appealing. We hope to sharethis with you by early August.PEUK A2154 Version 1.0 BTEC July 2020 DCL1: PublicI am a small centre and our results varysignificantly year on year. How will you calculatemy learners’ grades?We considered changes in prior attainment andentry size when making adjustments and calculatinggrades. We have sought to maintain the historicalvalue-added relationship observed at qualificationand unit level.

BTEC Entry Level (E1, E2, E3) BTEC Level 1 (QCF) expectations for your centre. PSD, Workskills (Level 1 & 2) Life Skills years).BTEC Specialist (Level 1-3)* BTEC Professional (Level 4-7)* BTEC qualification Internal ungraded unit (‘Pass/fail’) We reviewed the information you submitted to us (actual unit grades and CAG) against our