New Value Added Data Formula

[BKGarry]

Hello All,

 

From My Understanding from Summer 2015, the new value added data is going to be figured out by G to A* being 1 - 8 at GCSE level, but I am unsure what this would be for BTECs and how they are totalled up and figured out. I am trying to find some documentation or guidelines on how the process is meant to work, so that I can get SIMS to start working it out for our Grade Collections in the marksheets.

 

Look forward to hearing from you all,

 

Garry

[LosOjos]

I don't know for sure, but I'd assume it would be 8 - 5 (D* - P) to make BTEC/GCSE comparisons possible (this is what I use currently via lookup tables in SIMS), which puts D* equivalent to A* and P equivalent to C

[pingleby]

That is my assumption too, and it's what MAP Learners uses when calculating Attainment 8. I don't think we're going to have enough information to work out Progress 8 (the new value added indicator) ahead of time.

[tgayton]

Hi,

 

I had a meeting with Edexcel recently who got confirmation from the DFE that the current equivalent level will the be same ie a Pass = C or a 5 due to the new grading.

[CaterinaAnna]

New BTECs also have a Level 1 Pass which shows as an awkward 25 points on the current scoring system (or 50 for whatever they're calling the 'double' these days - First Certificate?).

[BKGarry]

So even if the BTEC is say the equivalent of 2 or 4 GCSEs it is still worth 5 on Progress 8? Makes it easier :-)

[mark80]

Yes as the non GCSE format qualifications will only count as one grade for the school regardless what it is worth to the student. This is how it will be for Summer 2014 (still using the old 58,52,46 etc..)

[NormalDistribution]

More detail of this is given here: Page 11 of the progress 8 technical guide

 

https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/287124/technical_note_final.pdf

[mark80]

Thanks - so the new Attainment 8 is similar to the Value Added

[BKGarry]

Hello All, Thought I would give you all an update on my progress, I spent the day with the technical guide @normaldistribution posted and SIMS Assessment Manager in front of me,

 

I have successfully got the Attainment 8 running and calculating correctly, but am awaiting some details from my line manager about the KS2 fine grades it shows and the expected progress from them.

 

I have done as follows,

 

• Updated the gradeset for BTECs to have a 1P and 2P in there, to indicate whether a pass is level 1 or 2 (due to it being the new exams that decide that)
  
• Created a lookup table for GCSE and a separate for BTEC to change them to the respective Att8 measurements
  
• Created aspects labels A8 for each subject to use the LOOKUP formula to convert the grades
  
• On the marksheet template I have all the current grades hidden and the lookup to write the Att8 grades
  
• For English I have an = max column between english and english lit
  
• another english min that uses MAX with a number 2 value for the lesser grade
  
• there is a column that is NESTED IF ELSE for if there is an English Lit it enters a 2, if not it enters a 1
  
• A column that multiplies the max english by the NESTED IF ELSE column.
  
• I have a Maths MULTIPLY by 2 Column for Maths
  
• I have EBacc aspects for A8 labelled 1 through 6 which in turn do a MAX lookup of all EBacc subjects for 1 - 6 Respectived
  
• I have 3 other columns which do a MAX for 1 - 3 of EBacc 4-6, the English min and all the others (we have no discounted subjects against one and other)
  
• There is an Att8 Total Column which adds the Multiplied English, Multiplied Maths, EBacc 1, 2 & 3 and the Other 1,2 & 3 together
  
• Then there is the Att8 Overall which uses the DIVISION formula and devices the total by 10
  

 

 

I have hidden all the subject grade aspects and the EBacc 4, 5 & 6 columns to avoid confusion.

 

I am now awaiting the expected progress for the fine grades at KS2 they want to use and then I will have progress 8 from the Attainment 8 which can then be used for individual subjects and the overall for Grade Reports home :-)

 

I hope this makes sense to you all and if you need any help feel free to ask as this did take me all day with some trial and error and rechecking.

 

TLDR; Have got attainment 8 working, guide on how to do it in Assessment Manager

[CaterinaAnna]

Thanks for the link NormalDistribution, and the breakdown BKGarry.

I'm in Excel, and have more or less got the same thing set up. I'm using fine grades from FFT, although some amendments are needed at the bottom end (they over-weight the TA when test = B or N) and additions for those who arrive late (I work their fine levels out from the grade boundaries - had to fudge an overall English for current Year 7).

[BKGarry]

Just waiting for my line manager to set me up with a FFT Live login, I have left FFT to him until now, as we never really used it for target setting etc.

[BKGarry]

Grrrrr finding the fine grades for year 10 in FFT live wouldn't be easy would it, I am also looking for documentation on the expected Attainment 8 for each average of the KS2 Fine Grades

[mark80]

^^ i dont believe they have finalised the model coeffifients yet, there will be a "dummy" run of the attainment 8 this year i believe but it will not be as a direct result of the students PA at KS2.

 

https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/269438/update_progress_8_measure_secondary_school_accountability_framework_reforms.pdf

[Ecclesbury]

Has anyone read anything that might suggest that they will be publishing the methodology for how they will calculate the Progress8 in 2014?

 

The technical guide says that all school will be given their Progress8 score based on 2014 results, but it would be lovely if we also got a ready reckoner type sheet so that we have something to at least start estimating our working Progress8.

[Ecclesbury]

Sorry, should clarify. I definitely don't expect any of that before the results are published but if a ready reckoner was available after the 2014 results they could be used as a rough estimate for future years. I do this currently with Best8 VA in the knowledge that the eventual score will most likely be different - although I was pretty damn close this year!

[Ecclesbury]

Final thought - for the current Year 7 if you use Key to Success the DfE have actually already calculated the KS2 APS for us so there is no need to worry about how the English score is being incorporated.

[BKGarry]

ARGH!!!!! my head is hurting more, I am looking for the Fine Grade Score not Average Point Score, tooooo many differences, I will have to go back an look at things to see what is done.

[CaterinaAnna]

Does the APS on Key to Success NCA tools not include Science as well?

If it doesn't then that makes life easy - and an awful lot more reliable.

BKGarry, fine grade is just Points/6 (if you're working whole levels you need to remember the +/- 3 (depending which way you're going) to get to mid-level).

 

As for baseline for P8, using our own results from previous years - even several aggregated - has problems not just because of the unrepresentative sample, but because historically absolutely everyone has multiple empty slots which would make the expectations too low. I've therefore fudged it by converting FFT CPS to an APS, translating to new points, plotting against the KS2EnMa mean fine level and using that relationship to get values for 'expected' A8 for each student. That, of course, has the opposite problem because it assumes no-one has empty slots and that points scores don't dip across the country as old BTECs and so on are phased out, but at least the data set is a proper size.

 

Still too many assumptions and get-rounds for me to be really happy with it though, so still open to suggestions of better ways.

[mark80]

For the current Y11 science is included in the APS but for current Year 10's the APS is a straight Eng&Math

[CaterinaAnna]

Thank you - good to know!