Chris Bennett

R10 in-year QAR data for 2024 to 2025 now on VYED

Created

None

The first in-year QAR data for 2024 to 2025 was released on to VYED yesterday.

I'm seeing higher achievement rates/less leavers than expected. The achievers are all accurate against my internal R10 data but some leavers/withdrawals that I expected to impact our 24/25 QAR are not in the data, which I'm not sure if this is connected to the following note in DfE Update:

Due to migration to a new data infrastructure we have not yet been able to include historical data for apprenticeships in your extracts for R10, but this will be available in future releases.

I haven't had chance to dig into this in full detail or raise a query, but wondering if others were seeing the same? It does limit the usefulness of in-year data if it doesn't include all the data to that point!

Also for some reason my Level 5 learners on one of the standards are being split across two different apprenticeship names, and thus two data lines on the QAR dashboard, some on the 'old' name and some on the new/current name:

  • 104 Operations Manager
  • 104 Operations or Departmental Manager

The name being used doesn't appear to correlate to which version of the standard they are on or their start date though, and I'm not seeing the same issue for other standards (e.g. everyone for code 105 has the apprenticeship name Team Leader, none have been named Team Leader or Supervisor).

Replies

No one has replied to this post.


Steve Hewitt

Hi Chris

Yeah, no, DO NOT USE IT TO LOOK AT YOUR ACH RATES!!! Because it hasn't got previous year's data, you are missing the people who withdrew last year (or even the year before!) who had planned end dates in this year and thus should be part of your cohort...

Absolute shocker they've had here, releasing the data like this...

Steve Hewitt

Can't help you on 104 though...

Emma Ford

Hi Chris,

Yes, we are seeing a similar situation. 

Our achievement rate on the VYED portal is slightly higher than expected and we have a small number of leavers that don't seem to have been included at all.

Our leavers relate to a small number of learners that had been on breaks in learning in previous years and were then withdrawn (backdated to the date the break in learning commenced) in this QAR year.

Not sure if this has anything to do with it though?

The learners are included in the QAR report pulled from our MI system, just not the data extract downloaded from the portal.

Emma

Martin Outlaw

Hi Chris, 

I am seeing a different picture with our data. The downloaded spreadsheet does contain the leavers from last year, and the year before with expected and dates in this year. That part of the cohort is correct.

Yes, I do appear to be 4 learners short of the full cohort I was expecting, and these learners were on a planned break last year and have subsequently withdrawn this year, and yes they are all in our current ILR submission. We know that there is a new methodology being used for this year, and whilst I would not have expected it to have this effect, it may be the cause. Last year's comparative in this years dashboard, does not match last years R14 data. it is slightly better. So have we pushed 4 learners back from this year's cohort in to last year's, and a couple more from last year's in to 2022/23....

Without the full 3 years data in the download, it is difficult to be sure.

Chris - all of our 104 / 105 show up on the dashboard under Operations or Departmental Manager, and Team leader or Supervisor for the 2022/23 comparative, and all in Operations Manager, and Team Leader for 2023/24 and 2024/25

Martin

 

 

Paul Taylor

Hi

I think the QAR is correct. The DFE note is clumsy but says that they have excluded prior year data from the final extract, and not from the calculation so the 24/25 calc should be as per the spec which is what we are seeing. It would be madness not to have done this.

We have also noticed the inconsistency with standard names. Looks lake a poor reporting process to me where they have merged the description from whichever year a leaver was reported in. This means that any standard names that have changed may be duplicated. Use the standard code if you are cross referencing to internal data.

Overdue breaks are often the explanation of where data differs. If you have changed a break from last year into a leaver this year then that is likely to show in a future year depending on planned end date. There is an explanation in the spec but you'll need all of your fingers to work it out.

(Edited)

Sam Bern

We noticed the same thing as Martin above that learners who were on a break in learning at the end of 23/24 but were reported as withdrawn in this academic year 24/25 were not included in the calculation. This may account for some discrepencies around the reported figure being higher then expected.

We also checked that they were being included in the r10 return which they were. 

We raised it with the DFE and they confirmed this was an error, which is being corrected in a future release of the data.

Emma Ford

Hi all,

We have also just had confirmation from the DfE, in respect of overdue breaks in learning that have been withdrawn in this QAR year that this is their error.

The learners are currently showing in earlier hybrid end years when they should be showing in this one.  They have ensured this will be fixed in future 24/25 data releases.

We shall see what the R12 in-year data release brings.

Emma