Accountability Framework Dashboard

Me too. Did get an invite to training from Nick Linford today

Hello Christina

Yes, I am in the same boat as you... I don't understand where they've got their data from for the EPAO part. I have tried to replicate it from an R14 report and we do have framework learners without an EPAO agreed - but that is correct. So wondering if it's picking those up?

Hi, 

Ours has come out the same, I am wondering if they have included frameworks, as the number they quote roughly matches the frameworks. All of our standards have EPOA, so the figure should be 0.

Martin

Hi

We have the same with the EPAO at risk at 2, however checking the R14 report this doesn't show any.

[gritted teeth] and THIS is why I've been begging for a PROPER Technical Spec...

Would have a fiver on them not excluding Frameworks though...

How have you managed to access it? as i tried the other day and couldn't.

Oh yes, just checked mine and I've got 7 and I know for a fact I had our last 7 Frameworks in R14.

Let's all send an email to provider.strategy@education.gov.uk about it, shall we?

Hi Helen

Mine didn't work on Wednesday either, seems to be up and running now though (suspect the Update notice was just slightly before they were ready to go!!!). VYED > Data Quality Assurance > Analyse FE Data (AFED) Private Beta > FE Provider Dashboard (prototype) > then the AAF tile!!!

Steve Hewitt Ahhh okay, yeah i still don't that. I have requested additional permissions so lets see we go in via IDMAS not VYED directly being a HEI so it could be that is part of the issue but do not have those options so will wait and see. Cheers though.

Um, once you've got the permissions, you'd still log in via VYED? you can't (SUPER ANNOYINGLY) get to anything from IDAMS which is purely for adding your permissions/setting up new people.

yep its completely baffling and not joined yup now to see if data matches. 

For 21/22 we only have 16-19 reports in the Beta area, joys of Apprenticeships to come in 22/23. Our 16-19 seems to make sense but odd way of displaying in my opinion when at R13 looks like learner numbers and aims drop when you close them off, if I've understood how it's working.

Our EPA data actually seems to match up to our R14 data. Our Rule Violation Report for R14 showed 58 learners with warning AFinType_10 and we have 58 learners showing on the EPA section of our dashboard.  Each learner was checked before R14 and we know the reason that they didn't have an EPAO.  In all cases, we didn't know the EPAO on their start date.  We didn't update the records as they either went on to withdraw or they went on a BIL.  On return from BIL, we updated the ILR with the EPAO but it is still counting them prior to their BIL. 

Joanne

Nice! ;)

I mean, here's the thing, none of this is "Computer says no". It's for the *start* of a conversation about what is happening with you as a provider. It *definitely* shouldn't be counting BILs that have come back though, that's just silly.

Indeed! And it shouldn't be counting withdrawals either, where the withdrawal date was more than 6 months before the planned end date :)

[points at the email address above ;)]

I will be sending an email to the address provided Steve Hewitt  

Thank you for your responses, I cannot get our figures to exactly match the ones on the portal, but I can get close. That's not good enough as I could be looking at completely the wrong learners.  It would have been helpful if they could have at least provided the learner details so we can look at that data.

I still have it blued out and saying 'coming soon'. Any ideas please?

Just to join in, we also had 5 learners who were frameworks last academic year. There are 5 learners showing on our EPA section of the Accountability Dashboard. We've checked our data and can't see any standards without EPA. We think it's falsely looking at these framework learners. We've emailed the DAS people to see what they say about this. I can't see how we check the data behind the dashboard, but I think it's the same learners.

Looks to me that the AAFD EPAO measure has now been updated to exclude frameworks.  Ours appears to still be including BILs where the lastest record does have the EPAO though so have sent another email. 

Yup, my 7 are now 0!

Shows they're listening (even if they're not responding)!

Mine have updated now too, so that's a relief although strangely At Risk still with 2 learners.

Tracy Clement Ah, I think you've clicked AFED, rather than AFED Private Beta?

Thanks yes, Sorry. I worked that out.

Ours has updated too, and is zero, as we had expected it to be. 

I'm hoping that they'll give us access to the data behind each of the statistics soon so that we know exactly how they are working out things like the 'withdrawals' percentage and know who they are including/excluding from the calculation...

So, on the withdrawals tile, under "Learner summary" and the "Withdrawals over time" graph next to it, it seems to be counting *aims* not Apprentices, right?

I *thought* I could get my ZPROGs to match the total number of Apps, but when I take out my <42 days I'm two *under* (and, interestingly, have 2 on zero days onprog (late July '21 starts who were continuing in 20/21 R14))... And I've got really simple data...

But yes, I don't really have time for this guessing game when they could JUST TELL US...

Steveh, there are some very interesting things going on here. I have managed to match the calculations for the AFED dashboard Apprenticeships, with the correct numbers for in learning, planned breaks, withdrawals and completions, and the resulting percentages.

The count is being taken from the indicative funding report, and counts ZPROGS, but not all of the ZPROGS are in scope. If a learner returns from a BIL and has 2 ZPROGs then they are both counted, the first remains in the BIL count, the second in the learning count, or withdrawn, or completed depending on the final outcome. If a second ZPROG is created in the report as a result of a funding change then only the latest version is counted. 

BIL count goes up with each new BIL, and only goes down if the learner fails to return, as the 6 changes to a 3 and the learner is then counted as a withdrawal. It is counting the the completion status field at 1, 2, 3, & 6 for all "In scope" ZPROGS.

The Beta dashboard is however a complete mystery, the headline total number of learners matches the original dashboard, but the withdrawal count and percentage does not, the learner summary and withdrawals over time, appear to be counting all aims even if the Apprenticeship component filter is unticked, and ticking it barely changes any of the results. It is a beta after all.

HTH 

Martin

Hi Martin

Ooh, useful. out of interest do you have any w/ds within 42 days? I think they should be excluded (per discussion I had in July with them about it), but I have a sneaking feeling they're still counting...

Hi Steveh,

Definitely included in the Main AFED dashboard counts.

May not be included in the Beta dashboard count, I couldn't agree the beta total either way, but excluding them brings it closer.

Martin