spring data conference - lsectlsect.co.uk › ... › spring-data-conference-2015-march.pdf · any...

12/03/2015

For more training and events visit lsect.com 1

Spring data conference

Agenda

10.35 ILR specification 2015/16, with a focus on changes and implicationsLisa Macdougall, Senior Data Manager, Funding and Programmes, SFA

11.40 Break for coffee and networking

12.00 The new success rates and minimum standards and plans for this year (14/15)Sue Parker, SFA Head of Performance Measures (including Q&A)

12.30 Ofsted's approach to the the new success rates and preparing data for inspectionJo Parkman, Team leader FE and Skills Data and Insight, Ofsted

13.00 Break for lunch and networking

13.50 Funding update - EFA/SFA changes and what they mean for 15/16Nick Linford

14:20 Outcome of late data funding audit for 2013/14 and other data related issuesRich Williams, Deputy Director for Programme Delivery & Performance, SFA

14.50 Ask the auditor: Tips and hint from using the new DSAT v15 in 2014/15Karl Bentley and Emma Crook, Baker Tilly

15.30 Spring data and conference end

12/03/2015


ILR Changes for 2015 to 2016

12 March2015Lsect FE Data Conference

Lisa Macdougall - Data Specification Manager

Summary

• Publication timetable

• Changes for 2015 to 2016

12/03/2015


• All changes approved by the BIS Vocational Education Data Board

• ILR specification v1 and Change summary for 2015 to 2016 now on gov.uk

https://www.gov.uk/government/collections/individualised-learner-record-ilr

• Still to come (by end of March)

– ILR Specification v2

– Validation Rules v1

– Provider support manual

– Collection timetable and other appendices

Publication timetable

• Changes to recording data about Maths and English GCSE achievement for EFA Condition of funding and disadvantage uplift

• New LLDD fields & SEN indicator

• Changes to support new ESF programme

• Additional ESOL delivery hours

• Traineeships (minor changes)

• A / AS levels

• 2 new HE fields

Key Changes

12/03/2015


Maths & English GCSEs

• Data to be collected the same as 14/15 but restructured

• 3 items of data required:

• Maths and English GCSE achievement at end of year 11 (for disadvantage funding): New FAM Type (EDF)

• Maths and English GCSE grade at start of current year (for condition of funding): 2 new fields

• Learners who are exempt from or have met the condition of funding: New FAM Types (MCF/ECF)

• MGA FAM Type used in 14/15 removed

LLDD data

• Dataset modified to align with data collected in schools. Consistent data up to age 25.

• LLDD Type and LLDD Code fields removed

• Replaced by 2 new fields: LLDD Category and Primary LLDD

• Categories broadly the same. Continuing learners need to use new codes – mapping in spec. 3 old codes still in use for continuing learners.

• Collect and return as many records as apply

• Primary LLDD field must be set for all new starters

• If learner only had 1 LLDD record in 14/15 then Primary LLDD must be set. Otherwise not required for continuing learners

12/03/2015


Traineeships

• Minor changes to data recorded

• Funding different for 14/15 continuing learners (14/15 funding per aim) and 15/16 new starts (single programme rate of funding for work prep/work experience)

• Need to record Achievement date for programme (ie. date that learner met progression outcome criteria)

• Must have a Destination & progression record

• 14/15 continuing learners and 15/16 new starts have different achievement criteria – refer to funding rules

• New “Awaiting outcome” code in Outcome field

• Changes to Destination & progression codes for self employment and unknown

Learner & Learning Delivery FAMs

• New Learner FAM Type: Special Educational Needs indicator

• New Learning Delivery field for Additional Delivery Hours for ESOL – replaces use of non-regulated aims for funding for starts from 1 Aug 2015

• New Learning Delivery FAM Type to record Family English Maths and Language (FEML), funded through ASB delivered by community learning providers

• Percentage of Online Delivery (POD) – investigating future collection through the course directory. Any changes to collection requirements to be confirmed for v2

12/03/2015


• ESF Agreement ID & Local Project Number fields removed and replaced by Contract reference number

• Learner Household situation

• New learning delivery FAM type to record learners from workless households with and without dependent children / single adult households with dependent children

• Data collected based on signed self declaration from learner

• VE Data board has asked for confirmation from SFA as to whether thismust be collected for the new ESF programme. To be confirmed for v2

ESF Programme

• ESF Destination field removed

• Data to be recorded in Destination & progression dataset

• Required for all ESF direct funded and Adult Skills funded learners for match

• Programme requirements still being finalised so exact details of when data needs to be collected are still to be confirmed.

• Completeness of data for Traineeships currently very low – looking at validating this before the final return of 2014 to 2015.

Destination and Progression

12/03/2015


• New linear A levels being introduced. AS decoupled from A level - AS marks will not count towards the A level.

• Record the learning aim that a learner is working towards; either an AS or A level learning aim

• A2 learning aims not recorded apart from for continuing learners• Learner who takes an AS qualification and A level in same subject - record both an AS learning aim and A level learning aim

• Use the Funding adjustment for prior learning field to reduce the funding for the A level where the learner has already studied the AS qualification.

• Comprehensive guidance published on the ILR Guidance page for 2015 to 2016.

AS / A levels

• Changes to align with HESA Student Record. HEFCE governance.

• UCAS tariff points field removed

• 2 fields added:

• Gross Tuition Fee

• HE centre location postcode

• Data type change on UCAS personal identifier

• Change to restricted string so will need to add leading zeros

HE Changes

12/03/2015


Qualification Success Rates and Minimum Standards

March 2015

Sue Parker Head of performance measures, monitoring

and risk assessment

These slides are intended for those who already have an understanding of QSRs and Minimum Standards.

The purpose of the presentation is to:

• make you aware of where we are now and intended changes for 2014/15

• signpost you to where to go to find further details

• give you the timeline for publication

The aim of this presentation

12/03/2015


Changes for 2013 to 2014 (1)

Change: A single set of business rules applied to Apprenticeships, Classroom learning and Workplace learning.

Change: The overall and timely methodology was applied to Classroom learning

Change: QSR calculations included functional skills qualifications and QCF units for the first time. Loan funded provision was also included.

Change: The QSR dataset given to each provider included a list of excluded aims with the reason for exclusion.


Change: Reports are no longer based on the planned duration of learning (Long, Short and Very Short). Instead, they are based on the following qualification types.

Implication: Categorising by qualification type rather than duration will make it easier for employers and learners to compare courses and providers.

A-Levels Diploma GCSE Other

AS-Levels ESOLOther non-Regulated

AwardFunctional Skills SfL

Other Regulated

Certificate GCSE Maths & English

QCF Unit

12/03/2015



Change: excluded for 2013 to 2014:

• Learners mandated to skills training and claiming Universal credit

• Work placement aims, including for traineeships. Any qualifications done within a traineeship are included, but excluded if the learning aim was unfinished due to the learner gaining employment.


Change: The reports contain both the QSR and Minimum Standards. The report layouts have been reformatted to give them all the same look and feel.

12/03/2015


Minimum Standards (1)

• Minimum Standards are QSR threshold levels set by the Skills Funding Agency (SFA). They are quality standards against which every provider receiving SFA funding is measured.

• Minimum standards only apply to SFA funded and loans funded provision. If a provider’s QSR falls below the Minimum Standard threshold, then the SFA may intervene.

• The Agency has published details on how it will apply Minimum Standards and how it will make decisions about interventions.


• QSR and Minimum Standards reports are intended to help providers to identify any poor performance and target improvement.

• Colleges and training organisations should not use the Minimum Standards thresholds as quality benchmarks. The national success rates are significantly higher and providers should use those to benchmark their performance and set targets for improvement.

12/03/2015



• Minimum standards use the overall success rate and use data for one year only.

• They are worked out on a combined total of classroom and workplace learning aims for age 19+.

• Minimum Standards are applied to Apprenticeships for all ages.

• More detailed information on tolerances and how they are applied is published in the guidance note that is sent to providers with their QSR reports.

Minimum Standards 2013 to 2014

Qualification Type Threshold %Qualification Type

Group

Apprenticeship Framework 55 App.

A-Levels 75 A

AS-Levels 63 A

Award 75 B

Certificate 70 A

Diploma 70 A

ESOL 63 B

Functional Skills SfL 63 B

GCSE Maths and English 75 A

GCSE Other 75 A

Other non-Regulated 75 B

Other Regulated 65 B

QCF Unit 75 B

12/03/2015


Minimum Standards tolerances (1)

In this example, the provider would not fall below Minimum Standards for Qualification Group Type A provision. Even though their Certificates provision is below the Minimum Standard threshold, it is a small proportion of their overall Qualification Group Type A provision.

40% MS threshold

Minimum Standards tolerances (2)

In this example, the provider would fall below Minimum Standards for Type A provision. More than 40% of their aims were below the Minimum Standard threshold for the qualification type.

The provider should look at how the Agency will make decisions about intervention.

40% MS threshold

12/03/2015


Likely changes for 2014/15 (1)

• Change of terminology

• Work place and classroom success rates combined

• Group A and B combined for MS

• Higher thresholds for apprenticeships

• Review qualification type thresholds – units, awards and certificates

• Universal credit mandated learners included

• New reporting mechanism

Changes for 2014/15 (2)

• Work continues on the development of outcome measures and BIS are consulting (meanwhile data sets are already published)

• Developing a Minimum Standard for positive destinations for traineeships (shadow reports for 14/15)

• Business rules published in April followed by technical documents

12/03/2015


When are Qualification Success Rates

and Minimum Standards reports

published?

Publishing QSR and Minimum Standards reports (1)

• Provisional 2014 to 2015 QSR and Minimum Standard reports will be shared with learning providers in the third week of December 2015.

• Success rate data will be included in the Statistical First Release in January 2016.

• Data in both the provisional and the confirmed reports remains RESTRICTED until after the publication of the January SFR and is for the internal use of providers only until then.

12/03/2015


Publishing QSR and Minimum Standards reports (2)

• The Agency does not produce any in-year QSR or Minimum Standards reports. The final dataset is needed to calculate the overall success rate and so this can only be done at year end.

• The Agency recommends that providers monitor their in-year success rates by using our data specifications to produce their own figures or through the use of a commercial MI system that generates reports.

Questions and contacts

12/03/2015


Questions and contacts

• If you have any QSRs or Minimum Standards questions, please log them with the Service Desk

• The Service Desk can also help resolve any problems accessing reports on Provider Gateway

• If you have any feedback on this presentation, please email the Sector Engagement team [email protected]

QSRs and beyond…..

Jo Parkman, Team leader FE and Skills Data and Insight, Ofsted

12/03/2015


13/14 QSRs what is working well?

Inclusion of minimum standards for adults

QSR AS/A levels now map-coded

Three year trend

Ofsted simplified approach to provider groups

13/14 QSRs what is working less well?

Table 12 GCSEs are NOT pass rates

A levels and GCSEs and ‘full’

Removal of component aims – change in methodology

Loss of simple ‘overall’ headline measure

12/03/2015


Dashboard – where next?

Data will be up-dated after NSRT published

Planning on using level 1 (Table 5)

Full level 2 and full level 3 (Table 6)

Fairer A level measures

Inspection myths….

Inspectors should NOT ask for other cuts of data to match the additional tier 2 SAs

Judgements on outcomes are not based on data alone

There are NO benchmarks

12/03/2015


New framework in September

Progress, progress, progress…

Increased focus on value added

Disadvantaged learners

What don’t QSRs include that leaders/managers might want to know?

Overall success on study programme?

Progress between one level and the next?

Drop out between AS and A2? (note decoupling though)

12/03/2015


Headline measures published in the 16 to 18 performance tables in 2016:

progress (a value added progress measure for academic and Applied General qualifications and a completion and attainment measure for Tech levels and substantial vocational qualifications at level 2) attainment progress in English and maths (for students without a

GCSE pass at A*-C in these subjects) retention destinations

Attainment of A levels…a new mine field..

Lots of change on the way!

The new 3 A level measure will NOT include students on mixed voc programmes

New allocation principles – so for example best 3 A level measure will be reported against institution where bulk of learning took place

Providers will be held to account on an annual basis based on funding received for core aim

12/03/2015


Nick LinfordAuthor of the Complete guide to funding apprenticeshipsOrder from www.lsect.co.uk/guide

Funding update - EFA/SFA changesand what they mean for 15/16

Funding update

CEO, Peter Lauener

16-19 (young)

19+ (adult)College/trainin

g provider

£

£

Study programmes

> Impact (if any) of qualification changes

> How painful was the 17.5% rate cut?

Limited change for 2015/16, but

> English and math CoF

Adult Skills Budget

> Growth in loan facilities (and what will BISconsultation response say?)

> No significant change to rules or rates, but bigcull of fundable qualifications

Changes for 2015/16

> Huge allocation cuts to non-apprenticeships

And what does ‘simplification’ mean to Peter

Lauener?

Nick BolesMinister for Skills

12/03/2015


Two 19+ funding letters published 26th Feb

Government letter from BIS telling SFA their priorities and budget for 2015-16 financial

year (April – to March)

SFA letter to providers setting out priorities and adult skills budget (ASB) allocation cuts for 2015/16 academic year (August– to July)

College/training provider allocation

Key financial year figures

Total budget cut 5% (£226m)

Teaching and learning cut 4% (£135m)

ASB cut 11% (£250m)

24+ advanced loans facility increase 25% (£100m)

Key academic year figures

of which:

ASB cut 17% (£360m?)

of which:

No cut to apprenticeships (initial budget set at £770m)

No cut to traineeships and English and maths (currently ??)

So 24% cut to everything else to find the £360m saving

SFA guidance note on 2015/16 allocations methodology

Published yesterday afternoon (three pages)

“This note sets out the principles we have used to calculate your funding allocations for the 2015 to 2016 funding year.”

Key question: What is the baseline ASB allocation for colleges and local authorities to which the 24% cut will apply?

Answer: “If you are funded through a grant, your mid-year funding claim has been used as your baseline for the 2015 to 2016 funding year. We have capped your baseline at the value of your 2014 to 2015 contract value before the performance-management point 2 review. Forecast delivery above your adult apprenticeship contract value that can be offset against delivery below contract in non-apprenticeship (other) Adult Skills Budget (ASB) – within the total ASB contract value – has been consolidated in your baseline.”

Keith Smith letter with allocations(expected next

Tuesday)

12/03/2015



A different approach for private training providers

“If you are funded through a contract or direct grant, we have used your 2014 to 2015 ASB contract after applying any automated reductions for performance-management point 2 as your baseline. We have capped your baseline at the value of your 2014 to 2015 contract value before performance-management point 2. We have apportioned your baseline across apprenticeships, traineeships and non-apprenticeship (other) ASB according to their relative proportions in your Individualised Learner Record (ILR) R06 data return.”


Tuesday)


“For all providers we have protected apprenticeships and traineeships at the level of your current delivery. We will continue to ring-fence your funding for adult apprenticeships within your overall ASB funding allocation.”

“We have protected English and maths delivery from within the non-apprenticeship (other) ASB. We have used your delivery of English and maths as submitted in your ILR R06 data return to protect these programmes. Please note that this does not include delivery of learning aims for English for speakers of other languages (ESOL).”


Tuesday)

Confirmation ESOL not protected

12/03/2015


Funding and Data Collections

Rich WilliamsDeputy Director: Programme Delivery and Performance

March 2015

• Published 26 February 2015

• CEO letter 26 February 2015

• Modelling and calculating

• 2015 to 2016 funding statements

• Impact assessment by EFA and SFA

Funding letter

12/03/2015


• Why do we do this?

• Process

• Outcomes

• Funding monitoring 2014 to 2015

Funding monitoring

• 2014 to 2015 update

• Error report

• Rich’s New Year list - updated

• Milestones

• Engaging providers

Data collections

12/03/2015


2014 to 2015 collections

ILR R07 First submission by UKPRN

0

20

40

60

80

100

120

140

160

180

R07 top 5 data errors

Rule Id Error descriptionProviders

Learners

EmpStat_08

This Learning aim reference is not valid in LARS for this Funding model for a new starter on this Learning start date.

29 536

Dest_03The Learning actual end date has not been returned, therefore this ESF destination is not valid.

29 328

ULN_05This Unique learner number is not valid.

106 388

EmpId_13The employer identifier [9999999999] has ben used

41 355

EmpID_10The employer identifier has not been returned

46 330

12/03/2015


Rich’s New Year list

• Land 2015 to 2016 systems• Open longer each month• Update reference data more often• Improve communication

Development milestones

System Planned Actual

Funding rules, rates, ILR spec 28 Jan 9 Feb

2015 to 2016 learning aims in LARS search facility on the Hub

Feb/Mar2015

In test now

FIS usability improvements Mar 2015 Mar 2015

Trailblazers EAS 2014 to 2015 Mar 2015 Mar 2015

FIS 2015 to 2016 initial release April 2015 May 2015

FIS 2015 to 2016 first full release July 2015

Data collections facility for 2015 to 2016 funding year

July 2015

12/03/2015


Technical User Group

Barking and Dagenham College Chelmsford CollegeCroydon Adult Learning CTS TrainingDudley College Easton and Otley Colleges EQL Solutions Exeter CollegeHenley College, Coventry HIT Training LtdLearndirect NCGNewcastle City Learning North Hertfordshire College QubeLearning Shrewsbury College SWRACTrafford College Walsall College W&SCP Ltd YMCA Training

Data and Management Information Advisory Group (DMIAG)

Dawn Ward, principal and chief executive of Burton and South Derbyshire College (Chair)Gary Burgess (Glos College) Julie Raine (Sunderland College)Toby Coombes (Exeter College) Ricky Coxon (Grimsby Inst of F&HE)Luke Rake (Hartpury College) Nicola Vine (Derwen College)Karen Mace (University of Derby) Caroline Miller (HOLEX)Lyn Joyce (Toni & Guy) Adele Lee (ESG Group)Dave McMillan (Burton and South Derbyshire Education Trust)Victoria Dale (South East Midlands Local Enterprise Partnership)BIS Ofsted

12/03/2015


Keep up-to-date

Skills Funding Agency website:https://www.gov.uk/government/organisations/skills-funding-agency

Regular updates in Skills Funding Agency newsletters:• Update• Inform

•Join the feconnect community http://feconnect.sfa.gov.uk

Twitter: @sfadata

Questions

12/03/2015


www.bakertilly.co.uk

Ask the Auditor: Hints and tips for using the new DSAT v15 2014/15

Karl Bentley/ Emma Crook

March 2015

Audit and DSATs for 2014/15

Audit for 2014/15

EFA - What’s new for 2014/15

SFA - What’s new for 2014/15

DSATs - What’s new for 2014/15

12/03/2015


Audit for 2014/15

• Did you receive a nice Christmas present from the SFA last year?

• Audit work and findings of this work were not aligned

• From 2014/15 the audit process is being ‘overhauled’ to bring it in-line with LARC – new DSAT reports

• Additional work is also being undertaken on subcontracting – still considered the highest risk area

• Audits of private providers are just about to start – Colleges will continue to be audited in the Autumn (as far as we know)

EFA – What’s new for 2014/15

New and improved for 2014/15

• Maths and English condition of funding – 4 questions covering exemptions and delivery

• Eligibility for Free School Meals

• Eligibility, procurement, contracting, monitoring and control of subcontracted provision

12/03/2015


Maths and English – Audit Requirements

From discussions with the EFA we have been provided with the following advice:

Evidence requirements for exemptions from maths and/or English

• Awarding body evidence demonstrating GCSE grade C or above• Evidence from PLR• Letter from previous school confirmed grades attained• Enrolling officer sign off to confirm certificates or equivalent have been seen with

record of grade achieved

EFA will reconcile ILR to awarding body data to confirm ILR data

If it doesn’t reconcile these learners will be taken out of the lagged count – unless you have evidence

So maybe keeping a copy of the certificate isn’t such a bad thing?

SFA – What’s new for 2014/15

New and improved for 2014/15

• Learning Start Date

• ESOL and Top Up codes

• Apprenticeship Grant for Employers

• Early Years Educator - GCSE requirements

• Additional subcontracting monitoring question on D3

12/03/2015


DSATs for 2014/15

• LARC exercise in December 2014 identified a number of data ‘issues’ across the sector – outside of audit scope

• In response to this DSATs have been updated or additional reports introduced

• Expect Auditors to be paying close attention to these reports

• And so should you if you want to avoid another surprise!

• Additional guidance on DSATs can be found in the ‘Reviewing PDSAT reports User Guide’

https://www.gov.uk/government/publications/ilr-data-check-that-it-meets-standards-and-quality-requirements

DSATs version 15

• B reports cover both streams – Three reports in total

15B-050: Possible Duplicate Learners

15B-060: Possible Duplicate or overlapping learning aims – Logic has been amended on report

12/03/2015


DSATs version 15

Three new reports specifically on Traineeships

• 15E-520: Traineeships maximum duration exemptions

• 15E-530: Traineeship Eligibility

• 15E-550: Traineeships with incorrect or no work placement aims

• 15E-490: Funding by Subcontractor – have you remembered to include UKPRN? Short hours and out of area?

• 15E-450: Learners on a Specified Aim – Now includes minimum/maximum Ofqual hours

DSATs version 15

SFA – New and amended reports, many of which are linked to LARC

• 15S-150: Prior Attainment and Full Funding for Learners aged 19-23 – Amended report with additional data to check if learner is eligible

• 15S-280: Resuming Learners – Repurposed by audit following amendment of duplicate learning aim report

• 15S-360: NI Numbers null, temporary – Amended to include BSI data

12/03/2015


DSATs version 15

• 15S-380: Employment status exceptions – Amended to include Start Date of Employment data

• 15S-530: Traineeship Eligibility – Now covers all aspects of eligibility and in-year changes

• 15S-550: Traineeships with incorrect or no work placement aims – checks a work placement aim is recorded and that it is appropriate

• 15S-560: 24+ Learners with full funding claimed – New report that reports full funded learners over 24 with employment, prior attainment and BSI data

DSATs version 15

• 15S-570: 24+ Workplace learning funding eligibility – identifies aims delivered in the workplace up to level 2 that may not be eligible for funding

• 15S-580: Traineeship with no work preparation aims - Work preparation is the ‘core’ element. Without it the learner is ineligible for funding

• 15S-590: Apprenticeships with non-mandatory English and/or Maths aims – identifies funded maths and English learning aims that are outside of the Apprenticeship programme and may not be eligible for funding

12/03/2015


DSATs version 15

• 15S-600: Level 3 Early Years Educator Learning Aims outside Apprenticeships – Identifies learners on Early Years Educator aims and GCSE Maths/English at the same time

• 15S-610: Level 3 Early Years Educator Learning Aims in Apprenticeships – Identifies learners on this framework enrolled on Functional Skills maths/English rather than GCSE

• 15S-620: Use of work experience aims outside Traineeships – only eligible if part of Prince’s Trust

• 15S-630: Funding Adjustments for prior learning outside Apprenticeships – Learners with funding adjustments are reported here to confirm if RPL is correctly applied

Thanks for listening

74

12/03/2015


Conference end

spring data conference - lsectlsect.co.uk › ... › spring-data-conference-2015-march.pdf · any...

Documents