Internet-based Performance-centered Learning Environment for Curriculum
Support (IPLECS)
Catalina Martínez-Mediano and Nuria [email protected]
MIDE I - Faculty of Education - UNED (Spanish University for Distance Education)
AndM. Castro, N. Mileva, S. Stoyanov, W. Kicken, S. Tzanova
CONTENTS
1. IPLECS
2. IPLECS Objectives
3. The project approach: PSS
4. Application of Performance-centered Approach in m-
Learning (mPSS)
5. The evaluation projects strategies
6. The evaluation projects results
7. Conclusions
1. IPLECS
Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS) is a virtual campus platform for performance-centered reusable learning materials to apply in performance-centered settings to support university curriculum in physic-engineering education.
1. Previous works
IPSS_EE (Internet-based Performance Support System with Educational Elements) provide online access to the full range of information and guidance. Performance-centred learning Self-directed learning Based on tasks
DIPSEIL is a project, that add to IPSS_EE, a distributed system for individualized learning
2. IPLECS Objectives
Design a Master Degree, within the EHEA on Information and Communication System (ICS),
Apply the ICS master, by means of the DIPSEIL-IPLECS platform, in Plovdiv University, Bulgaria,
Evaluate the ‘ICS master’ in its design, during their application and in their results.with the collaboration of 6 European
universities (Plovdiv U, TUS Sofia, CIME-INP Grenoble, DEIS, Cork, OTC-OU Netherland, DIEEC-EDU-UNED, Madrid,
3. The project approach: PSS
Based in the ‘Principles of Electronic Performance Support System’ (EPSS), but evolved to the Higher Education System.
The EPSS concept includes the idea to provide information and help to the learner just-in-time, just-enough, and just-at-the-point-of needed
And needs computer support for an effective and efficient job performance.
3.1. The PSS concept in IPLECS
The concept of performance support system (PSS) in education, should consider the specific goals of higher education:
Students should be supported to perform the task, but also to understand the underlying processes and concepts.
4. PSS Workflow Model to guide the curriculum design
The PSS Workflow Model is based in: State a reference situation in which the students will
use what they are going to learn Formulate a few learning goals and clear and specific
objectives oriented to competences Create learning tasks, providing to the students:
Background information, Examples, Procedures and Feedback,
Summative evaluation.
5. The evaluation projects strategies
The evaluation strategy of the IPLECS and mPSS projects aims to study the total purposes, specially:
1. The coherence between every course in the ICS curriculum with the PSS Workflow Model (adequacy indicators), by means of the ‘PSS Validity Scale’
2. The Students’ attitude to learn by computer, by one specific
Questionnaire.
3. The usability and functionality of the platform (efficiency indicators), by means of the‘Computer System Usability Questionnaire’
4. The ‘ Effect of PSS curriculum on students’ learning achievement in competencies’ (efficacy indicators), by means of tests
5. The ‘Satisfaction with the curriculum and the IPLECS platform (when the course has finished) by means of Questionnaires, focus groups, interviews).
5. The evaluation projects strategies
To summarize: Planned, enacted, experienced curriculum Teachers’ and students’ experiences By means of Quantitative and qualitative
instruments and data analysis
6.The evaluation projects results 6.1. The PSS Validity Scale (adequacy)
PSS Validity Scale: Criteria Results:
1. State a reference situation in which the students will use what they are going to learn
This element didn’t appear in all the courses
2. Formulate a few learning goals and clear and specific objectives oriented to competences
This element always appears in the courses
3. Create learning tasks, providing to the students: - Background information,
- Examples,
- Procedures and
- Feedback
This element always appears in the courses, developed according to the advices given in it.
4. Support provided to the students in order to help them perform the task more easily and facilitate learning
This element didn’t always appears in the courses.
5. Summative evaluation This element always appears in the courses, but in some case the evaluation criteria are not included.
6. The evaluation projects results 6.2. The attitude to learn by computer
Attitude is considered one variable that should be controlled, because one positive attitude or a negative one affects to our research purpose.
The questionnaire, of 20 items, Likert scale (1-5 less to maximal agree), was answered by 10 students.
The items with higher punctuation (4.5): I enjoy working in internet environment; I find very positive the idea of using computers and Internet by study
different subject matters.
The items mean: 4.26 showing a positive attitude.
6. The evaluation projects results6.3. The Computer System Usability Q.
A questionnaire on usability and functionality of the IPLECS
platfom, of 19 items, Likert scale, 1-7, maximal disagree to
maximal agree with the item.
The items better valuated:
It was easy to learn to use the system (6.60)
The organization of information on the system screens is clear
I am able to efficiently complete my work using the system
Mean=5.94, S.D.=0.267, show a positive valuation and agreement
between the students.
6. The evaluation projects results6.4. Effect of PSS curriculum on students achievement in competencies’ (efficacy)
Mean of the 8 tasks (range 1 to 10) (Introduction to ITS)10,009,509,008,508,007,50
Fre
qu
ency
5
4
3
2
1
0
Histogram
Mean =8,90Std. Dev. =0,819
N =12
Introduction to Information and Telecommunication Systems
Students Tasks Range Min-max Mean St.D
12 8 1-10 7.75-10 8.90 0.89
Two subjects have been evaluated:1. Introduction to Information and Telecommunication Systems
6. The evaluation projects results6.4. Effect of PSS curriculum on students’ achievement in competencies’ (efficacy)
Means of the 8 tasks (range 1 to 10) (Advanced Electronic for ICT)
10,009,008,007,006,00
Fre
qu
ency
4
3
2
1
0
Histogram
Mean =8,49Std. Dev. =0,958
N =12
Advanced Electronics for Information and communication Technology
Students Tasks Range Min-max Mean St.D
12 8 1-10 7.25-10 8.49 0.95
2. Advanced Electronics for Information and communication Technology
6. The evaluation projects results6.5. Satisfaction with the ICS curriculum
and the IPLECS platform
The 'Reflective Questionnaire' on the general instructional design is applied in every course.
The questionnaire was integrated by 29 items, Likert scale, from 1 to 5, maximal disagree to maximal agree with the items.
We can see the resume of the descriptive statistics in two courses evaluated by the students.
6. The evaluation projects results6.5. Satisfaction with the PSS curriculum
and the IPLECS platform
Items mean. Reflective Q on 'Introduction and Telecommunication Systems'.
4,604,404,204,003,803,60
Fre
qu
ency
6
4
2
0
Histogram
Mean =4,12Std. Dev. =0,199
N =34
Reflective Q. on ‘Introduction to Information and Telecommunication Systems’ course
Students Range Mean St.D
10 1-5 4.12 0.11
6. The evaluation projects results6.5. Satisfaction with the PSS curriculum
and the IPLECS platform
Items mean. Reflective Q on 'Advanced electronics for informationand communication technologies'
4,254,003,753,503,253,00
Fre
qu
ency
20
15
10
5
0
Histogram
Mean =3,49Std. Dev. =0,334
N =34
Reflective Q. on ‘Advanced Electronics for Information and communication Technology’ course
Students Range Mean St.D
10 1-5 3.49 0.33
7. Conclusions
1. The PSS validity scale gives a heterogeneous results on the ICS courses in some items, but, in general the results show that the courses are aligned with the PSS Model.
2. The students’ attitude to learn by computer, is very positive and homogeneous.
3. The usability and functionality of the platform, present good evaluation on the screens organization and its easy learning.
…
7. Conclusions
4. The ‘ Effect of PSS curriculum on students’ learning achievement in competencies’, in the subjects evaluated, have been very positive, with a very good marks.
5. The ‘Satisfaction with the PSS curriculum and the IPLECS platform on the courses evaluated, show a high satisfaction.
Lessons learned and improvement necessities
1. In order to get a better adequacy to the instructional purpose of the DIPSEIL and PSS models is necessary that the curriculum developer and the instructional group design make and effort to work together.
2. Some changes should be done in the different instruments to collect information, to refine they.
3. We need to analyze information collected by focus groups and interviews, add their results to our report.
THANK YOU !!.
Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS)
Catalina Martí[email protected]
MIDE I - Faculty of Education- UNED (Spanish University for Distance Education)