design and implementation of lecturer evaluation system ... · enterprise data in databases, data...

9
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com _________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281 Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 242 Design and Implementation of Lecturer Evaluation System Using ELECTRE Method in Web-based Application Fajar Masya Hendra Prastiawan Destriyani Putri Information System Information System Information System Computer Science Faculty Computer Science Faculty Computer Science Faculty Mercu Buana University Mercu Buana University Mercu Buana University [email protected]; [email protected]; [email protected] ; Manuscript History Number: IRJCS/RS/Vol.04/Issue05/MYCS10083 Received: 25, April 2017 Final Correction: 20, April 2017 Final Accepted: 22, April 2017 Published: May 2017 Abstract -- In order to improve the performance of human resources (in this case is a lecturer) at the Faculty of Computer Science University of Mercu has conducted a lecturer's performance evaluation at the end of each semesterBuana periodically. The evaluation is aimed at improving the ongoing teaching and learning process. Based on the evaluation results, we will get an overview of the lecturer's work value for each semester. Ongoing lecturer evaluation activities have several problems such as lecturer evaluation process is still done manually.To solve these problems, it needs a change within the system that is from the manual lecturer evaluation system into web-based lecturer evaluation information system.Thus, all processes in lecturer evaluation activities can be done by online, either in the input process of questionnaires or in presenting a report.Lecturer evaluation activities which conducted by online can assist in making decision to get the best lecturer's recommendation by using ELECTRE method.System development method which use are use case diagram, activity diagram, sequence diagram, and class diagram and then is use PHP and MySQL as a programming language. Keywords: Performance Evaluation of Lecturers, ELECTRE Method, Waterfall I. INTRODUCTION In order to improve the performance of human resources (in this case is a lecturer) at the Faculty of Computer Science University of Mercu has conducted a lecturer's performance evaluation at the end of each semester Buana periodically.The evaluation is aimed at improving the ongoing teaching and learning process. Based on the evaluation results, we will get an overview of the lecturer's work value for each semester. The university assigns each lecturer who teaching in the class to distribute the questionnaire to the students and each student fills out the questionnaire to evaluate the teaching and learning process of the course. The Questionnaire which filling is still done manually by filling the sheet of paper. Then the sheets are collected and the University will process the data.Based on this, it certainly has some problems such as filling questionnaires only done by some students who are in the class when the questionnaire was distributed.The results of the questionnaires which got a bad score will separated by its lecturers to avoidthe reduction of the score of their work due to lack of supervision from the University, so The University still difficult to get the real score by its reports.Baed on the existing problem, this research intends to create a Lecturer Evaluation System by Student usingElimination et Choix Traduisant la Realite (ELECTRE) Methodto assist and facilitate in making decision related to lecturer's evaluation to get the best lecturer's recommendation. 1.2 RESEARCH PROBLEMS Based on the above background, the author tries to identify some of the issues that exist among them as follows: 1) How can a decision-making system with Elimination et Choix Traduisant la Realite (ELECTRE) method provide solutions in determining the best lecturer rankings?

Upload: trantram

Post on 27-Nov-2018

228 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 242

Design and Implementation of Lecturer Evaluation System

Using ELECTRE Method in Web-based Application

Fajar Masya Hendra Prastiawan Destriyani Putri Information System Information System Information System Computer Science Faculty Computer Science Faculty Computer Science Faculty Mercu Buana University Mercu Buana University Mercu Buana University [email protected]; [email protected]; [email protected];

Manuscript History Number: IRJCS/RS/Vol.04/Issue05/MYCS10083 Received: 25, April 2017 Final Correction: 20, April 2017 Final Accepted: 22, April 2017 Published: May 2017

Abstract -- In order to improve the performance of human resources (in this case is a lecturer) at the Faculty of Computer Science University of Mercu has conducted a lecturer's performance evaluation at the end of each semesterBuana periodically. The evaluation is aimed at improving the ongoing teaching and learning process. Based on the evaluation results, we will get an overview of the lecturer's work value for each semester. Ongoing lecturer evaluation activities have several problems such as lecturer evaluation process is still done manually.To solve these problems, it needs a change within the system that is from the manual lecturer evaluation system into web-based lecturer evaluation information system.Thus, all processes in lecturer evaluation activities can be done by online, either in the input process of questionnaires or in presenting a report.Lecturer evaluation activities which conducted by online can assist in making decision to get the best lecturer's recommendation by using ELECTRE method.System development method which use are use case diagram, activity diagram, sequence diagram, and class diagram and then is use PHP and MySQL as a programming language.

Keywords: Performance Evaluation of Lecturers, ELECTRE Method, Waterfall

I. INTRODUCTION

In order to improve the performance of human resources (in this case is a lecturer) at the Faculty of Computer Science University of Mercu has conducted a lecturer's performance evaluation at the end of each semester Buana periodically.The evaluation is aimed at improving the ongoing teaching and learning process. Based on the evaluation results, we will get an overview of the lecturer's work value for each semester. The university assigns each lecturer who teaching in the class to distribute the questionnaire to the students and each student fills out the questionnaire to evaluate the teaching and learning process of the course. The Questionnaire which filling is still done manually by filling the sheet of paper. Then the sheets are collected and the University will process the data.Based on this, it certainly has some problems such as filling questionnaires only done by some students who are in the class when the questionnaire was distributed.The results of the questionnaires which got a bad score will separated by its lecturers to avoidthe reduction of the score of their work due to lack of supervision from the University, so The University still difficult to get the real score by its reports.Baed on the existing problem, this research intends to create a Lecturer Evaluation System by Student usingElimination et Choix Traduisant la Realite (ELECTRE) Methodto assist and facilitate in making decision related to lecturer's evaluation to get the best lecturer's recommendation.

1.2 RESEARCH PROBLEMS

Based on the above background, the author tries to identify some of the issues that exist among them as follows:

1) How can a decision-making system with Elimination et Choix Traduisant la Realite (ELECTRE) method provide solutions in determining the best lecturer rankings?

Page 2: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 243

2) How to design a lecturer performance evaluation information system that can provide online questionnaire filling

service and can present the output performance evaluation result from each lecturer? 1.3 LIMITATION OF RESEARCH

The limitation in this research are: 1) The method used in decision making is the ELECTRE method to determine the best lecturer rank. 2) Objects that are evaluated are lecturers. 3) Filling in the questionnaire data online by the students and can present the results of the questionnaire. 4) The system to be built is a web-based application which can be accessed via the Internet network. 5) This application is built using Apache web server, PHP web programming language and MySQL as its database. 6) The process of developing lecturer evaluation information system is only at the Faculty of Computer Science Mercu

Buana University 7) In the form of questionnaires there are 4 assessment scales, among others:

a. Very unsatisfactory b. Not satisfactory c. Satisfactory d. Very satisfactory

1.4 PURPOSE AND OBJECTIVES

The purpose of this research are: 1) Analyze the ongoing lecturer evaluation system, design and develop an information system capable of reducing the

error rate in input data evaluation, data processing evaluation, calculating the evaluation value and presenting the result of evaluation output obtained by each lecturer.

2) To apply Elimination et Choix Traduisant la Realite (ELECTRE) method in determining the best lecturer rank from the result of lecturer's value.

3) With the new information system is expected to facilitate the activity in evaluating the performance of lecturers.

II. METHODOLOGY

2.1 DEFINITON OF DECISION SUPPORT SYSTEM The Decision Support System (DSS) is an organized collection of people, procedures, software (software), databases and tools used to help make decisions to solve problems. (Reynolds and Ralph, 2015: 316)

Decision Support System consists of several components as follows:

1) DSS DATABASE DSS database management system enables managers and decision makers to perform qualitative analysis on large enterprise data in databases, data warehouses, data marts using data mining and business intelligence. DSS database management systems can also connect to external databases to provide managers and decision makers with more information and decision support. External databases can include internet, libraries, government databases etc. The combination of access from internal or external databases can improve the performance of DSS systems.

2) BASE MODEL Base model allows managers and decision makers to perform quantitative analysis on both internal and external data. Once large databases are collected and stored, companies use models (analysis) to turn data into future products, services and benefits. Base model gives decision makers access to various models so as to explore different scenarios and can be seen the effect. It can help in the decision making process.

3) USER INTERFACE OR DIALOG MANAGEMENT The user interface or manager dialog allows the user to interact with the DSS to get the information.

2.2 MULTI CRITERIA DECISION MAKING Multi Criteria Decision Making (MCDM) is a decision-making method to establish the best alternative of a number of alternatives based on certain criteria. Criteria are usually the size, rule or standard used in decision making. MCDM is used to solve problems in discrete space. Therefore, the MCDM is usually used to assess or select a limited number of alternatives. There are some common features that will be used in MCDM, ie alternatives, attributes, conflicts, between criteria, decision weight and decision matrix.Some methods that can be used to solve MCDM problems include:

1) Simple Additive Weighting Method (SAW) 2) Weighted Product Model (WPM) 3) ELECTRE 4) Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) 5) Analytic Hierarchy Process (AHP)

Page 3: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 244

2.3 ELECTRE ELECTRE Method is included in the multicriteria decision-making method of analysis originating from Europe in the 1960s. ELECTRE is an acronym of Elimination et Choix Traduisant la Realite.The ELECTRE method is one of the methods used to rank and determine the best alternative. The basic concept of the ELECTRE method is to handle outranking relationships by using pairwise comparisons of several alternatives based on each appropriate criteria. Outranking relationships explain that the i-alternatives do not dominate the j-alternatives quantitatively.Alternatives are said to be dominated if there are other alternatives that outperform them in one or more attributes and the same in the remaining attributes (Made Sudarma et al, 2015). 1) The first thing that to do in the ELECTRE method is that each attribute is converted to a comparable value. Any

normalization of the value () can be done by the formula:

So we get the R matrix which is the result of normalization.

R is a normalized matrix, where m represents an alternative, denotes the criterion and is the normalization of the choice of alternative i in relation to the j criterion.

2) After normalization, the next step is to assign the weight (factor of interest) to each criterion expressing its relative

importance () by means of each column of the matrix R multiplied by the weights () determined by the decision maker. Thus, the weighted normalized matrix is V = RW written in the following formula:

Where W is:

3) The third step is to determine the set of concordance and discordance, for each pair of alternatives k and l (k, l = 1, 2, 3, ... m and k ≠ l) the set of criteria j is divided into two subsets, concordance and discordance. When a criterion in an alternative including concordance is:

Instead, the complementary of this subsection is discordance, that is, when:

4) The fourth step is to determine the value of concordance and discordance matrices. a. Concordance To determine the value of the concordance matrix is to add the weights included in the concordance set, mathematically as follows:

Page 4: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 245

So the concordance matrix produced is:

b. Discordance To determine the value of the elements in the discordance matrix is to divide the maximum of the difference of the criterion value included in the discordance set with the maximum difference of the values of all the existing criteria, mathematically as follows:

So the discordance matrix produced is:

III. ANALYSIS AND DESIGN SYSTEM 3.1 PROBLEM IDENTIFICATION The problems faced in the ongoing lecturer evaluation system are as follows:

1) There are students who do not fill out the questionnaire form completely so as to result in data processing in the evaluation process becomes ineffective and there is a possibility of data obtained is not valid.

2) Evaluation activities of lecturers take a lot of time, because the procedure used has long stages. In addition, there are often lecturers in the classroom without any students or the number of students who attend just a little.

3.2 PROBLEM SOLVING Problem solving used in solving existing problems is by changing the lecturer evaluation system that is running manually with computerized system based on website.With this solution, it is expected that there will be no more processing of data in the process of ineffective evaluation, long evaluation procedures of lecturers that take a lot of time. The lecturer's evaluation process is done online. Each student and lecturer has a special account in the process of filling out the questionnaire form or viewing the evaluation report.

3.3 ANALYSIS OF CURRENT SYSTEM This analysis is conducted to illustrate the ongoing lecturer's performance evaluation system at Mercu Buana University, especially the Faculty of Computer Science. The implementation flow begins with Puslit in coordination with the Director of Learning, Research and Technology in developing the PBM evaluation questionnaire form. After the questionnaire was approved, LPPM (Institute for Research and Community Service) formed a lecturer evaluation team (enumerator officer). After that, the evaluation instrument of lecturers is ready to be circulated by the enumerator officer to the students in each class where the learning process is ongoing between the students and the lecturer concerned according to the course. Before distributing the lecturer evaluation instrument, the enumerator officer gives first lecture letter to the lecturer as the enumerator identifier. After getting permission from the lecturer, the enumerator officer distributes lecturer evaluation instrument to the students and the students are asked to fill the questionnaire instrument. If the students have evaluated the evaluation process of the lecturer, the student returns the evaluation instrument of the lecturer to the enumerator officer. After the enumerator officer receives all results of the lecturer's evaluation instrument, the officer checks the feasibility of the lecturer's evaluation instrument. Then, the enumerator officer sends the result to the LPPM to be processed to the next stage which is to enter data into computer by using Microsoft Excel software, then analyzed and calculated the acquisition result.Based on the results of data processing that has been done in the previous stage, the LPPM reports the results of the evaluation of lecturers and the evaluation report is distributed to the Related Party (Rector, Vice Rector of Fields 1, 2 and 3, Director of Learning, Research and Technology, Director of Resources, Coordinator MKCU, Head of Quality Assurance Center and Dean of Faculty). The following is a description of the flow of the running system.

Page 5: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 246

Fig. 1 Analysis of Current System

3.4 PROPOSED SYSTEM Below is the proposed architecture for building the system.

Fig. 2Proposed System Architecture

Page 6: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 247

3.5 ACTIVITY DIAGRAM 1) Activity Diagram Proposed Filling Questionnaire

Fig. 3.Activity Diagram Proposed Filling Questionnaire

2) Activity Diagram Proposed Managing Questionnaire Evaluation

Fig. 4.Activity Diagram Proposed Managing Questionnaire Evaluation

Page 7: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 248

3) Activity Diagram Proposed Calculating Electre Method

Fig. 5Activity Diagram Proposed Calculating Electre Method

3.6 CLASS DIAGRAM

Fig. 6.Class Diagam

Page 8: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 249

IV. IMPLEMENTATION

4.1 USER INTERFACE DISPLAY OF FILLING QUESTIONNAIRE This page is a display of questionnaires filled by students after logging into the system and clicking the questionnaire button on the student's main page. Then, students are asked to choose the name of lecturers and courses taught by the lecturer before the system displays form filling questionnaire.

Fig. 7- User Interface Display of Filling Questionnaire

4.2 TEST RESULT ANALYSIS After thorough testing, it can be concluded that the test has presented the output (output) and the process in accordance with the design of the application. The results of this test can be said that this application can work well because it has been proven from the results of test scenarios. Test results obtained can be analyzed as follows:

1) The admin login page that controls menu activity and the form in the system has done well. 2) The user login page in the system has been running properly. 3) The admin home page in the system is running well. 4) The main page of the user in the system running well and in accordance with the expected. 5) All sub menus contained in the menu of master data, menu questionnaire evaluation and electre process works well

in accordance with the planned.

V. CONCLUSION The conclusion that the author can be taken from the results of the implementation and evaluation of this research are as follows: 1) Lecturer evaluation system that has been made has been computerized and web-based and can be used as an

alternative solution to assist in lecturer evaluation process. 2) With this system, admins and lecturers can see the best lecturer ranking obtained from the calculation using the

ELECTRE method. 3) For further research, it is expected that the system will be added for evaluation of lecturer based on the research and

community service

Page 9: Design and Implementation of Lecturer Evaluation System ... · enterprise data in databases, data warehouses, data marts using data mining and business intelligence. ... questionnaire

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842 Issue 05, Volume 4 (May 2017) www.irjcs.com

_________________________________________________________________________________________________ IRJCS: Impact Factor Value – SJIF: Innospace, Morocco (2016): 4.281

Indexcopernicus: (ICV 2015): 79.58 © 2014- 17, IRJCS- All Rights Reserved Page - 250

REFERENCES

[1] Connolly, Thomas dan Carolyn Begg. 2014. Database Systems: A Practical Approach to Design, Implementation, and

Management, 6th edition. New Jersey: Pearson. [2] Dennis, Alan dkk. 2015. System Analysis & Design An Object Oriented Approach with UML, 5th edition. New

York: John Wiley. [3] Eniyati, Sri dan Rina Candra N. S. 2010. Perancangan Sistem Pendukung Keputusan Penilaian Prestasi Dosen

Berdasarkan Penelitian dan Pengabdian Masyarakat. Journal Teknologi Informasi DINAMIK. Vol. XV, No. 2. (ISSN: 0854-9524).

[4] Gilmore, W. Jason. 2010. Beginning PHP and MySQL: From Novice to Professional, 4th edition. New York: Apress. [5] Gupta, Hitesh. 2011. Management Information System (An Insight). New Delhi: International Book House PVT.

LTD. [6] Situmeang, Mesdina. 2015. Perancangan Aplikasi Penilaian Hasil Kinerja Dosen Terbaik Dengan Metode Simple

Multi Attribute Rating Technique (Studi Kasus: AKPER Yayasan Binalita Sudarma Medan). Pelita Informatika Budi Darma.Vol. IX, No. 1. (ISSN: 2301-9425).

[7] Stair, Ralph M. dan George W. Reynolds. 2015. Fundamentals of Information System, 8th edition. USA: Cengage Learning.

[8] Suehring, Steven dan Janet Valade. 2013. PHP, MySQL, Javascript & HTML5 All-In-One for Dummies. New York: John Wiley.

[9] Valacich, Joseph S. dan Christoph Schneider. 2015. Information Systems Today Managing in the Digital World, 7th edition. New Jersey: Pearson.