uncw.edu csb mscsis assessmen… · web viewuncw.edu

31
University of North Carolina Wilmington Educational Program Assessment Plan and Report Assessment Plan for 2012-2013 Cameron School of Business Primary Contact Name/Info: Becky Porterfield, AoL Director, Cameron School of Business Degree: Master of Science in Computer Science and Information Systems MSCSIS Program Outcomes Program Outcome UNCW Strategic Goal Tools Implementation Summary of Findings Actions Taken PO 1: Increase dialogue between industry and MS CSIS program. UNCW Goal 5 Wilmington IT Exchange and Conference Dr. Tom Janicki; number of industry people, faculty and students who attend events Spring 2013 event had approximately 400 attendees: students, industry professionals, faculty. Breakout sessions and panels also support PO2. Supports PO3 through broad awareness marketing. Panel topics are adjusted each year to maintain currency. Post- event meetings to adjust operational issues. New speakers and special guests each year. IT Career Day Dr. Tom Janicki, other faculty Fall 2013 event had more than 25 employers Continue to promote the event, with the

Upload: others

Post on 30-Aug-2019

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

University of North Carolina WilmingtonEducational Program Assessment Plan and Report

Assessment Plan for 2012-2013Cameron School of Business

Primary Contact Name/Info: Becky Porterfield, AoL Director, Cameron School of Business

Degree: Master of Science in Computer Science and Information Systems

MSCSIS Program OutcomesProgram Outcome

UNCW Strategic GoalTools Implementation Summary of Findings Actions Taken

PO 1: Increase dialogue between industry and MS CSIS program.UNCW Goal 5

Wilmington IT Exchange and Conference

Dr. Tom Janicki; number of industry people, faculty and students who attend events

Spring 2013 event had approximately 400 attendees: students, industry professionals, faculty. Breakout sessions and panels also support PO2. Supports PO3 through broad awareness marketing.

Panel topics are adjusted each year to maintain currency. Post-event meetings to adjust operational issues. New speakers and special guests each year.

IT Career Day Dr. Tom Janicki, other faculty

Fall 2013 event had more than 25 employers inverviewing. Approximately 30 graduate students attended. Approximately 20 CSIS alumni attended.

Continue to promote the event, with the goal of increasing industry and student involvement.

Cyber Defense Competition

Dr. Ulku Yaylacicegi, Dr. Ron Vetter, faculty and IT Professionals

Spring 2013 group of graduate and undergraduate students attended their first event. New contacts made with DOD and FBI.

Continue involvement making operational changes. Offer independent study credit to students.

Page 2: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Cape Fear .Net Developer Group

Meeting space on campus through Dr. Janicki, IT professionals arrange meetings

This fills a professional organization gap in the Wilmington area. Venue for faculty and professionals to interact and share knowledge.

Continue supporting this professional group through meeting space and attendance of faculty and students.

Day trip to Raleigh to do site visits at

Whole day trip where students spend time at one of these companies: AT&T and EMC.

Employers enjoy working with students.Students see a real-world work environment.

Continue to make the trip. Expand the pool of companies that students can visit. Candidates include Credit Suisse, Fidelity, IBM, AT&T, SAS and Red Hat.

Spring trip to NC State Engineering Career Fair

Graduate Student Association in CSIS organized a trip to the NC State Career Fair.

At least one job offer and at least one internship offer were a result of this trip. In addition, we now have contacts into IBM and EMC that we didn’t have before

Develop the new contacts at IBM and EMC, and continue to support the GSA in making this trip in the Fall and Spring.

Alumni Reunion One early evening of Business Week, we hosted a social event in honor of MSCSIS alumni, and invited faculty, students, alumni, and employers.

About 40 attendees. Approximately 10 alumni, 5 employer representatives, and 15 students and 10 faculty attended. All were very pleased with the event.

More formally invite employers to this event in Spring 2014.

Business Week Sessions specifically for MSCSIS students by MSCSIS Alumni

Three MSCSIS alumni returned to campus to be on a panel of MSCSIS alumni, and relate their work experience. Companies: ATMC, AT&T.

At least 30 attendees. Good networking opportunities for current students.

Continue to develop Business Week sessions that are specifically of interest to MSCSIS students. Invite alumni from other companies.

PO2: Provide learning IT Breakfast Series Dr. Tom Janicki; number Approximately 2 Continue to offer new

Page 3: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

opportunities for faculty

UNCW Goal 2

of breakfast meetings and attendance data

breakfast meetings each semester. Faculty and professionals share knowledge and keep current with fast-changing technologies.

topics each year.

Cyber Defense Competition

Dr. Ulku Yaylacicegi, Dr. Ron Vetter, faculty and IT Professionals

Bi-weekly meetings of students with industry professionals guest-speaking. Faculty learn real-world challenges.

Continue and increase involvement in this event.

Cape Fear .Net Developer Group

Meeting space on campus through Dr. Janicki, IT professionals arrange meetings

A valuable learning opportunity for faculty.

Continue supporting this professional group through meeting space and attendance of faculty and students.

Faculty training Faculty arrange their own, funding support from ISOM and CSB

At least 4 IS faculty traveled for multi-day technical training. New knowledge integrates well into the classroom.

Continue to financially support technical training trips. Seek new sources of funds for training.

PO3: Improve student recruitmentUNCW Goal 1

New web site content; web site analytics

Dr. Douglas Kline, Dr. Tom Janicki, other faculty

Web site content does not address concerns of prospective students. Web traffic has been stable over 2 years.

Implement “landing pages” more focused towards specialized areas such as Security. Provide links from capstone documents to main site. Improve calls-to-action. More clearly explain application process.

Social media: LinkedIn, Facebook

Dr. Douglas Kline, Mrs. Karen Barnhill

Social media usage is increasing among potential applicants

Establish LinkedIn and Facebook presences. Adopt LinkedIn for internal processes such

Page 4: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

as event announcement. Use LinkedIn for public announcements: awards, publications, etc.

Google Adwords and reports

Dr. Douglas Kline, Mrs. Karen Barnhill

The current Adwords budget is too small to have a measurable effect, but shows anecdotal promise.

Increase adword budget, have focused landing pages, target major metro regions one direct flight from Wilmington.

Graduate School applications reports

Graduate School Applicants hear about graduate programs from 1) the web; 2) word-of-mouth

Increased social media usage. Increase alumni word-of-mouth through social media.

Mobile-friendly web content

Mobile-friendly versions of targeted marketing pages: FAQ, YouTube Video, Top Ten Reasons, and targeted topic pages

Bounce rate for these landing pages dropped from 95% to about 40%.

Continue to develop and promote mobile friendly web content.

Target specific advertising through Adwords

More specific ad groups targeting students interested in advanced study in: Security, Mobile Development, Biometrics, and Natural Language Processing.

More traffic at lower cost. Grant of $4400 received from Sloan Foundation for advertising.

Continue to improve Ad Copy, Keywords, Landing pages, and lead follow-through.

MSCSIS Student Learning Outcomes

MSCSIS ProgramSLO1: Graduates will be able to formulate and solve problems using advanced mathematics and numerical methods,

Method: Multiple choice questions were developed to assess content knowledge.

Administration: Questions are administered to all students in CSC/MIS 532 Design and Analysis of

No trends in scores were apparent over time. However, correct answers to the recurrence question of

Special attention will be given to writing and solving recurrences for running time in the Computer Algorithms

Page 5: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

and computer information systems-based techniques.

UNCW Goal 1

Algorithms at the end of their program. The MSCSIS faculty committee reviews the data and initiates any changes.

the assessment were very low.

course.

SLO2: Graduates will demonstrate knowledge of ethics and professionalism, and understand contemporary issues such as green computing, data security, privacy, and compliance with regulations.UNCW Goal 3

Method: Multiple choice questions were developed to assess content knowledge.

Administration: Questions are administered to all students in CSC/MIS 534 Information Security Management at the end of their program. The MSCSIS faculty committee reviews the data and initiates any changes.

No trends were identified in assessment scores across time. However, questions regarding cryptoanalysis were low.

The textbook and instructor for MIS 534 will change in the Spring. Dr. Cummings will be teaching the course in Spring 2013, and will cover cryptoanalysis.

SLO3: Graduates will be able to complete analysis and design of business processes employing the latest information technology techniques, including the unified process model.UNCW Goal 1

Method: Multiple-choice questions were developed to assess content knowledge.

Administration: Questions are administered in CSC/MIS 550 and 565, Software Engineering and Analysis, Modeling, and Design courses, respectively at the end of their program. The MSCSIS faculty committee reviews the data and initiates any changes.

Scores did not change in a patterned way over time. However, a particular question regarding project management’s role in system development scored very low.

Additional emphasis will be placed on the role of project management in the system development process, in the MIS550 course.

SLO4: Graduates will be Method: Multiple-choice Administration: No obvious trends over Additional readings on

Page 6: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

able to apply science and business principles to analyze and interpret data, using analytic and computer-based techniques.UNCW Goal 1

questions were developed to assess content knowledge.

Questions are administered in CSC 555 Data Management Systems at the end of their program. The MSCSIS faculty committee reviews the data and initiates any changes.

time were apparent. However, correct responses to the question regarding Clustered indexes were very low.

clustered indexes will be assigned in the MIS555 class.

SLO5: Graduates will demonstrate effective communication through written and oral presentations.

UNCW Goal 1

A: Written Communication

Method: A capstone assessment survey was developed for all projects for evaluation, including thesis.

Administration: The faculty team evaluates the work using the assessment survey to determine if effective written communication was evident. This is conducted when the major culminating project for the degree is completed. The MSCSIS faculty committee reviews the data and initiates any changes

Question 7 of the overall capstone evaluation form is the only communication question on the rubric. No obvious trends appear in the data. However, anecdotal evidence suggests oral communication skills can be improved.

More granular assessment questions will be added to measure oral and written components. Extra-curricular communication skills sessions will be delivered prior to Career Night.

SLO6: Graduates will be exposed to a variety of advanced technology communications tools, such as Web conferencing, wikis, and social networking

Method: Multiple-choice questions were developed to assess content knowledge.

Administration: Assessment is administered by faculty member in the CSC 544 Network Programming course every fall semester to all students.

Rubric scores showed no clear trend over time. However, the scores are generally very high, with many questions scoring 100%.

A new set of questions should be developed that will more accurately assess this student learning outcome.

Page 7: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

software.UNCW Goal 1

The MSCSIS faculty committee reviews the data and initiates any changes

Page 8: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix A: MSCSIS Program Goals

Information Systems / MS Computer Science Information SystemsAdvisory Board MeetingTuesday, September 21, 2010Madeline Suite5:15 to 7:30 p.m.Agenda (Key Items)1. Update on success of WITX Conference2. Introduction of Guests / Business and Student3. Career Day (November 16, 2010) Update, seek speakers, interview tables4. Breakouts to seek input from the advisory board as we start our 5 year review of the MS CSIS program. Information below is intended as background materials in advance of the meeting.Review of MS CSIS ProgramOverview of Program:The Information Systems & Operations Management department from the Cameron School of Business and the Computer Science department from the College of Arts and Sciences began the Master of Science in Computer Science and Information Systems in Fall 2005. The MSCSIS is an intensive graduate program aimed at preparing the student to take on leadership roles in the development and implementation of computer and information systems. The curriculum requires 36 semester hours. There are six required core courses providing a mix of theoretical underpinning, technical skills and information technology perspectives. Students can choose elective courses to provide opportunity for additional study in a variety of areas. The program culminates with a capstone experience that can be an integrative project or a thesis.Experienced professionals and undergraduates from both disciplines will enable significant classroom sharing of real world and theoretical knowledge.Core Course Topics:MIS 534. Information Security Management

Security Architecture and Models Telecommunications and Network Security Business Continuity Planning and Disaster Recovery Physical Security, including securing network devices Authentication, authorization, and accounting Implementing firewall technologies, intrusion prevention and VPN Cryptographic systems

Page 9: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

MIS 555. Database Management Systems Structured Query Language Data Modeling Indexing & Balanced Trees Transaction Management DB Management (Hardware, Backup, Recovery, Maintenance, etc.)

MIS 565. Analysis, Modeling and Design System development methodologies including the cycle and iterative design models: development phases including system

selection and planning, analysis, logical design, physical design, implementation and maintenance Techniques for requirements, determination, collection and organization Team organization and communication; interviewing, presentation, design and delivery; group dynamics and leadership. Project feasibility assessment and risk analysis Design reviews and structured walkthroughs Human computer interaction (HCI) Software and system quality metrics Software package evaluation and acquisition, open source, managing, external relationships and procurement. Currency in the field of Information Technology Enhanced presentations/writing skills

CSC 532. Design and Analysis of Algorithms I Design of efficient computer algorithms. Algorithms for sorting, searching, pattern matching, and polynomial arithmetic, cryptography. The study of greedy algorithms, graph algorithms.

CSC 544. Network Programming TCP/IP Protocols: SMTP, HTTP, ARP, TCP, UDP, IP, DNS, ICMP, DHCP, SNMP Implementation of network and distributed programming concepts Client/server application programming Networking programming interfaces (specifically raw sockets and socket APIs) Hands on experience with network components (significant laboratory component)

CSC 550. Software Engineering

Reading, critiquing and summarizing research literature (4-8 weeks) Software architecture and design UML modeling and the UML metamodel Aspect-oriented software engineering

Page 10: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Model-driven software development

Elective Courses Offered:MIS 513. (MBA 513) Information Analysis and ManagementCSC 515. (415) Artificial Intelligence.CSC 517. Symbolic Artificial IntelligenceCSC 520. Digital Image ProcessingCSC 421/521. Computer GamingCSC 537. (437) Parallel ComputingCSC 546. (446) Grid ComputingMIS 560. Data MiningMIS 567. Software Architecture and Development PracticesPOM 572. Project ManagementMIS 575. E-Strategies and ImplementationCSC 577. Pattern RecognitionMIS 587. (CSC 587) Systems SimulationCSC 591. (MIS 591) Directed Independent StudyCSC 592. (MIS 592) Topics in ComputingCSC 594. (MIS 594) Research ProjectCSC 595. (MIS 595) Research SeminarCSC 598. (MIS 598) InternshipCSC 599. (MIS 599) Thesis

Capstone Experience:Option 1 - Research ProjectThis option requires at least 36 semester hours of graduate credit, with three credit hours for the project (CSC 594 or MIS 594). Under this option, the student is required to complete a three hour research project under the direction of a graduate advisory committee. This project could involve the development of software, work on a project (potentially part of a team), independent research, or some other scholarly pursuit. The outcome includes a technical paper written by the student and an oral defense acceptable to the student's advisory committee. In the oral defense, the student is responsible for the domain of the research project as well as the program coursework.Option 2 - ThesisThis option requires at least 36 semester hours of graduate credit, with six credit hours for the thesis (CSC 599 or MIS 599). Each student must present and defend a thesis, based on original research, acceptable to the student's advisory committee, prior to

Page 11: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

graduation. In the oral defense, the student is responsible for the domain of the research effort as well as the program coursework. The thesis defense is open to the public.

List of Capstone/Thesis Completed:Seiken Higashionna, Constructing a 3D morphable face from a single picture by establishing a correspondence from 2D active appearance model parameters, July 16, 2010Maz Boddoohi, An Evaluation of Software Architectures, May 3, 2010Christopher Cotton, Rez-o-lution: Ticket Management System, April 30, 2010Matthew Ratliff, Active Appearance Models for Affect Recognition using Facial Expressions, April 23, 2010Parker Moran, Advancement of Academic Research Computing at UNCW, April 16, 2010Jerry Martin, Suppressing Independent Loops in Packing/Unpacking Loop Nests to Reduce Message Size for Message-Passing Code, April 14, 2010Maurice Benson,Using 3D Video Game Scenarios and Artificial Neural Networks to Classify Brain States for a Brain Computer Interface, March 30, 2010Camilo Alvarez, iTour: A System for Self-Guided Virtual Campus Tours of UNCW, December 8, 2009Matt Boykin, Utilization of Automation to Deliver Historical Economic Data to Customers through the Use of Web Technologies, December 3, 2009Matt Hernandez, Determining Improvements to IT Systems through Business Service Management while Calculating, Through Time Savings (or Fractional Employee Reduction), the Business Value of IT Investments, December 1, 2009Matt Mascherin, Venture Business Plan for E-Commerce Business, December 1, 2009Robert Harrison, A Low-Cost Tele-Operated Robotic Platform, November 30, 2009Casey Tucker, GNU Radio and the USRP as a Solution for Remote Emergency Monitoring, November 11, 2009Royce Nobles, Evaluation of Spelling Correction and Concept-based Searching Models in a Data Entry Application, June 25, 2009Sarah Peck, Analysis and Implementation of an Assurance of Learning System for the Cameron School of Business, May 13, 2009Justin Denning, A Quantitative Analysis of SQL Server 2008 Constructs, May 1, 2009Kevin Matthews, Development and Evaluation of an Adaptive Grading/Learning System (AGLS), December 11, 2008Steve Sutton, Cipher-N -- a Secure, Web-based Document Exchange Service, December 8, 2008William Shipman, CommunityTips.org: A system for Anonymous Tipping, October 30, 2008Max Rupplin, DDAS: Distributed Data Analysis System, June 13, 2008Josh Tobey, Utilizing Web Technologies to Provide Historical Data Relative to the Economic Health of Southeastern North Carolina, May 8, 2008James G. Huff, An Applicable Approach to Signal Analysis and Peak Detection, May 7, 2008Ryan Renninger, Analysis and Implementation of a Financial Budgeting System in a Corporate Environment, April 25, 2008

Page 12: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Allen Rawls, A Systematic Approach for Improving Predicted Arrival Time Using Historical Data in Absence of Schedule Reliability, April 16, 2008Daniel Rayburn-Reeves, Disambiguating Human Spoken Diary Entries Using Context Information, April 4, 2008Shaun Border, Communication Between Outlook Mobile Services and Mobile Devices, November 19, 2007Alisha Oliver, Exploring Methods to Justify Projects with Intangible Benefits, November 14, 2007Eric Harris, Extending GridNexus and JXPL to Support the Visual Assembly of Web Services, July 12, 2007Ryan Wilkins, Neurocognitive Inspired Hierachical Face Recognition System, May 10, 2007Chris Holtsford, A Solution for Community Development, May 2, 2007Employers of Graduates:American Eagle Chicago ILDeloitte Touche Atlanta GAGE-Hitachi Nuclear Energy Wilmington NCNew Hanover Regional Medical Wilmington NCCorning Wilmington NCATMC Shalotte NCPPD Wilmington NCSafe Data Inc Wallace NCVisionAir Wilmington NCUnited Advisors Wilmington NCThe Coastal Companies Holden Beach NCHealth Care Software Farmingdale NJTriumph Interactive Wilmington NCW. T. Cox Subscriptions Wilmington NCGrant Thornton Raleigh NCTranS1 Wilmington NCAT&T Charlotte NCUNCW Wilmington NCPricewaterhouse Coopers Washington DCSpecialty Soft Wilmington NCCape Fear Community College Wilmington NC94% of graduates have positions within their field or are attending graduate school (1 graduate in PhD program) within 2 months of graduation. Average Starting Salary: $54,545

Review of MS CSIS Program

Page 13: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

BREAKOUTSBreakout sessions organized into the following groups:

Core Curriculum:1. Review the core course topic lists.2. Is there anything missing?3. Are the topics relevant today?

Selection of Electives:1. Review the electives offered.2. Are there any elective courses that are missing?3. Are the courses relevant today?4. How should we assess the value of our programs?

Service Learning / Community Involvement / Project Theses1. Internships are strongly encouraged in the program.2. What can we do to get more students placed?3. How should internships be assessed?4. Review the projects/theses completed.5. Are the projects relevant today?6. How do we involve the community / mentor relationship

Page 14: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix B: MSCSIS SLO1 Findings

Content Knowledge Assessment Results, Spring2009 – Spring 2013CSC 532

Percent CorrectSpring 2009

Spring 2011

Fall 2011

Spring 2012

Fall 2012

Spring 2013

Is the following true or false? f(n) = O(g(n)) Implies g(n) = O(f(n)) 0% 50% 50% 42% 25% 50%Is the following true or false? f(n) = O(g(n)) implies g(n) = Ω(f(n)) 100% 25% 50% 33% 75% 50%What is the O() complexity for the following function. Give your answer as a function of n. 100% 62% 50% 50% 50% 17%What is the O() complexity for the followng segment of program which multiplies two matrices a and b (resident in 2-d arrays) to find the result matric in c. 100% 75% 75% 75% 75% 100%The two most common algorithms (Prim and Kruskal Algorithms) to solve Minimum Spanning Tree problem belong to which of the following class of techniques. 100% 100% 75% 42% 100% 67%Which of the following characterizes the applicability of Dynamic Programming Techniques to solve problems? 100% 75% 100% 75% 100% 50%Write a recurrence for the running time T(n) of f(n), and solve that recurrence. Assume that addition can be done in constant time. 0% 50% 75% 25% 50% 17%Decide whether you think the following statement is true or false. In a flow network which has maximum flow from node s to node t the flow across any s-t cut (no matter which cut is considered) is the same. 0% 50% 50% 67% 50% 50%Which of the following characterizes the applicability of Linear Programming Technique to solve problems? 100% 88% 100% 92% 100% 100%Decide whether you think the following statement is true or false. Let G be a flow market, with a source s and a sink t, and a positive integer capacity c(e) on every edge e. If it is a maximum flow in G, then f saturates every edge out of s with flow (I.e. for all edges e out of s, we have f(e)=c(e) ). 0% 62% 100% 83% 75% 83%

overall 60% 64% 73% 58% 70% 58%N 1 8 4 12 4 6

Page 15: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Spring 2009

Spring 2011

Fall 2011 Spring 2012

Fall 2012 Spring 2013

60% 64%73%

58%

70%

58%

CSC532 Computer Algorithms Assessment Scores

Page 16: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix C: MSCSIS SLO2 Findings

Ethics/ MIS534 Assessment Results, Spring 2009-Spring 2013

Spring 2009

Spring 2010

Spring 2011

Fall 2011

Spring 2012

Fall 2012

Spring 2013

Identifying, assessing, and reducing risk to an acceptable level and maintaining the achieved level is referred to as _________. 89% 100% 92% 100% 100% 100% 100%What are the three fundamental principles (AIC triad) that serve as a security program’s objectives? 67% 100% 96% 75% 92% 100% 83%The steps of an access control model should follow which logical flow? 67% 60% 71% 75% 67% 100% 83%What is the new program/standard that evaluates the computer security in the United States? 33% 60% 33% 25% 33% 50% 17%Which of the following items is Not considered a preventive physical control? 100% 80% 92% 75% 83% 100% 100%A function that takes a variable-length string and creates a fixed-length value is called ______. 100% 80% 58% 100% 75% 75% 100%When considering an IT system Development life-cycle, security should be: 100% 80% 88% 100% 92% 100% 100%Preparing for a damaging event before it takes place in order to minimize loss and ensure that the business continues to operate is the definition of _______? 100% 100% 96% 100% 83% 100% 67%A hospital is trying to select a facility backup option. They want to ensure no downtime and extremely focused on contingency planning and testing capability through the year. Which of the following alternatives would serve the hospital best? 44% 60% 21% 75% 25% 25% 17%Which of the following is the science of studying and breaking encryption algorithms and cryptosystem? 100% 80% 50% 50% 17% 25% 83%

Average 80% 80% 70% 78% 67% 78% 75%

N 9

5

24

4

12

4

6

Page 17: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Spring 2009

Spring 2010

Spring 2011

Fall 2011 Spring 2012

Fall 2012 Spring 2013

80% 80%

70%

78%

67%

78%75%

MIS534 Information Assurance Assessment Scores

Page 18: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix D: MSCSIS SLO3 Findings

Content Knowledge Assessment Results, Fall 2009 – Spring 2013

Fall 2009

Spring 2010

Spring 2011

Fall 2011

Spring 2012

Fall 2012

Spring 2013

In general, academics and professionals read research literature for all but one of the following reasons. 69% 67% 80% 75% 92% 50% 50%Which of these questions is least important in assessing research articles? 38% 17% 60% 50% 33% 50% 83%To which scientist is the origin of separation of concerns principle normally attributed? 100% 83% 60% 50% 75% 100% 33%Which of the following is not a fundamental AOSD concept 92% 83% 100% 75% 67% 100% 50%A meta-model is: 100% 100% 80% 100% 92% 100% 83%Software testing shows all of the following, except: 46% 100% 40% 100% 75% 75% 33%It is difficult to find all the bugs in large complex software because: 92% 100% 60% 100% 83% 50% 50%Validation is: 38% 50% 20% 25% 50% 0% 67%A test oracle is: 54% 83% 60% 100% 17% 25% 50%Identify the concept that is not fundamental to model-driven software development. 31% 33% 20% 25% 17% 25% 33%

Average 66% 72% 58% 70% 60% 58% 53%N 13 6 5 4 12 4 6

Page 19: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Fall 2009 Spring 2010

Spring 2011

Fall 2011 Spring 2012

Fall 2012 Spring 2013

66%72%

58%

70%

60% 57%53%

CSC550 SW Engineering Assessment Scores

Page 20: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix E: MSCSIS SLO4 Findings

Content Knowledge Assessment Results, MIS 555, Fall 2010

Fall 2008

Fall 2010

Fall 2011

Spring 2012

Fall 2012

Spring 2013

1. The main purpose of referential integrity constraints in a relational database is to: 57% 54% 100% 50% 50% 83%2. Structured Query Language is a(n): 57% 77% 50% 67% 100% 50%3. A foreign key must be: 43% 54% 50% 67% 25% 33%4. As compared to other data structures, Balanced Trees are used in relational databases because they: 86% 100% 50% 50% 100% 17%5. Data fragmentation is helpful in what type of system? 100% 69% 50% 42% 25% 0%6. The "I" in the ACID transaction requirements stands for: 100% 100% 75% 50% 50% 67%7. One purpose of an SQL view is to: 100% 85% 100% 83% 100% 83%

8. Transaction collisions without loss of data integrity are accomplished with: 100% 100% 100% 75% 100% 33%9. Relational databases were created to: 57% 38% 100% 33% 50% 33%10. Clustered indexes perform especially well on: 71% 62% 100% 8% 50% 33%

average 77% 74% 78% 53% 65% 43%

N7 13

4 12 4 6

Page 21: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Fall 2008 Fall 2010 Fall 2011 Spring 2012 Fall 2012 Spring 2013

77% 74% 78%

53%

65%

43%

MIS555 Relational DatabaseAssessment Scores

Page 22: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix F: MSCSIS SLO5 Findings

1. Written Communication Assessment Results, Spring 2011

2007 2008 2009 2010 2011 2012 2013

4.21

4.04

4.25

3.88 3.94

3.79

3.59

Average Capstone Assessments

Category2007 2008 2009 2010 2011 2012 2013

Select and Narrow Topic for Research or Projects

4.3

4.2

4.3

4.0

4.0

3.9

3.7

Use Computer Lit Skills/Info Databases for Research

4.2

3.7

4.2

4.0

3.8

3.9

3.8

Independently Read CS and IS Papers 4

.1 3

.5 4

.1 3

.9 3

.8 3

.8 3

.5Apply Concepts, Principles, and Theories

4.4

4.4

4.3

4.3

4.3

4.0

3.6

Critically Analyze, Evaluate Project or Thesis Results

4.1

4.1

4.3

4.0

3.9

3.7

3.5

Page 23: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Assess Conclusions and Implications of Research or Project

4.4

4.2

4.4

4.0

4.0

3.7

3.6

Present Research/Proj. Findings (Clear, Coherent, Succinct)

4.3

4.0

4.1

4.0

4.1

3.9

3.6

Evaluate Work of Others Objectively and Fairly

3.8

3.8

4.0

3.8

3.8

3.7

3.3

Analyze Bus. User's Needs/Develop Solution

4.3

4.2

4.3

3.3

3.9

3.7

3.5

Combine CS/IS Learning for Research or Bus. Opportunities

4.2

4.2

4.5

3.5

3.8

3.7

3.6

Page 24: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

2. Oral Communication Assessment Results

Fall 2010

Technical Knowledge Presentation Materials Presentation Style Presenter Presence0.00

1.00

2.00

3.00

4.00

5.004.57

3.863.43

2.71

4.42

3.42

2.422.17

4.503.90

3.242.76

MIS 565 Oral Communication Assessment

Fall 2008Fall 2009Fall 2010

Spring 2009

Page 25: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Appendix G: MSCSIS Goal 6 Findings

Content Knowledge Assessment Results, Fall 2010

Fall 2008

Fall 2009

Fall 2010

Fall 2011

Spring 2012

Fall 2012

Spring 2013

1. The main difference between TCP and UDP is: 69% 100% 87% 100% 83% 100% 83%2. World Wide Web technologies include: 92% 50% 100% 100% 92% 100% 67%3. When developing a network application, the primary programming interface is: 92% 100% 87% 100% 83% 75% 50%

4. Examples of distributed computing/programming paradigms include: 62% 100% 47% 75% 67% 75% 50%

5. Which of the following are social networking sites: 92% 100% 93% 100% 100% 100% 100%6. Wireshark is an example of: 100% 100% 100% 100% 100% 100% 100%7. ARP refers to: 100% 100% 93% 75% 100% 100% 83%8. DNS refers to: 92% 100% 87% 100% 83% 100% 100%9. Network security technologies include: 92% 50% 73% 100% 83% 75% 67%10. Database management systems used for web programming include: 92% 100% 93% 100% 100% 100% 100%

88% 90% 86% 95% 89% 93% 80%

13

2

15 4

12

4

6

Page 26: uncw.edu csb mscsis assessmen… · Web viewuncw.edu

Fall 2008 Fall 2009 Fall 2010 Fall 2011 Spring 2012

Fall 2012 Spring 2013

88%90%

86%

95%

89%93%

80%

CSC544 Network ProgrammingAssessment Scores