the biolab feedback report - university of strathclyde ... · web view“lovely relaxed...

The BioLab Feedback Report 2016Annual report based on the feedback form responses PCR (Updated Form)

Table of Contents

Page No.

Summary of Findings 2

Background and Objectives 2

Survey Method 2

Analysis 3 - 11

Conclusion 12 - 17

Appendix 18 - 19

Page 1 of 24

Summary of Findings

From the feedback form, the responses indicated the following:

97% believed the lab to be well prepared and organised.

96% agreed that the presentation was informative and helpful.

95% thought the lab practical enhanced their understanding of PCR.

97% were in agreement that the demonstrators were knowledgeable and approachable.

95% agreed the instructions were clear.

95% believed they learned new skills.

97% felt the pace of the lab was suitable.

97% would recommend the PCR lab.

Background and Objectives

The BioLab was set up by the previous Biology lecturer and technician. It was run by the technician until he left the

University. At this point Pam Tait (Chemistry technician) became responsible for the lab. Laura Gray (Biology

technician) joined the department and has been working with Pam on the BioLab during 2016.

There were previously 3 labs offered to secondary school senior pupils, but due to the changes in Higher/Higher

Human Biology/Advanced Higher courses, it was agreed we would focus on PCR. Pam worked on ways to reduce the

lab from a full day to a half day. As such, all aspects of the lab needed to be changed, from the presentations to the

practical experiment itself.

Survey Method

We devised an evaluation form for the pupils to fill in anonymously on the day of the lab. This would encourage

honest answers to be given, and also ensure we got feedback promptly, allowing changes to be made as we

progressed.

We used 8 statements based on the areas we felt were most important. Following feedback from the original form,

we changed statement 7 from “I was able to interpret my results” to “The pace of the lab was suitable”. All

statements had a space for comments and there were additional sections for comments on “things I enjoyed” and

“things that could be improved”.

The pupils filling in the form were either 5th or 6th year secondary school pupils sitting Higher/Human

Higher/Advanced Higher Biology. Teachers and other school visitors were also encouraged to participate.

We had 254 respondents to this version of the evaluation form.

The schools that visited the BioLab came from various local authorities (Renfrewshire, East Ayrshire, Glasgow,

Inverclyde and North Lanarkshire)

Page 2 of 24

Analysis

Statement 1 - The lab was well prepared and organised

It is important that our lab is well laid out and that the pupils are able to find the equipment they need.

The majority of respondents were in agreement with 93% strongly agreeing and 4% agreeing.

Comments include:

“We were early and they still managed to start straight away – very organised”

“Saved time by all prep work being done”

“It was very straight forward to do things as it was all set out”

“Easy to understand what to do”

“Everything was easy to find”

“Apparatus and instructions of high standard”

“Every test-tube was laid out neatly, labelled and easily accessible”

“Was well set out and prepared. Enough room on the desk”

1 - Strongly Disagree

2 - Disagree 3 - Don't Know 4 - Agree 5 - Strongly Agree

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 3 of 24

S1 - The lab was well prepared and organised

Response Percentage of Respondents

1 - Strongly Disagree 3%

2 - Disagree 0%

3 - Don't Know 0%

4 - Agree 4%

5 - Strongly Agree 93%

Statement 2 - The presentation was informative and helpful

The presentation includes information on the lab, and also virtual demonstrations of the processes. We wanted to

ensure it was a useful resource and aided the practical aspect of the lab.


Comments include:

“Excellent animations”

“Interesting and well informed”

“Clear and concise”

“I learned a lot”

“The virtual lab was extremely helpful”

“I learn better visually, so it was good”

“It had good diagrams”

“Yes, the presentation was visually pleasing making me pay attention”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 4 of 24

S2 - The presentation was informative and helpful



2 - Disagree 0%

3 - Don't Know 1%

4 - Agree 26%


Statement 3 - The lab practical enhanced my understanding of the subject

Our main aim is to provide a lab that helps the students understand PCR. We believe performing a practical

experiment will enhance any theory previously learnt.


Comments include:

“It reinforced my knowledge”

“It was good to be able to actually do the lab and learn the process in a different way”

“Having a first-hand experience with PCR has helped my knowledge”

“I wasn’t very confident on the process of PCR but now I am”

“Each stage explained clearly”

“It visualised the PCR process for me”

“Very independent doing steps – good for enhancing learning”

“I understand what PCR is now”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 5 of 24

S3 - The lab practical enhanced my understanding of the subject



2 - Disagree 1%

3 - Don't Know 2%

4 - Agree 29%


Statement 4 - The demonstrators were knowledgeable and approachable

We wanted to make sure the pupils felt comfortable in the lab, that they were able to ask for help when they

needed it, and understood the instructions given.


Comments include:

“Were round very often and were very helpful”

“Was easy to ask for advice”

“Made it easy for us to understand”

“Lovely relaxed but professional attitude maintained throughout in a setting which could be daunting for school

pupils”

“Fantastically helpful, incredibly patient with young people”

“Very easy going people who made me feel comfortable and confident in what I was doing”

“Excellent and very enthusiastic”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 6 of 24

S4 - The demonstrators were knowledgeable and approachable



2 - Disagree 0%

3 - Don't Know 0%

4 - Agree 11%


Statement 5 - The instructions were clear

We used various methods of instruction – demonstrations, PowerPoints and lab manuals. They should all

complement each other and make the process easier to comprehend.


Comments include:

“Liked that it is broken down in stages”

“Very clear in speaking”

“Very easy to follow”

“Booklets helped, if I forgot/not sure I could check it”

“We had a booklet that took us step by step which I enjoyed”

“Loud and clear”

“3 ways – verbal, pictoral and written. Covers all learning styles”

“Step-by-step guide was excellent”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 7 of 24

S5 - The instructions were clear



2 - Disagree 0%

3 - Don't Know 2%

4 - Agree 18%


Statement 6 – I learned new skills

We hope to make the experience a valuable one for the pupils and provide them with various techniques/pieces of

equipment they are unlikely to have used before.


Comments include:

“Learned to use a micropipette and a vortex mixer”

“Measuring accurately”

“Gave us a chance to use new equipment such as the centrifuge”

“Working independently”

“Learnt how to extract DNA from plants using specialist equipment”

“I think it also improved my confidence in practical experiments”

“I learned how to load the gel”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 8 of 24

S6 - I learned new skills



2 - Disagree 0%

3 - Don't Know 2%

4 - Agree 23%


Statement 7 – The pace of the lab was suitable

Previously this statement was about the pupils’ ability to interpret their results. We changed it as we were making a

conscious effort to keep everyone working on the same stage of the experiment. We thought this would help their

understanding of the subject while ensuring no one got left behind.


Comments include:

“It wasn’t too fast or slow”

“The pace was quick and understandable. It was really good”

“Found it quite easy to keep up”

“Was done at a good pace where you could learn what to do and then carry it out efficiently”

“Not rushed – pupils encouraged to try/practice techniques”

“The instructors made sure everyone was keeping up”

“The instructors were very patient”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 9 of 24

S7 - The pace of the lab was suitable



2 - Disagree 0%

3 - Don't Know 0%

4 - Agree 22%


Statement 8 – I would recommend this lab

We felt a key signifier in the pupils’ enjoyment was whether they would recommend the lab or not.


Comments include:

“Very interesting and fun to be able to complete the experiment”

“I’d give it 5 stars on yelp and a great review”

“Yes it was enjoyable”

“Something different and very interesting”

“It’s fun and informative”

“Very educational and demonstrators were very helpful”

“Definitely worth participating in this lab”

“What a phenomenal opportunity for young people to access practical, relevant scientific work”

“Open and friendly environment”



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Page 10 of 24

S8 - I would recommend this lab



2 - Disagree 0%

3 - Don't Know 0%

4 - Agree 12%


Additional Comments

Pupils were encouraged to provide comments on things they found useful and things that could be improved. We

felt this would allow for an open and more general feedback.

Things I found useful:

“Good clear instruction”

“Use of virtual lab was good”

“Lab instructors very friendly”

“How there was an information booklet as well as instructors to help you”

“Advice given by the demonstrators was good”

“I enjoyed using the equipment that we don’t get the chance to use in school”

“Being able to carry out the experiment myself”

“Got to practice the procedure in a real lab”

“It helped to further my understanding of the primers and process before amplification”

“To see the outcome of the gel electrophoresis”

“How to use pipette correctly”

“I enjoyed experiencing this as I plan to do something similar once I leave school so this was an insight into what

offers there are”

“All equipment was labelled and set out in an organised manner”

“Learning about lab processes”

“Learning I would like to continue Biology in later life”

“Practical work involving participation kept me from losing focus”

“I liked the fact that everyone went at the same pace and that nobody got left behind”

“I enjoyed the experiment and I feel as though it significantly improved my understanding of PCR”

Things that could be improved:

“Whole day”

“Maybe make a guide which is suitable for people of our ability”

“Maybe more instructors”

“Not shout the instructions but explain to groups individually”

“It would have been better if we could use human DNA (or our own)”

“Slow instructions down a little”

“Some of the PowerPoint was confusing”

“More space to do experiment”

“Have it a little faster pace”

“Have a break a bit earlier”

Page 11 of 24

Conclusion

The feedback from the updated form allowed us to check if the changes we made to the lab were effective.

We compared the results from the original form with the updated version:

Percentage of Respondents

Agreeing/ Strongly Agreeing

Statement Original Form Updated Form

S1 - The lab was well prepared and organised 100% 97%

S2 - The presentation was informative and helpful 97% 96%

S3 - The lab practical enhanced my understanding of the subject 98% 95%

S4 - The demonstrators were knowledgeable and approachable 100% 97%

S5 - The instructions were clear 97% 95%

S6 - I learned new skills 99% 95%

S7 - I was able to interpret my results/The pace of the lab was suitable 90% 97%

S8 - I would recommend this lab 99% 97%

We had 8 forms returned which marked all statements as disagree strongly or disagree. Due to the positive

comments left, we presume these to have been completed incorrectly. It is worth noting this, as they have been

included in the results. To prevent this in the future we will discuss the format of the form with the pupils.

Page 12 of 24


2 - Disagree 3 - Don't Know

4 - Agree 5 - Strongly Agree

0%10%20%30%40%50%60%70%80%90%

100%

Original Form Updated Form

Page 13 of 24

S1 - The lab was well prepared and organised


ResponseOriginal

FormUpdated

Form

1 - Strongly Disagree 0% 3%

2 - Disagree 0% 0%

3 - Don't Know 0% 0%

4 - Agree 8% 4%

5 - Strongly Agree 92% 93%

S2 - The presentation was informative and helpful


ResponseOriginal

FormUpdated

Form


2 - Disagree 1% 0%


4 - Agree 48% 26%





0%10%20%30%40%50%60%70%80%90%

100%





0%10%20%30%40%50%60%70%80%90%

100%


Page 14 of 24

S3 - The lab practical enhanced my understanding of the subject


ResponseOriginal

FormUpdated

Form


2 - Disagree 0% 1%


4 - Agree 41% 29%





0%10%20%30%40%50%60%70%80%90%

100%


Page 15 of 24

S4 - The demonstrators were knowledgeable and approachable


ResponseOriginal

FormUpdated

Form


2 - Disagree 0% 0%


4 - Agree 20% 11%


S5 - The instructions were clear


ResponseOriginal

FormUpdated

Form


2 - Disagree 2% 0%


4 - Agree 36% 18%





0%10%20%30%40%50%60%70%80%90%

100%





0%10%20%30%40%50%60%70%80%90%

100%


Page 16 of 24

S6 - I learned new skills


ResponseOriginal

FormUpdated

Form


2 - Disagree 0% 0%


4 - Agree 29% 23%





0%10%20%30%40%50%60%70%80%90%

100%


Page 17 of 24

S7 - I was able to interpret my results/The pace of the lab was suitable


ResponseOriginal

FormUpdated

Form


2 - Disagree 2% 0%


4 - Agree 54% 22%


S8 - I would recommend this lab


ResponseOriginal

FormUpdated

Form


2 - Disagree 0% 0%


4 - Agree 23% 12%





0%10%20%30%40%50%60%70%80%90%

100%


Page 18 of 24

The overall results for percentages of respondents agreeing/ strongly agreeing were similar in both the original and updated form. What we did see in all areas was an increase in the “strongly agree” response. The areas with the least increase were already scoring highly, so we felt this was another indicator that these were successful parts of the lab. These areas are:

1. The organisation of the lab

2. Our own approachability and helpfulness

3. The skills being learned

After the feedback from the original form we looked to improve various areas. The following is a reminder of the

changes made, and the results from the updated feedback:

1. The PowerPoint presentation

The feedback suggested the PowerPoint presentation was a bit confusing. We were providing the pupils with all of

the information for the lab at the beginning. We decided to split it into more manageable segments and intersperse

these through the lab to give timely and relevant information. We incorporated aims and improved our results

section, and from there created a conclusion.

We increased the “strongly agree” response from 49% to 70%. Although there are other factors to take into account,

such as pupil ability etc., we found across the board that pupils understood the process more after we broke it up

into manageable sections. There were more comments on the feedback forms about feelings of knowing what PCR is

now etc., and the results from statement 3 “The lab practical enhanced my understanding of the subject” also

showed an increase in the “strongly agree” response to back this up. As instructors we felt the conclusion was a

good addition and allowed us to finish the lab in a better way.

2. The instructions

We were very aware of the difficulty we faced at being heard over the centrifuges. This was only an issue when we

had a class of over 16 pupils, as the centrifuge holding 16+ tubes is very noisy. We also quickly realised some pupils

couldn’t see the demonstrator clearly. We created documents to go along with some of the demonstrations which we

put on the large screen, and split some of the other demonstrations into two groups with one demonstrator at each.

We increased the “strongly agree” response from 61% to 77% in statement 5 “The instructions were clear”. We felt

the extra guidance/documents and splitting the groups for some demonstrations was very effective. There were

comments regarding the instructions being too loud sometimes, but we felt this was better than the previous

situation of not being heard.

3. The electrophoresis part of the experiment

One of the main areas which slowed down the lab was running the gel electrophoresis. Each pupil had a single tank

which had to be checked before being connected to a power pack. We reduced this time-consuming task by

purchasing multi-gel tanks. (This change of kit meant we also had to change the instruction manuals).

This had the additional bonus of providing the pupils with more bench space and also speeded up the lab, allowing

plenty of time to discuss the results.

Page 19 of 24

4. The feedback form

We asked if pupils were able to interpret their results. However, they filled out their forms in the time while they were

waiting for the gel to run, so had no results to check. We decided to change this statement to one about the pace of

the lab, as we were making a conscious effort to keep everyone working together.

Statement 7 was the one we swapped from “I was able to interpret my results” to “The pace of the lab was suitable”.

We felt it was a more suitable question and that our decision to change it was correct.

Ongoing improvements:

When looking at the additional comments and the “things that could be improved” section, we found there were

fewer areas we could improve on. Some felt the pace was too fast, others a bit too slow – we are catering to

everyone, so this is unavoidable. Again in terms of having a longer break/break earlier in the lab, we inform the

school before they book that there is only a break after 2hrs, and it is for 30mins. They have the option to choose

their start time and to extend their break. We have decided to ensure schools are given the following information:

The PCR lab runs for 3 hours. We request that you add 30mins onto this if travelling by coach/minibus to allow for

pick up and drop off time. There is a natural 30min break at approx. 2hrs into the lab (this can be extended by

request) – please ensure pupils are aware of this and have eaten before they arrive.

Other comments provide good ideas:

“Whole day”

“Maybe more instructors”

“Not shout the instructions but explain to groups individually”

“It would have been better if we could use human DNA (or our own)”

“More space to do experiment”

Unfortunately we are restricted in having 2 demonstrators/ working with the space and resources we have while

also taking the schools’ requirements into account.

We have plans to include the BioLab on the University’s website. We are hoping this will provide all the information

the schools need, as well as an online booking system.

Next year will see us in a different lab, with a slightly different layout. We will continue to review and make

improvements to the BioLab as time/money allows.

Page 20 of 24

Appendix

Page 21 of 24

StatementStrongly Disagree Disagree

Don't know Agree

Strongly Agree

The lab was well prepared and organised

The presentation was informative and helpful

The lab practical enhanced my understanding of the subject

The demonstrators were knowledgeable and approachable

The instructions were clear

I learned new skills

The pace of the lab was suitable

I would recommend this lab

Comments:

Comments:

The BioLabEvaluation Form

If you wish to expand, fill in the comments box - please be honest and constructive

Comments:

Comments:

Comments:

Please turn over and complete the next section

Indicate your views by ticking one box for each statement

Responses are anonymous

Lab Attended - __________________________ Date - ____________

Comments:

Comments:

Comments:

Page 22 of 24

the biolab feedback report - university of strathclyde ... · web view“lovely relaxed...

Documents